2024-05-12T10:34:20.693 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-12T10:34:20.694 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265 --owner scheduled_leonidus@teuthology --verbose --name leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} -- /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/orig.config.yaml 2024-05-12T10:34:20.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-12T10:34:20.875 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265 branch: wip-lusov-quiesce-lock-auth description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} email: null first_in_suite: false job_id: '7703265' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lusov-quiesce-lock-auth ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: f1ec882358465db8f363a3865fa83f099183688a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: f1ec882358465db8f363a3865fa83f099183688a kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiesce-lock-auth sha1: f1ec882358465db8f363a3865fa83f099183688a owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 7749 sha1: f1ec882358465db8f363a3865fa83f099183688a sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiesce-lock-auth suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f1ec882358465db8f363a3865fa83f099183688a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f1ec882358465db8f363a3865fa83f099183688a syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAAhLey9zL+rUEFGqEJN9UUvpB74fVIlQTJfICdHw2JmRxlVgEfzm7Vlau2fhNBm5mE2LEqCyYcMPWwPtnEyz5k= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJIWz+Ox8RR+0LrFeazc09VwoQJqY2FtkklVyDVmvp99VsPeY6GqMyqANcGMN0WZHHLFJjfleWSc30AHq2By7HM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - quiescer: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-12_10:14:03 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-12T10:34:20.875 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f1ec882358465db8f363a3865fa83f099183688a/qa; will attempt to use it 2024-05-12T10:34:20.876 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f1ec882358465db8f363a3865fa83f099183688a/qa/tasks 2024-05-12T10:34:20.877 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-12T10:34:20.878 INFO:teuthology.task.internal:Checking packages... 2024-05-12T10:34:20.901 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'f1ec882358465db8f363a3865fa83f099183688a' 2024-05-12T10:34:20.901 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-12T10:34:20.901 INFO:teuthology.packaging:ref: None 2024-05-12T10:34:20.901 INFO:teuthology.packaging:tag: None 2024-05-12T10:34:20.901 INFO:teuthology.packaging:branch: wip-lusov-quiesce-lock-auth 2024-05-12T10:34:20.902 INFO:teuthology.packaging:sha1: f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:34:20.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lusov-quiesce-lock-auth 2024-05-12T10:34:21.043 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3517-gf1ec8823-1jammy 2024-05-12T10:34:21.045 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-12T10:34:21.052 INFO:teuthology.task.internal:no buildpackages task found 2024-05-12T10:34:21.052 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-12T10:34:21.059 INFO:teuthology.task.internal:Saving configuration 2024-05-12T10:34:21.079 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-12T10:34:21.085 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-12T10:34:21.111 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-12 10:28:33.481476', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIESaZbCpK8QEDWqxHHItMEB5gLQEpwhojbNqE4ql9j/W'} 2024-05-12T10:34:21.133 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-12 10:28:33.479812', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGswuXG7ugf2PjbQVD7W9xIsuOyA8Vap+TreX0mOiyre'} 2024-05-12T10:34:21.133 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-12T10:34:21.139 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-12T10:34:21.139 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-12T10:34:21.139 INFO:teuthology.run_tasks:Running task console_log... 2024-05-12T10:34:21.204 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f06216685e0>, signals=[15]) 2024-05-12T10:34:21.205 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-12T10:34:21.212 INFO:teuthology.task.internal:Opening connections... 2024-05-12T10:34:21.212 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:34:21.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:34:21.341 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-05-12T10:34:21.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:34:21.425 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-12T10:34:21.433 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-05-12T10:34:21.439 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-05-12T10:34:21.439 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-05-12T10:34:21.484 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-12T10:34:21.484 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Ubuntu" 2024-05-12T10:34:21.484 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="22.04" 2024-05-12T10:34:21.484 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-12T10:34:21.484 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_CODENAME=jammy 2024-05-12T10:34:21.484 INFO:teuthology.orchestra.run.smithi115.stdout:ID=ubuntu 2024-05-12T10:34:21.484 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE=debian 2024-05-12T10:34:21.484 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-12T10:34:21.485 INFO:teuthology.orchestra.run.smithi115.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-12T10:34:21.485 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-12T10:34:21.485 INFO:teuthology.orchestra.run.smithi115.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-12T10:34:21.485 INFO:teuthology.orchestra.run.smithi115.stdout:UBUNTU_CODENAME=jammy 2024-05-12T10:34:21.485 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-05-12T10:34:21.507 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-05-12T10:34:21.512 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-05-12T10:34:21.512 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-05-12T10:34:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-12T10:34:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2024-05-12T10:34:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="22.04" 2024-05-12T10:34:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-12T10:34:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=jammy 2024-05-12T10:34:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2024-05-12T10:34:21.564 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2024-05-12T10:34:21.565 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-12T10:34:21.565 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-12T10:34:21.565 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-12T10:34:21.565 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-12T10:34:21.565 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=jammy 2024-05-12T10:34:21.565 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-05-12T10:34:21.580 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-12T10:34:21.590 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-12T10:34:21.596 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-12T10:34:21.596 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-05-12T10:34:21.599 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-05-12T10:34:21.613 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-12T10:34:21.621 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-12T10:34:21.621 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-05-12T10:34:21.647 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-05-12T10:34:21.661 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-12T10:34:21.721 INFO:teuthology.run_tasks:Running task kernel... 2024-05-12T10:34:21.736 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-05-12T10:34:21.736 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-05-12T10:34:21.736 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-05-12T10:34:21.736 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-12T10:34:21.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:34:21.741 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-05-12T10:34:21.916 DEBUG:teuthology.task.kernel:sha1 for client.0 is fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-12T10:34:21.916 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e"... 2024-05-12T10:34:21.917 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-05-12T10:34:21.922 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-56-generic 2024-05-12T10:34:21.923 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-12T10:34:21.923 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-12T10:34:21.923 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-05-12T10:34:21.924 DEBUG:teuthology.orchestra.run.smithi115:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-05-12T10:34:21.976 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-05-12T10:34:22.114 INFO:teuthology.orchestra.run.smithi115.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-05-12T10:34:22.114 INFO:teuthology.orchestra.run.smithi115.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-05-12T10:34:22.114 INFO:teuthology.orchestra.run.smithi115.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-05-12T10:34:22.114 INFO:teuthology.orchestra.run.smithi115.stderr:hint: 2024-05-12T10:34:22.114 INFO:teuthology.orchestra.run.smithi115.stderr:hint: git config --global init.defaultBranch 2024-05-12T10:34:22.115 INFO:teuthology.orchestra.run.smithi115.stderr:hint: 2024-05-12T10:34:22.115 INFO:teuthology.orchestra.run.smithi115.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-05-12T10:34:22.115 INFO:teuthology.orchestra.run.smithi115.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-05-12T10:34:22.115 INFO:teuthology.orchestra.run.smithi115.stderr:hint: 2024-05-12T10:34:22.115 INFO:teuthology.orchestra.run.smithi115.stderr:hint: git branch -m 2024-05-12T10:34:22.115 INFO:teuthology.orchestra.run.smithi115.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-05-12T10:34:22.117 DEBUG:teuthology.orchestra.run.smithi115:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-05-12T10:34:22.193 DEBUG:teuthology.orchestra.run.smithi115:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-05-12T10:34:22.250 DEBUG:teuthology.orchestra.run.smithi115:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-05-12T10:35:04.052 INFO:teuthology.orchestra.run.smithi115.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-05-12T10:35:04.053 INFO:teuthology.orchestra.run.smithi115.stderr: * [new branch] main -> origin/main 2024-05-12T10:35:04.083 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190312 -> 20190312 2024-05-12T10:35:04.083 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190416 -> 20190416 2024-05-12T10:35:04.083 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190514 -> 20190514 2024-05-12T10:35:04.083 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190618 -> 20190618 2024-05-12T10:35:04.083 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190717 -> 20190717 2024-05-12T10:35:04.083 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190815 -> 20190815 2024-05-12T10:35:04.083 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190923 -> 20190923 2024-05-12T10:35:04.083 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20191022 -> 20191022 2024-05-12T10:35:04.084 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20191215 -> 20191215 2024-05-12T10:35:04.084 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200122 -> 20200122 2024-05-12T10:35:04.084 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200316 -> 20200316 2024-05-12T10:35:04.084 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200421 -> 20200421 2024-05-12T10:35:04.084 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200519 -> 20200519 2024-05-12T10:35:04.086 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200619 -> 20200619 2024-05-12T10:35:04.086 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200721 -> 20200721 2024-05-12T10:35:04.086 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200817 -> 20200817 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200918 -> 20200918 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20201022 -> 20201022 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20201118 -> 20201118 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20201218 -> 20201218 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210208 -> 20210208 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210315 -> 20210315 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210511 -> 20210511 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210716 -> 20210716 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210818 -> 20210818 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210919 -> 20210919 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20211027 -> 20211027 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20211216 -> 20211216 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220209 -> 20220209 2024-05-12T10:35:04.087 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220310 -> 20220310 2024-05-12T10:35:04.088 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220411 -> 20220411 2024-05-12T10:35:04.088 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220509 -> 20220509 2024-05-12T10:35:04.088 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220610 -> 20220610 2024-05-12T10:35:04.088 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220708 -> 20220708 2024-05-12T10:35:04.088 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220815 -> 20220815 2024-05-12T10:35:04.088 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220913 -> 20220913 2024-05-12T10:35:04.090 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20221012 -> 20221012 2024-05-12T10:35:04.090 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20221109 -> 20221109 2024-05-12T10:35:04.090 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20221214 -> 20221214 2024-05-12T10:35:04.090 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20230117 -> 20230117 2024-05-12T10:35:04.090 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20230210 -> 20230210 2024-05-12T10:35:04.090 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20230310 -> 20230310 2024-05-12T10:35:04.090 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20230404 -> 20230404 2024-05-12T10:35:04.090 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20230515 -> 20230515 2024-05-12T10:35:04.090 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20230625 -> 20230625 2024-05-12T10:35:04.090 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20230804 -> 20230804 2024-05-12T10:35:04.091 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20230919 -> 20230919 2024-05-12T10:35:04.091 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20231030 -> 20231030 2024-05-12T10:35:04.091 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20231111 -> 20231111 2024-05-12T10:35:04.091 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20231211 -> 20231211 2024-05-12T10:35:04.091 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20240115 -> 20240115 2024-05-12T10:35:04.091 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20240220 -> 20240220 2024-05-12T10:35:04.091 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20240312 -> 20240312 2024-05-12T10:35:04.091 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20240410 -> 20240410 2024-05-12T10:35:08.364 INFO:teuthology.orchestra.run.smithi115.stderr:Updating files: 45% (1550/3419) Updating files: 46% (1573/3419) Updating files: 47% (1607/3419) Updating files: 48% (1642/3419) Updating files: 49% (1676/3419) Updating files: 50% (1710/3419) Updating files: 51% (1744/3419) Updating files: 52% (1778/3419) Updating files: 53% (1813/3419) Updating files: 54% (1847/3419) Updating files: 55% (1881/3419) Updating files: 56% (1915/3419) Updating files: 57% (1949/3419) Updating files: 58% (1984/3419) Updating files: 59% (2018/3419) Updating files: 59% (2041/3419) Updating files: 60% (2052/3419) Updating files: 61% (2086/3419) Updating files: 62% (2120/3419) Updating files: 63% (2154/3419) Updating files: 64% (2189/3419) Updating files: 65% (2223/3419) Updating files: 66% (2257/3419) Updating files: 67% (2291/3419) Updating files: 68% (2325/3419) Updating files: 69% (2360/3419) Updating files: 70% (2394/3419) Updating files: 70% (2400/3419) Updating files: 71% (2428/3419) Updating files: 72% (2462/3419) Updating files: 73% (2496/3419) Updating files: 74% (2531/3419) Updating files: 75% (2565/3419) Updating files: 76% (2599/3419) Updating files: 77% (2633/3419) Updating files: 78% (2667/3419) Updating files: 79% (2702/3419) Updating files: 80% (2736/3419) Updating files: 81% (2770/3419) Updating files: 82% (2804/3419) Updating files: 83% (2838/3419) Updating files: 83% (2849/3419) Updating files: 84% (2872/3419) Updating files: 85% (2907/3419) Updating files: 86% (2941/3419) Updating files: 87% (2975/3419) Updating files: 88% (3009/3419) Updating files: 89% (3043/3419) Updating files: 90% (3078/3419) Updating files: 91% (3112/3419) Updating files: 92% (3146/3419) Updating files: 93% (3180/3419) Updating files: 94% (3214/3419) Updating files: 95% (3249/3419) Updating files: 96% (3283/3419) Updating files: 97% (3317/3419) Updating files: 98% (3351/3419) Updating files: 99% (3385/3419) Updating files: 100% (3419/3419) Updating files: 100% (3419/3419), done. 2024-05-12T10:35:08.369 INFO:teuthology.orchestra.run.smithi115.stdout:HEAD is now at b9d2bf23 Merge branch 'robot/pr-0-1715362889' into 'main' 2024-05-12T10:35:08.391 INFO:teuthology.task.kernel:Downloading kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on client.0... 2024-05-12T10:35:08.391 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-12T10:35:08.620 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-gfb9a6a44107e/ 2024-05-12T10:35:08.620 DEBUG:teuthology.orchestra.run.smithi115:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-gfb9a6a44107e_6.9.0-rc3-gfb9a6a44107e-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-gfb9a6a44107e/ --input-file=- 2024-05-12T10:35:08.623 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi115.front.sepia.ceph.com to complete... 2024-05-12T10:35:10.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12 10:35:10 URL:https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-gfb9a6a44107e/linux-image-6.9.0-rc3-gfb9a6a44107e_6.9.0-rc3-gfb9a6a44107e-1_amd64.deb [44809390/44809390] -> "/tmp/linux-image.deb" [1] 2024-05-12T10:35:10.319 INFO:teuthology.orchestra.run.smithi115.stderr:FINISHED --2024-05-12 10:35:10-- 2024-05-12T10:35:10.319 INFO:teuthology.orchestra.run.smithi115.stderr:Total wall clock time: 1.7s 2024-05-12T10:35:10.320 INFO:teuthology.orchestra.run.smithi115.stderr:Downloaded: 1 files, 43M in 1.5s (27.6 MB/s) 2024-05-12T10:35:10.324 INFO:teuthology.task.kernel:Installing kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on client.0... 2024-05-12T10:35:10.324 DEBUG:teuthology.orchestra.run.smithi115:> sudo dpkg -i /tmp/linux-image.deb 2024-05-12T10:35:10.591 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-gfb9a6a44107e. 2024-05-12T10:35:12.637 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-05-12T10:35:12.641 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-05-12T10:35:12.771 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-6.9.0-rc3-gfb9a6a44107e (6.9.0-rc3-gfb9a6a44107e-1) ... 2024-05-12T10:35:16.832 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-6.9.0-rc3-gfb9a6a44107e (6.9.0-rc3-gfb9a6a44107e-1) ... 2024-05-12T10:35:16.949 INFO:teuthology.orchestra.run.smithi115.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:35:39.323 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub' 2024-05-12T10:35:39.339 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-12T10:35:39.363 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2024-05-12T10:35:39.680 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:35:39.698 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:35:39.973 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-12T10:35:39.989 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-12T10:35:40.050 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-12T10:35:40.056 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-12T10:35:40.225 INFO:teuthology.orchestra.run.smithi115.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-12T10:35:40.225 INFO:teuthology.orchestra.run.smithi115.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-12T10:35:40.225 INFO:teuthology.orchestra.run.smithi115.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-12T10:35:40.258 INFO:teuthology.orchestra.run.smithi115.stderr:done 2024-05-12T10:35:40.414 DEBUG:teuthology.orchestra.run.smithi115:> dpkg-deb -c /tmp/linux-image.deb 2024-05-12T10:35:40.422 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./ 2024-05-12T10:35:40.422 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./boot/ 2024-05-12T10:35:40.422 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7002012 2024-05-10 02:40 ./boot/System.map-6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:35:40.439 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 172073 2024-05-10 02:40 ./boot/config-6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:35:40.440 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13120512 2024-05-10 02:40 ./boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:35:40.461 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./etc/ 2024-05-12T10:35:40.461 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./etc/kernel/ 2024-05-12T10:35:40.461 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./etc/kernel/postinst.d/ 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./etc/kernel/postrm.d/ 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./etc/kernel/preinst.d/ 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./etc/kernel/prerm.d/ 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/ 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/ 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/ 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/ 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/ 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/ 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 507569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/aesni-intel.ko 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-12T10:35:40.462 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-12T10:35:40.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-12T10:35:40.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 97953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-12T10:35:40.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 109905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-12T10:35:40.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 155249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-12T10:35:40.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-12T10:35:40.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-12T10:35:40.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 87009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-12T10:35:40.465 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-12T10:35:40.465 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-12T10:35:40.465 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-12T10:35:40.465 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-12T10:35:40.465 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44657 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-12T10:35:40.465 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-12T10:35:40.465 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-12T10:35:40.465 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-12T10:35:40.465 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-12T10:35:40.466 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14809 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-12T10:35:40.466 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/ 2024-05-12T10:35:40.466 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/ 2024-05-12T10:35:40.466 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/ 2024-05-12T10:35:40.466 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-12T10:35:40.466 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpuid.ko 2024-05-12T10:35:40.466 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/msr.ko 2024-05-12T10:35:40.466 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/ 2024-05-12T10:35:40.466 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 444425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-12T10:35:40.466 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1035881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-12T10:35:40.467 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 2849609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm.ko 2024-05-12T10:35:40.571 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ 2024-05-12T10:35:40.571 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/af_alg.ko 2024-05-12T10:35:40.571 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/algif_hash.ko 2024-05-12T10:35:40.571 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/algif_skcipher.ko 2024-05-12T10:35:40.571 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ansi_cprng.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/anubis.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10929 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/arc4.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/asymmetric_keys/ 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/ 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_memcpy.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_pq.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_tx.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_xor.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/raid6test.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authenc.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authencesn.ko 2024-05-12T10:35:40.572 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blake2b_generic.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_common.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_generic.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/camellia_generic.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast5_generic.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast6_generic.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast_common.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ccm.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cmac.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crc32_generic.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cryptd.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_engine.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_simd.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_user.ko 2024-05-12T10:35:40.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cts.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/des_generic.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/dh_generic.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/echainiv.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/essiv.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/fcrypt.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/khazad.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lrw.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4hc.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13393 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/md4.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/michael_mic.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcbc.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcrypt.ko 2024-05-12T10:35:40.574 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/rmd160.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/seed.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/serpent_generic.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 169065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tcrypt.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tea.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_common.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_generic.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/vmac.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/wp512.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xcbc.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xor.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xts.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xxhash_generic.ko 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ 2024-05-12T10:35:40.575 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_extlog.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_pad.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/apei/ 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/apei/einj.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ec_sys.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/platform_profile.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbs.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbshc.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 119033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/video.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/acard-ahci.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 96825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci_platform.ko 2024-05-12T10:35:40.576 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 107737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci_platform.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_acpi.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ali.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_amd.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_artop.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atiixp.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28785 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atp867x.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd640.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28929 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd64x.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cypress.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_efar.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt366.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt37x.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-12T10:35:40.577 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-12T10:35:40.578 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it8213.ko 2024-05-12T10:35:40.578 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it821x.ko 2024-05-12T10:35:40.578 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_jmicron.ko 2024-05-12T10:35:40.578 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_legacy.ko 2024-05-12T10:35:40.578 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_marvell.ko 2024-05-12T10:35:40.578 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_mpiix.ko 2024-05-12T10:35:40.578 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_netcell.ko 2024-05-12T10:35:40.578 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ninja32.ko 2024-05-12T10:35:40.578 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87410.ko 2024-05-12T10:35:40.578 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87415.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_oldpiix.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_opti.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_optidma.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pcmcia.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_piccolo.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_radisys.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rdc.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rz1000.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sch.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_serverworks.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sil680.ko 2024-05-12T10:35:40.579 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sl82c105.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_triflex.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_via.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pdc_adma.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_inic162x.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 102121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_mv.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_nv.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_promise.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_qstor.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil24.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sis.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_svw.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sx4.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_uli.ko 2024-05-12T10:35:40.580 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_via.ko 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_vsc.ko 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ks0108.ko 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/ 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 163969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/bcma.ko 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/ 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/ 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 140865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/aoe.ko 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/ 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1241657 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/drbd.ko 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 203289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/floppy.ko 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/ 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 115265 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-12T10:35:40.581 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 143433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/nbd.ko 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/ 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 126617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/null_blk.ko 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 119873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/pktcdvd.ko 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 313217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/rbd.ko 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/ 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 117233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/ 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/zram.ko 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/applicom.ko 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hangcheck-timer.ko 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/ 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-12T10:35:40.582 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/via-rng.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 186921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 179561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/lp.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/ 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 103409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/mwave.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/nvram.ko 2024-05-12T10:35:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ppdev.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tlclk.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/ 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39193 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/xillybus/ 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/xillybus/xillybus_class.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62545 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/xillybus/xillybus_core.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13929 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/clk/ 2024-05-12T10:35:40.584 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/clk/clk-palmas.ko 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/clk/clk-si5351.ko 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/clk/clk-twl6040.ko 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/clk/clk-wm831x.ko 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/ 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 89257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 333657 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp.ko 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/ 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/ 2024-05-12T10:35:40.585 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/ 2024-05-12T10:35:40.586 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 751713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-12T10:35:40.586 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-05-12T10:35:40.586 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-12T10:35:40.586 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-aes.ko 2024-05-12T10:35:40.586 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-sha.ko 2024-05-12T10:35:40.586 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/ 2024-05-12T10:35:40.586 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 90441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-12T10:35:40.586 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/ 2024-05-12T10:35:40.586 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/dca.ko 2024-05-12T10:35:40.586 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/ 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 146769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 96145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/amd64_edac.ko 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/e752x_edac.ko 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/edac_mce_amd.ko 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3000_edac.ko 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3200_edac.ko 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5100_edac.ko 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5400_edac.ko 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7300_edac.ko 2024-05-12T10:35:40.587 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 64161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7core_edac.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i82975x_edac.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ie31200_edac.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 68697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/sb_edac.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/x38_edac.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/extcon/ 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/extcon/extcon-gpio.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/extcon/extcon-max14577.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35601 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/extcon/extcon-max77693.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/extcon/extcon-max8997.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/extcon/extcon-palmas.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/extcon/extcon-rt8973a.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/extcon/extcon-sm5502.ko 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/ 2024-05-12T10:35:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/dmi-sysfs.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/efi/ 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/efi/efi-pstore.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/ 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-adp5520.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-amd8111.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-arizona.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16745 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-da9052.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-da9055.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-dln2.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 81073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-f7188x.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-generic.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ich.ko 2024-05-12T10:35:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-kempld.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-lp3943.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-max7300.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-max730x.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24745 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-max732x.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-pca953x.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-pcf857x.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-rdc321x.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-sch.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-sch311x.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14265 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-tps65912.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-twl4030.ko 2024-05-12T10:35:40.590 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-twl6040.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17897 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-vx855.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-wm831x.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-wm8350.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-wm8994.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/ 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-a4tech.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43553 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-apple.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-appleir.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9393 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-aureal.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-axff.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-belkin.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-cherry.ko 2024-05-12T10:35:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-chicony.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 74393 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-cp2112.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-cypress.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-dr.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elecom.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elo.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-emsff.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ezkey.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gaff.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-generic.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gt683r.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gyration.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtekff.ko 2024-05-12T10:35:40.592 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-hyperv.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-icade.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kensington.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-keytouch.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kye.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12265 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lcpower.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-led.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lenovo.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37553 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lg-g15.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 68081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 121369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 97953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-magicmouse.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-microsoft.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-monterey.ko 2024-05-12T10:35:40.593 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-multitouch.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ntrig.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ortek.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-penmount.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-petalynx.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-picolcd.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-pl.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-plantronics.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-primax.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-rmi.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-common.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-12T10:35:40.594 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-saitek.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-samsung.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sjoy.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sony.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-speedlink.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-steelseries.ko 2024-05-12T10:35:40.595 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sunplus.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tivo.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tmff.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-topseed.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-twinhan.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 81113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-uclogic.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-waltop.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 184745 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-wiimote.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-xinmo.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zpff.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zydacron.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 319921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid.ko 2024-05-12T10:35:40.596 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/uhid.ko 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/usbhid/ 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 153633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/usbhid/usbhid.ko 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/usbhid/usbkbd.ko 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/usbhid/usbmouse.ko 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 261945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/wacom.ko 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/ 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 75065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_balloon.ko 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 110681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_utils.ko 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 382033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_vmbus.ko 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru.ko 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 67009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru3.ko 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-12T10:35:40.597 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7414.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7418.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adc128d818.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1025.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 115057 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1026.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1029.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1031.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm9240.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ads7828.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7410.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7411.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 89025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7462.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7470.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 81473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7475.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7x10.ko 2024-05-12T10:35:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/amc6821.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 68865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/applesmc.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60193 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asb100.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 69009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asc7621.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/atxp1.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/coretemp.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/da9052-hwmon.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/da9055-hwmon.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 113201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dme1737.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds1621.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds620.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc1403.ko 2024-05-12T10:35:40.599 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc2103.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc6w201.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71805f.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 108961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71882fg.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f75375s.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fam15h_power.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fschmd.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g760a.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g762.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl518sm.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 56313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl520sm.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hih6130.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5500_temp.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5k_amb.ko 2024-05-12T10:35:40.600 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmaem.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmpex.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina209.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina2xx.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 156465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/it87.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/jc42.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k10temp.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k8temp.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lineage-pem.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm63.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm73.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm75.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm77.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm78.ko 2024-05-12T10:35:40.601 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm80.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20545 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm83.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 86497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm85.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm87.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm90.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm92.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 131505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm93.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95234.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95241.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95245.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26393 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc2945.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4151.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4215.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4222.ko 2024-05-12T10:35:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4245.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4260.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4261.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max16065.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1619.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1668.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max197.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6639.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6650.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6697.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mc13783-adc.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mcp3021.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 56505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6683.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 141353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775-core.ko 2024-05-12T10:35:40.603 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 67841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct7802.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 97777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87360.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87427.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pcf8591.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33265 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-12T10:35:40.604 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/powr1220.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5627.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5636.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40849 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht15.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht21.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/shtc1.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sis5595.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47b397.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m1.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m192.ko 2024-05-12T10:35:40.605 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/thmc50.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp102.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp103.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp401.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp421.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via-cputemp.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via686a.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt1211.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt8231.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 71169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627ehf.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 96577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627hf.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83781d.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 75129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83791d.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 83425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83792d.ko 2024-05-12T10:35:40.606 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 116777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83793.ko 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 134441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83795.ko 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l785ts.ko 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l786ng.ko 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/ 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/ 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/ 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-05-12T10:35:40.607 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 64233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 76969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-12T10:35:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52937 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20057 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-05-12T10:35:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59193 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27849 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-mux.ko 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-smbus.ko 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-stub.ko 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/muxes/ 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ 2024-05-12T10:35:40.610 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 329697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1119913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_core.ko 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 83905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 408433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 120921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 347217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 84945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/ 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/ 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 590929 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/ 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 514641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/ 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 911665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-12T10:35:40.611 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 375545 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/ocrdma/ 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 197121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/usnic/ 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 212553 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 334401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 120673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 132585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ 2024-05-12T10:35:40.612 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 157937 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 156673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/ 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/evbug.ko 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/ff-memless.ko 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/ 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/gameport.ko 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/joydev.ko 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/ 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-05-12T10:35:40.613 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-05-12T10:35:40.614 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-12T10:35:40.614 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-05-12T10:35:40.614 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/lkkbd.ko 2024-05-12T10:35:40.614 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/lm8323.ko 2024-05-12T10:35:40.614 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/lm8333.ko 2024-05-12T10:35:40.614 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-05-12T10:35:40.614 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-05-12T10:35:40.614 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-05-12T10:35:40.614 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-05-12T10:35:40.614 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/newtonkbd.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/qt1070.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/qt2160.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/stowaway.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/sunkbd.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/xtkbd.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/matrix-keymap.ko 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/ 2024-05-12T10:35:40.615 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/appletouch.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39553 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/bcm5974.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 160017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/cyapatp.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 114273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/gpio_mouse.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 428185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/psmouse.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16937 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/sermouse.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27193 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18809 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/ 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 140969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/ 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/altera_ps2.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/arc_ps2.ko 2024-05-12T10:35:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/ct82c710.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18393 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/parkbd.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/pcips2.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/ps2mult.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serio_raw.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serport.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/sparse-keymap.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/ 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-88pm860x.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-adp5520.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77265 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-bd2802.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-blinkm.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11897 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-da903x.ko 2024-05-12T10:35:40.617 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-da9052.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-gpio.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3530.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3533.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm355x.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3642.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp3944.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12809 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp8788.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-max8997.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-mc13783.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-menf21bmc.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-pca9532.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23809 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-pca955x.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-pca963x.ko 2024-05-12T10:35:40.618 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-ss4200.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-tca6507.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-wm831x-status.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-wm8350.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16601 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/ 2024-05-12T10:35:40.619 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/ 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 790753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/bcache.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bio-prison.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 116825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bufio.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache-smq.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 199041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 134945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-crypt.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28897 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-delay.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 67497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-era.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-flakey.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log-userspace.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-mirror.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 97209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-multipath.ko 2024-05-12T10:35:40.620 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19809 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-queue-length.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-raid.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-region-hash.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-round-robin.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-service-time.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 139817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-snapshot.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-switch.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 234457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-thin-pool.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-verity.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-zero.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/ 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 264329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid0.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 125009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid1.ko 2024-05-12T10:35:40.621 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 157681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid10.ko 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 444665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid456.ko 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/ 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/ 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 214841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptbase.ko 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptctl.ko 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54785 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptfc.ko 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptlan.ko 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 150761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptsas.ko 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 97281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptscsih.ko 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 63873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptspi.ko 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/ 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/88pm800.ko 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/88pm805.ko 2024-05-12T10:35:40.622 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/88pm80x.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/arizona-i2c.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 148633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/arizona.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/bcm590xx.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/cros_ec_dev.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/dln2.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18601 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/janz-cmodio.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/kempld-core.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31897 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lm3533-core.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lp3943.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_ich.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_sch.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/max8907.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mc13xxx-core.ko 2024-05-12T10:35:40.623 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12937 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/menf21bmc.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/pcf50633-adc.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/pcf50633-gpio.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/pcf50633.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/retu-mfd.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 99425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/si476x-core.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58057 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/sm501.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/tps65010.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11785 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/tps6507x.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/viperboard.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/vx855.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wl1273-core.ko 2024-05-12T10:35:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wm8994.ko 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/ 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 64265 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/ad525x_dpot.ko 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/ 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds9802als.ko 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds990x.ko 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/bh1770glc.ko 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/c2port/ 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/c2port/core.ko 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/ 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/cb710.ko 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/ds1682.ko 2024-05-12T10:35:40.625 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/dummy-irq.ko 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/echo/ 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/echo/echo.ko 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/ 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/at24.ko 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/max6875.ko 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/enclosure.ko 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/genwqe/ 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 191649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hmc6352.ko 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hpilo.ko 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/ibmasm/ 2024-05-12T10:35:40.626 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 92345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/ics932s401.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29003.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29020.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/ 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/ 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 154169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-me.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 69809 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-txe.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 389033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/phantom.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/ti-st/ 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/ti-st/st_drv.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_7xx1.ko 2024-05-12T10:35:40.627 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_core.ko 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tsl2550.ko 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_balloon.ko 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/ 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 234905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/ 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 620961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/bonding.ko 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/ 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/ 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 139817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49545 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/ 2024-05-12T10:35:40.628 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 587065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19553 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dummy.ko 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/eql.ko 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/ 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 158649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 73865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 109521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-12T10:35:40.629 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/ 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 64705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/ 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 84329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/ 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/ 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/ 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 56057 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 115881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/ 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/ 2024-05-12T10:35:40.630 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 124497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 128409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 110345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/ 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 88953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/ 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 105633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 228985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1733353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 167185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-12T10:35:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/ 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 161417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 440625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/ 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/ 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 432201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/ 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 257201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 446177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1311433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 206689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-12T10:35:40.632 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/ 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/ 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 269313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/ 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/ 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 169089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 76209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/ 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 75945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-12T10:35:40.633 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-12T10:35:40.634 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dnet.ko 2024-05-12T10:35:40.634 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ec_bhf.ko 2024-05-12T10:35:40.634 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/ 2024-05-12T10:35:40.634 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/ 2024-05-12T10:35:40.634 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 356377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-12T10:35:40.634 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ethoc.ko 2024-05-12T10:35:40.634 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 63185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fealnx.ko 2024-05-12T10:35:40.634 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fujitsu/ 2024-05-12T10:35:40.634 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-05-12T10:35:40.634 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 115569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/ 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 366217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/ 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 755793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/ 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 324577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/ 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1196297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/ 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 362593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/ 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 671801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-12T10:35:40.635 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/ 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 121537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 966705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 193585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 108633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/jme.ko 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/ 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 126881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 150777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/ 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 905033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 344145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-12T10:35:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-05-12T10:35:40.637 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-05-12T10:35:40.637 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1412417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-12T10:35:40.723 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ 2024-05-12T10:35:40.723 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-05-12T10:35:40.723 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-05-12T10:35:40.723 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-05-12T10:35:40.723 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 117353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-12T10:35:40.723 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/ 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 131425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 56689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/ 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 181081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/ 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 171417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/ 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/ 2024-05-12T10:35:40.724 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 300817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 105689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 885129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/ 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/ 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 81641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 100689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 264161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/samsung/ 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-05-12T10:35:40.725 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 142449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/ 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1350385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/ 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/ 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 80065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/ 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 74289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 79457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 100785 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 83441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/ 2024-05-12T10:35:40.726 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 644537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/ 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 128497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 207993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 82633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/ 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/ 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 110729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/ 2024-05-12T10:35:40.727 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 98689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 102513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/ 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/ 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 69913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/fddi/ 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/fddi/defxx.ko 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/fddi/skfp/ 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 275801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/fddi/skfp/skfp.ko 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/geneve.ko 2024-05-12T10:35:40.728 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/ 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 290441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/ 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ifb.ko 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 108329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvlan.ko 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvtap.ko 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/ 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-gpio.ko 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio.ko 2024-05-12T10:35:40.729 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mii.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/netconsole.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/nlmon.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/ 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/amd.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm87xx.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/broadcom.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/cicada.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/davicom.ko 2024-05-12T10:35:40.730 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/et1011c.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/icplus.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/lxt.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 103377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/marvell.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 96025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/micrel.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/national.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 121105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/phylink.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/qsemi.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/realtek.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/smsc.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ste10Xp.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/vitesse.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/plip/ 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/plip/plip.ko 2024-05-12T10:35:40.731 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_async.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppoe.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppox.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pptp.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35937 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sb1000.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/ 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slip.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sungem_phy.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 80161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tap.ko 2024-05-12T10:35:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/ 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 137321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team.ko 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_random.ko 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 108089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/veth.ko 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/ 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 176497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/ 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 383593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/vxlan.ko 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/ 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 175537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ 2024-05-12T10:35:40.733 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ntb.ko 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/ 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/ 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 335857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme-core.ko 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 126553 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme.ko 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/ 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 168145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport.ko 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_cs.ko 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 103889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_pc.ko 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_serial.ko 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/ 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/ 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-05-12T10:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-05-12T10:35:40.735 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pci-stub.ko 2024-05-12T10:35:40.735 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/xen-pcifront.ko 2024-05-12T10:35:40.735 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/ 2024-05-12T10:35:40.735 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/i82092.ko 2024-05-12T10:35:40.735 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 179961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pcmcia.ko 2024-05-12T10:35:40.735 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pcmcia_core.ko 2024-05-12T10:35:40.735 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-05-12T10:35:40.735 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pd6729.ko 2024-05-12T10:35:40.735 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 133753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-12T10:35:40.735 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/phy/ 2024-05-12T10:35:40.735 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/phy/broadcom/ 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/phy/samsung/ 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/ 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/ 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78193 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/ 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/chrome/ 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29657 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/chrome/cros_ec.ko 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-05-12T10:35:40.736 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/ 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 87481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acerhdf.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 73865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 164769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/hdaps.ko 2024-05-12T10:35:40.737 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/ibm_rtl.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/ 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14193 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel_ips.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51897 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-12T10:35:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11657 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/ 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/ 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/88pm860x_battery.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/88pm860x_charger.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 68833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/bq2415x_charger.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 73073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/bq24190_charger.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/bq24735-charger.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/da9030_battery.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/da9052-battery.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/ds2760_battery.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/ds2780_battery.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28809 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/ds2781_battery.ko 2024-05-12T10:35:40.739 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28657 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/ds2782_battery.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/gpio-charger.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/isp1704_charger.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/lp8727_charger.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/max14577_charger.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/max17042_battery.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/max8903_charger.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/max8925_power.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/pcf50633-charger.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/sbs-battery.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/test_power.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/tps65090-charger.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/wm831x_backup.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/wm831x_power.ko 2024-05-12T10:35:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/power/supply/wm8350_power.ko 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/ 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 73297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/ 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/ 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps_parport.ko 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/pps_core.ko 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91393 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp.ko 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp_kvm.ko 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/ 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/ 2024-05-12T10:35:40.741 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/ 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 67513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/fmpm.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/ 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-88pm80x.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-88pm860x.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-da9052.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-da9055.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-da9063.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 82225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-12T10:35:40.742 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16057 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-em3027.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-lp8788.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t86.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max6900.ko 2024-05-12T10:35:40.743 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max8907.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max8925.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max8997.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max8998.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-palmas.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 56777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21601 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf50633.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32657 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rc5t583.ko 2024-05-12T10:35:40.744 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-s35390a.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-tps6586x.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-tps65910.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-wm831x.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-wm8350.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-x1205.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 90377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-9xxx.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 69593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-sas.ko 2024-05-12T10:35:40.745 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-xxxx.ko 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 164569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/BusLogic.ko 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/a100u2w.ko 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/ 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 340721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 120337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/advansys.ko 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/ 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 468081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 380673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic94xx/ 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 243705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/am53c974.ko 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/ 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 135617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-12T10:35:40.746 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/atp870u.ko 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/ 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 304993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/ 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1527113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/bfa.ko 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/ 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 297801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/ 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 144401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ch.ko 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/ 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 390713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/ 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-05-12T10:35:40.747 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 88881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 117481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 173017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dc395x.ko 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dmx3191d.ko 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/ 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 267577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esp_scsi.ko 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/ 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 95329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 194017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fdomain.ko 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/ 2024-05-12T10:35:40.748 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 366529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/fnic.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 251505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hpsa.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hptiop.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hv_storvsc.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/imm.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/initio.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 327841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ipr.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 129785 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ips.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/ 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 397785 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/isci.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 63121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/ 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 386849 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/libfc.ko 2024-05-12T10:35:40.749 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 178177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi.ko 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 64809 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/ 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 274009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/libsas.ko 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/ 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 2736001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/ 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 88529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 389177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 104769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid.ko 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/ 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 836945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/ 2024-05-12T10:35:40.750 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 158729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 96537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvumi.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pcmcia/ 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28265 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/ 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 443745 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 152033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pmcraid.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ppa.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla1280.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/ 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 2324809 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 103601 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-12T10:35:40.751 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/ 2024-05-12T10:35:40.752 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 697337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-12T10:35:40.752 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qlogicfas408.ko 2024-05-12T10:35:40.752 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/raid_class.ko 2024-05-12T10:35:40.752 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 322865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_debug.ko 2024-05-12T10:35:40.752 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 219857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-12T10:35:40.752 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 357153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-12T10:35:40.752 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 121185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-12T10:35:40.752 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 93481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-12T10:35:40.752 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-12T10:35:40.752 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ses.ko 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 138121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/st.ko 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/stex.ko 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/ 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 205025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/virtio_scsi.ko 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/wd719x.ko 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/xen-scsifront.ko 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 174913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ssb.ko 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/ 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/ 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 920169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-12T10:35:40.753 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/ 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_file.ko 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_iblock.ko 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1170033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_mod.ko 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51897 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_pscsi.ko 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 149721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_user.ko 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/ 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 90057 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/ 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/ 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/ 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-12T10:35:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16745 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12929 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-12T10:35:40.755 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12849 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 99313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 69729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/moxa.ko 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/mxser.ko 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 134401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_gsm.ko 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_hdlc.ko 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/nozomi.ko 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/ 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/ 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44057 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-12T10:35:40.756 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/altera_uart.ko 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/arc_uart.ko 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/ 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 120577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/rp2.ko 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/sc16is7xx.ko 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/ 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 693081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/ 2024-05-12T10:35:40.757 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_aec.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_cif.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_dmem_genirq.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_mf624.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_netx.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pci_generic.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_sercos3.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/ 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/c67x00/ 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 90321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/c67x00/c67x00.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/chipidea/ 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 189209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-05-12T10:35:40.758 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/ 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101545 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-acm.ko 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 63073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 56721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usblp.ko 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 107417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usbtmc.ko 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/common/ 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/common/ulpi.ko 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/dwc2/ 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/dwc3/ 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-05-12T10:35:40.759 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 574593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/dwc3/dwc3.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/ 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/ 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/u_ether.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/u_serial.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43553 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 131345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 146617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-05-12T10:35:40.760 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 71257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 84937 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/ 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-05-12T10:35:40.761 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 204049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/libcomposite.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/ 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/bdc/ 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 182561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45545 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-05-12T10:35:40.762 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 69313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 90313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/net2272.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 90361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/net2280.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 94841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 80521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 87465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 95441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 195969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/ 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/bcma-hcd.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 108321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/isp116x-hcd.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 104377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 102273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-05-12T10:35:40.763 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811_cs.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/ssb-hcd.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32553 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/ 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/mdc800.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/microtek.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/adutux.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/appledisplay.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/cytherm.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ehset.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi26.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi62.ko 2024-05-12T10:35:40.764 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13057 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ezusb.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/idmouse.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/iowarrior.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ldusb.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/legousbtower.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/lvstest.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/ 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14601 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usb3503.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usblcd.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27809 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 84265 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbtest.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/uss720.ko 2024-05-12T10:35:40.765 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/yurex.ko 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/mon/ 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/mon/usbmon.ko 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/musb/ 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 396209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/musb/musb_hdrc.ko 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/ 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-generic.ko 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-isp1301.ko 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-tahvo.ko 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/aircable.ko 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ark3116.ko 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-12T10:35:40.766 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ch341.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 79681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cp210x.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cyberjack.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/empeg.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/f81232.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 188609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 152305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 142833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_ti.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 69217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipaq.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipw.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ir-usb.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-12T10:35:40.767 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 122329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mct_u232.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/metro-usb.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 79681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7720.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 89969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7840.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mxuport.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/navman.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/omninet.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/opticon.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 193857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/option.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/oti6858.ko 2024-05-12T10:35:40.768 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/pl2303.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcaux.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcserial.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/quatech2.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/safe_serial.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/sierra.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ssu100.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19601 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/symbolserial.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70497 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_debug.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 151137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usbserial.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/visor.ko 2024-05-12T10:35:40.769 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/whiteheat.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/wishbone-serial.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 64049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/uas.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-karma.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-12T10:35:40.770 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33849 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41785 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 201193 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/usb-storage.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/ 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 76041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 122321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/ 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/ 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 206921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 134265 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 93673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-12T10:35:40.771 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/ 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 138721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost.ko 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 71281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_net.ko 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 107905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_scsi.ko 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/ 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/ 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/aat2870_bl.ko 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/adp5520_bl.ko 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/adp8860_bl.ko 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51745 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/adp8870_bl.ko 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/apple_bl.ko 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/as3711_bl.ko 2024-05-12T10:35:40.772 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/bd6107.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/da903x_bl.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/da9052_bl.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13785 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/gpio_backlight.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/kb3886_bl.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lcd.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lm3533_bl.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23393 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lm3639_bl.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lv5207lp.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/max8925_bl.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/pandora_bl.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13057 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/wm831x_bl.ko 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/ 2024-05-12T10:35:40.773 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2482.ko 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2490.ko 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/matrox_w1.ko 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/w1-gpio.ko 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/ 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-12T10:35:40.774 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 129433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/wire.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/acquirewdt.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/advantechwdt.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/cpu5wdt.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/da9052_wdt.ko 2024-05-12T10:35:40.775 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/da9055_wdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/da9063_wdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/dw_wdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/eurotechwdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/hpwdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/i6300esb.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ib700wdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ibmasr.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it87_wdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/kempld_wdt.ko 2024-05-12T10:35:40.776 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/machzwd.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/mena21_wdt.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/nv_tco.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pc87413_wdt.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37193 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/retu_wdt.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sc1200wdt.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-05-12T10:35:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/softdog.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/twl4030_wdt.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/via_wdt.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23393 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wafer5823wdt.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wdt_pci.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wm831x_wdt.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wm8350_wdt.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/xen_wdt.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/ 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-evtchn.ko 2024-05-12T10:35:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntalloc.ko 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntdev.ko 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/ 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 213913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-privcmd.ko 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-scsiback.ko 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/ 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/ 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 192617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/9p.ko 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/adfs/ 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/adfs/adfs.ko 2024-05-12T10:35:40.779 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/ 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 197849 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/affs.ko 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/afs/ 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1261113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/afs/kafs.ko 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/autofs/ 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 127377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/autofs/autofs4.ko 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/ 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 80521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/befs.ko 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/bfs/ 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/bfs/bfs.ko 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/binfmt_misc.ko 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/ 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 4489593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/btrfs.ko 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/ 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 376857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/cachefiles.ko 2024-05-12T10:35:40.780 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1586065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ceph.ko 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/ 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 130073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/coda.ko 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/configfs/ 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 139081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/configfs/configfs.ko 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/ 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/cramfs.ko 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/ 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 813225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/dlm.ko 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/efs/ 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/efs/efs.ko 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/ 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1906817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/f2fs.ko 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/ 2024-05-12T10:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/msdos.ko 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/freevxfs/ 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/freevxfs/freevxfs.ko 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/ 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/cuse.ko 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/ 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1486521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/gfs2.ko 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/ 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 183305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/hfs.ko 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/ 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 282097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/hfsplus.ko 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hpfs/ 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 249009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hpfs/hpfs.ko 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/ 2024-05-12T10:35:40.782 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 93033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/isofs.ko 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/ 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 533073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/jfs.ko 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/ 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 361369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/lockd.ko 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/ 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 112609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/minix.ko 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/ 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 591585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/netfs.ko 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/ 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/ 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 102561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/ 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 74353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/ 2024-05-12T10:35:40.783 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 147689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1320249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfs.ko 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 82105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv2.ko 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 151641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv3.ko 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 2518505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv4.ko 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/ 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19849 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/grace.ko 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/nfs_acl.ko 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/ 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 2024049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/nfsd.ko 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/ 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 734025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/nilfs2.ko 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/ 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-celtic.ko 2024-05-12T10:35:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-centeuro.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-croatian.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-cyrillic.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-gaelic.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-greek.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-iceland.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-inuit.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-roman.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-romanian.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-turkish.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ascii.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1250.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1251.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1255.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp737.ko 2024-05-12T10:35:40.785 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp775.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp850.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp852.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp855.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp857.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp860.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp861.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14657 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp862.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp863.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp864.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp865.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp866.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp869.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp874.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 95625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp932.ko 2024-05-12T10:35:40.786 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 144209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp936.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 167137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp949.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 119513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp950.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_euc-jp.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-1.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-13.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-14.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-15.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-2.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-3.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-4.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-5.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-6.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-7.ko 2024-05-12T10:35:40.787 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-9.ko 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-r.ko 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-ru.ko 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-u.ko 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9601 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_utf8.ko 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 302073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 548169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 3245617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2.ko 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-12T10:35:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/omfs/ 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 67489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/omfs/omfs.ko 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/ 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 462873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/overlay.ko 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 67977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ramoops.ko 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/qnx4/ 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/qnx4/qnx4.ko 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/qnx6/ 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 56097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/qnx6/qnx6.ko 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/quota/ 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/quota/quota_tree.ko 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/quota/quota_v1.ko 2024-05-12T10:35:40.789 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/quota/quota_v2.ko 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/ 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 684841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/reiserfs.ko 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/ 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/romfs.ko 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/ 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/ 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 3319041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/cifs.ko 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/ 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_arc4.ko 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_md4.ko 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/ 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 164185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/squashfs.ko 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/ 2024-05-12T10:35:40.790 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 115977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/sysv.ko 2024-05-12T10:35:40.791 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/ 2024-05-12T10:35:40.791 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 310017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/udf.ko 2024-05-12T10:35:40.791 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ 2024-05-12T10:35:40.791 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 198233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ufs.ko 2024-05-12T10:35:40.791 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/ 2024-05-12T10:35:40.791 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 5192705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/xfs.ko 2024-05-12T10:35:40.834 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/ 2024-05-12T10:35:40.834 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/locking/ 2024-05-12T10:35:40.834 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 97625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/locking/locktorture.ko 2024-05-12T10:35:40.834 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/time/ 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/time/test_udelay.ko 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/torture.ko 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc-itu-t.ko 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc7.ko 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc8.ko 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/ 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libarc4.ko 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libdes.ko 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/interval_tree_test.ko 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/libcrc32c.ko 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lru_cache.ko 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/ 2024-05-12T10:35:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4_compress.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4hc_compress.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/ 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7281 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/cordic.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/memory-notifier-error-inject.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/notifier-error-inject.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/percpu_test.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/pm-notifier-error-inject.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/ 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 152025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/raid6_pq.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/rbtree_test.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/ 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/test-kstrtox.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 4912441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/test_bpf.ko 2024-05-12T10:35:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/test_firmware.ko 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7121 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/test_module.ko 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24937 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/test_user_copy.ko 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_bm.ko 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_fsm.ko 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_kmp.ko 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/xz/ 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/xz/xz_dec_test.ko 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/ 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/hwpoison-inject.ko 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/ 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/6lowpan.ko 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_dest.ko 2024-05-12T10:35:40.837 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_fragment.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_hop.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_mobility.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_routing.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_udp.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/ 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/garp.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/mrp.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9849 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/p8022.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/psnap.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13537 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/stp.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/ 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 106793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/8021q.ko 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/ 2024-05-12T10:35:40.838 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 236793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet.ko 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_fd.ko 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_rdma.ko 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_virtio.ko 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/ 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 879697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/batman-adv.ko 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/ 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 84761 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/br_netfilter.ko 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1030873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/bridge.ko 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-12T10:35:40.839 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9569 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-12T10:35:40.840 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70529 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtables.ko 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/ 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1243505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/libceph.ko 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/ 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 153801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/pktgen.ko 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/ 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 244889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp.ko 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_diag.ko 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 71033 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv4.ko 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 74993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv6.ko 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/ 2024-05-12T10:35:40.841 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 507705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/dsa_core.ko 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_brcm.ko 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_dsa.ko 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_none.ko 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_trailer.ko 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/hsr/ 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 128873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/hsr/hsr.ko 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 357425 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154.ko 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59393 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ah4.ko 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/esp4.ko 2024-05-12T10:35:40.842 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/fou.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21937 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/gre.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/inet_diag.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 75489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_gre.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_tunnel.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_vti.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipcomp.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34745 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipip.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50169 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ip_tables.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-12T10:35:40.843 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-12T10:35:40.844 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_bic.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_dctcp.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_diag.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_highspeed.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_htcp.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11665 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_hybla.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_illinois.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11737 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_lp.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9601 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_scalable.ko 2024-05-12T10:35:40.845 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_vegas.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_veno.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_westwood.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11745 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_yeah.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tunnel4.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_diag.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_tunnel.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ah6.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/esp6.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/fou6.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 103177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_gre.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 118881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_tunnel.ko 2024-05-12T10:35:40.846 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 71089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_vti.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ipcomp6.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/mip6.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15929 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-12T10:35:40.847 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-12T10:35:40.848 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 94089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/sit.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/tunnel6.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/ 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 106369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/af_key.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/ 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 153217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_core.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_eth.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip6.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_netlink.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ppp.ko 2024-05-12T10:35:40.849 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/lapb/ 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 63345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/lapb/lapb.ko 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/ 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc.ko 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 332889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc2.ko 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/ 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 388873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/mac802154.ko 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/ 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/mpls_gso.ko 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 147745 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set.ko 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32553 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-12T10:35:40.850 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 124041 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 124345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 126681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 126473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 137833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 133681 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 139073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 138265 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 136177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 139897 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 534113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-12T10:35:40.851 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20953 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24577 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12649 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15977 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12809 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conncount.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 496817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack.ko 2024-05-12T10:35:40.852 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 134377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24513 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 140801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18937 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 79873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 117201 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table.ko 2024-05-12T10:35:40.853 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_log_syslog.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 118369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14185 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13345 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_irc.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_sip.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53393 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 807985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_tables.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53049 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_log.ko 2024-05-12T10:35:40.854 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_chain_nat.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_compat.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50657 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_ct.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11081 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13745 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fib.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16545 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_hash.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_limit.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17921 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_log.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_masq.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_nat.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16473 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_numgen.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13945 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_osf.ko 2024-05-12T10:35:40.855 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_queue.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16657 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_redir.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject_inet.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15057 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_socket.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24993 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_synproxy.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17641 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_tproxy.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 108393 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/x_tables.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14193 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_AUDIT.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CT.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_DSCP.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HL.ko 2024-05-12T10:35:40.856 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15745 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HMARK.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45217 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15937 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LED.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13017 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LOG.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NETMAP.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10857 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFLOG.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15361 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23089 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_RATEEST.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12553 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16689 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_SECMARK.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18985 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20697 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TEE.ko 2024-05-12T10:35:40.857 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TPROXY.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TRACE.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15289 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_addrtype.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16633 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_bpf.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cgroup.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cluster.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_comment.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11961 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connbytes.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlabel.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlimit.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connmark.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14209 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_conntrack.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cpu.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dccp.ko 2024-05-12T10:35:40.858 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_devgroup.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10257 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dscp.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12657 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ecn.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_esp.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hashlimit.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_helper.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hl.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipcomp.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_iprange.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipvs.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19193 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_l2tp.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9137 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_length.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11521 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_limit.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mac.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mark.ko 2024-05-12T10:35:40.859 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_multiport.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nat.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nfacct.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_osf.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11561 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_owner.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_physdev.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_pkttype.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13553 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_policy.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_quota.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11881 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_rateest.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9273 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_realm.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_recent.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_sctp.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36489 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_set.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_socket.ko 2024-05-12T10:35:40.860 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10753 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_state.ko 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10849 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_statistic.ko 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_string.ko 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpmss.ko 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18449 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpudp.ko 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12441 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_time.ko 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_u32.ko 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/ 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17233 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/netlink_diag.ko 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/ 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14073 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/nsh.ko 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/ 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 488825 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/openvswitch.ko 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12009 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-geneve.ko 2024-05-12T10:35:40.861 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10873 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-gre.ko 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-vxlan.ko 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/ 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15929 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/af_packet_diag.ko 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/phonet/ 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 142025 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/phonet/phonet.ko 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 68817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/phonet/pn_pep.ko 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/ 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 318617 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds.ko 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 202305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_rdma.ko 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85105 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_tcp.ko 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rxrpc/ 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1027897 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rxrpc/rxrpc.ko 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/ 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39001 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_csum.ko 2024-05-12T10:35:40.862 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28721 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_gact.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_mirred.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27593 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_nat.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53465 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_pedit.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38705 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_police.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23969 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_simple.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43417 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_skbedit.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45673 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_vlan.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32129 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_basic.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41457 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_bpf.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23225 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_cgroup.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37305 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_flow.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39601 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_fw.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49321 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_route.ko 2024-05-12T10:35:40.863 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 79145 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_u32.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8713 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_cmp.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15385 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_ipset.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48785 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_meta.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9241 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_nbyte.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13369 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_text.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8377 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_u32.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_choke.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25097 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_codel.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43481 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_drr.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39177 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq_codel.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_gred.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62817 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hfsc.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26585 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hhf.ko 2024-05-12T10:35:40.864 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 81833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_htb.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33545 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_ingress.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36625 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12297 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio_lib.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33065 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_multiq.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44793 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_netem.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32833 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_pie.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13505 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_plug.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_prio.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60249 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_qfq.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_red.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33433 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfb.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38329 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfq.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35777 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_tbf.ko 2024-05-12T10:35:40.865 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34161 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_teql.ko 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/ 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1187313 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp.ko 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23913 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp_diag.ko 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/ 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/ 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 432409 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70113 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1940889 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/sunrpc.ko 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/ 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 890729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/ 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1122337 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc.ko 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12153 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc_diag.ko 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/ 2024-05-12T10:35:40.866 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18801 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/unix_diag.ko 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/ 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 105609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 90265 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 123769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock.ko 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12905 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20401 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/x25/ 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 165841 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/x25/x25.ko 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/ 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26729 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_algo.ko 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23353 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 131865 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_user.ko 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 644769 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 628542 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias.bin 2024-05-12T10:35:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7706 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23609 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.alias.bin 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9941 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.bin 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70990 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.modinfo 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 146959 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 232835 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep.bin 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 210 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.devname 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72602 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.order 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 879 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.softdep 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 258450 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 313019 2024-05-10 02:40 ./lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols.bin 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./usr/ 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./usr/share/ 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./usr/share/doc/ 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2024-05-10 02:40 ./usr/share/doc/linux-image-6.9.0-rc3-gfb9a6a44107e/ 2024-05-12T10:35:40.868 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 173 2024-05-10 02:40 ./usr/share/doc/linux-image-6.9.0-rc3-gfb9a6a44107e/changelog.Debian.gz 2024-05-12T10:35:40.869 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 691 2024-05-10 02:40 ./usr/share/doc/linux-image-6.9.0-rc3-gfb9a6a44107e/copyright 2024-05-12T10:35:40.874 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:35:40.874 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:35:40.874 DEBUG:teuthology.orchestra.run.smithi115:> egrep '(submenu|menuentry.*6.9.0-rc3-gfb9a6a44107e).*{' /boot/grub/grub.cfg 2024-05-12T10:35:40.882 INFO:teuthology.orchestra.run.smithi115.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-12T10:35:40.882 INFO:teuthology.orchestra.run.smithi115.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-gfb9a6a44107e' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-gfb9a6a44107e-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-12T10:35:40.882 INFO:teuthology.orchestra.run.smithi115.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-gfb9a6a44107e (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-gfb9a6a44107e-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-12T10:35:40.882 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-05-12T10:35:40.883 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:35:40.883 DEBUG:teuthology.orchestra.run.smithi115:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-05-12T10:35:40.925 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi115.front.sepia.ceph.com to complete... 2024-05-12T10:35:41.332 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub' 2024-05-12T10:35:41.333 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-12T10:35:41.355 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2024-05-12T10:35:41.594 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:35:41.602 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:35:41.869 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-12T10:35:41.873 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-12T10:35:41.917 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-12T10:35:41.923 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-12T10:35:42.066 INFO:teuthology.orchestra.run.smithi115.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-12T10:35:42.066 INFO:teuthology.orchestra.run.smithi115.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-12T10:35:42.066 INFO:teuthology.orchestra.run.smithi115.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-12T10:35:42.075 INFO:teuthology.orchestra.run.smithi115.stderr:done 2024-05-12T10:36:13.175 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-12T10:36:13.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-12T10:36:13.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:36:31.647 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-05-12T10:36:40.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-12T10:36:40.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:36:43.714 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-05-12T10:36:55.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-12T10:36:55.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:37:55.719 DEBUG:teuthology.orchestra.remote:timed out 2024-05-12T10:38:10.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-12T10:38:10.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:38:10.955 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-05-12T10:38:11.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-12T10:38:11.602 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-gfb9a6a44107e"... 2024-05-12T10:38:11.602 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-05-12T10:38:11.650 INFO:teuthology.orchestra.run.smithi115.stdout:6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:38:11.651 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-gfb9a6a44107e vs 6.9.0-rc3-gfb9a6a44107e 2024-05-12T10:38:11.651 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-12T10:38:11.651 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-12T10:38:12.652 DEBUG:teuthology.parallel:result is None 2024-05-12T10:38:12.652 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-12T10:38:12.662 INFO:teuthology.task.internal:Creating test directory... 2024-05-12T10:38:12.662 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-12T10:38:12.666 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-12T10:38:12.672 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-12T10:38:12.679 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-12T10:38:12.685 INFO:teuthology.task.internal:Creating archive directory... 2024-05-12T10:38:12.685 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-12T10:38:12.718 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-12T10:38:12.954 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-12T10:38:12.962 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-12T10:38:12.962 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-12T10:38:12.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:38:12.967 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-12T10:38:12.970 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-12T10:38:13.043 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T10:38:13.056 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T10:38:13.062 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T10:38:13.079 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T10:38:13.082 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-12T10:38:13.089 INFO:teuthology.task.internal:Configuring sudo... 2024-05-12T10:38:13.089 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-12T10:38:13.092 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-12T10:38:13.123 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-12T10:38:13.133 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-12T10:38:13.133 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-12T10:38:13.154 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-12T10:38:13.176 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-12T10:38:13.212 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-12T10:38:13.267 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:38:13.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-12T10:38:13.339 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-12T10:38:13.345 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-12T10:38:13.392 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:38:13.392 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-12T10:38:13.459 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-05-12T10:38:13.463 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-05-12T10:38:13.563 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-12T10:38:13.570 INFO:teuthology.task.internal:Starting timer... 2024-05-12T10:38:13.571 INFO:teuthology.run_tasks:Running task pcp... 2024-05-12T10:38:13.581 INFO:teuthology.run_tasks:Running task selinux... 2024-05-12T10:38:13.590 DEBUG:teuthology.task.selinux:Excluding smithi115: OS 'ubuntu' does not support SELinux 2024-05-12T10:38:13.590 DEBUG:teuthology.task.selinux:Excluding smithi134: OS 'ubuntu' does not support SELinux 2024-05-12T10:38:13.590 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-12T10:38:13.590 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-12T10:38:13.591 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-12T10:38:13.591 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-12T10:38:13.599 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-12T10:38:13.604 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-12T10:38:13.779 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-12T10:38:13.796 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-12T10:38:13.797 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi115.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-12T10:45:43.991 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi115.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-05-12T10:45:43.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-12T10:45:43.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:45:44.079 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-05-12T10:45:44.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-12T10:45:44.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-05-12T10:45:44.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:45:44.282 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-05-12T10:45:44.414 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-05-12T10:45:44.414 INFO:teuthology.run_tasks:Running task clock... 2024-05-12T10:45:44.426 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-12T10:45:44.426 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-12T10:45:44.427 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T10:45:44.430 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-12T10:45:44.430 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T10:45:44.464 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-12T10:45:44.465 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: Command line: ntpd -gq 2024-05-12T10:45:44.465 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: ---------------------------------------------------- 2024-05-12T10:45:44.465 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: ntp-4 is maintained by Network Time Foundation, 2024-05-12T10:45:44.466 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-12T10:45:44.466 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: corporation. Support and training for ntp-4 are 2024-05-12T10:45:44.466 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: available at https://www.nwtime.org/support 2024-05-12T10:45:44.466 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: ---------------------------------------------------- 2024-05-12T10:45:44.466 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: proto: precision = 0.042 usec (-24) 2024-05-12T10:45:44.467 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: basedate set to 2022-02-04 2024-05-12T10:45:44.467 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: gps base set to 2022-02-06 (week 2196) 2024-05-12T10:45:44.467 INFO:teuthology.orchestra.run.smithi115.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-12T10:45:44.467 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-12T10:45:44.467 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: restrict ::: KOD does nothing without LIMITED. 2024-05-12T10:45:44.468 INFO:teuthology.orchestra.run.smithi115.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-12T10:45:44.469 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: Listen and drop on 0 v6wildcard [::]:123 2024-05-12T10:45:44.469 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-12T10:45:44.469 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: Listen normally on 2 lo 127.0.0.1:123 2024-05-12T10:45:44.469 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: Listen normally on 3 enp3s0f1 172.21.15.115:123 2024-05-12T10:45:44.469 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: Listen normally on 4 lo [::1]:123 2024-05-12T10:45:44.469 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce8f%5]:123 2024-05-12T10:45:44.469 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:44 ntpd[17243]: Listening on routing socket on fd #22 for interface updates 2024-05-12T10:45:44.486 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-12T10:45:44.486 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: Command line: ntpd -gq 2024-05-12T10:45:44.486 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: ---------------------------------------------------- 2024-05-12T10:45:44.486 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: ntp-4 is maintained by Network Time Foundation, 2024-05-12T10:45:44.486 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-12T10:45:44.486 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: corporation. Support and training for ntp-4 are 2024-05-12T10:45:44.486 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: available at https://www.nwtime.org/support 2024-05-12T10:45:44.486 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: ---------------------------------------------------- 2024-05-12T10:45:44.487 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: proto: precision = 0.054 usec (-24) 2024-05-12T10:45:44.487 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: basedate set to 2022-02-04 2024-05-12T10:45:44.487 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: gps base set to 2022-02-06 (week 2196) 2024-05-12T10:45:44.487 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-12T10:45:44.488 INFO:teuthology.orchestra.run.smithi134.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-12T10:45:44.488 INFO:teuthology.orchestra.run.smithi134.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-12T10:45:44.489 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: restrict ::: KOD does nothing without LIMITED. 2024-05-12T10:45:44.489 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: Listen and drop on 0 v6wildcard [::]:123 2024-05-12T10:45:44.489 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-12T10:45:44.489 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: Listen normally on 2 lo 127.0.0.1:123 2024-05-12T10:45:44.489 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: Listen normally on 3 enp3s0f1 172.21.15.134:123 2024-05-12T10:45:44.489 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: Listen normally on 4 lo [::1]:123 2024-05-12T10:45:44.489 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de9%5]:123 2024-05-12T10:45:44.489 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:44 ntpd[17699]: Listening on routing socket on fd #22 for interface updates 2024-05-12T10:45:45.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:45.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:45.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:45.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:45.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:45.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:45.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:45.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:45.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:45.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:45.488 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:45.488 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:45.488 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:45.488 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:45 ntpd[17699]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:47.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:47 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:47.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:47 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:47.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:47 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:47.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:47 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:47.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:47 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:47.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:47 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:47.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:47 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:47.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:47 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:47.487 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:47 ntpd[17699]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:48 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:48 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:48 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:48 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:48 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:48 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:49.467 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:49.467 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:49.469 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:49.469 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:49.469 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:49.469 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:49 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:49.490 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:49.490 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:49.490 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:49.490 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:49.490 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:49 ntpd[17699]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:50.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:50 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:50.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:50 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:50.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:50 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:50.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:50 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:50.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:50 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:50.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:50 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:51.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:51.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:51.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:51.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:51.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:51.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:51.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:51.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:51.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:51.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:51.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:51.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:51 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:51.488 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:51.488 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:51.488 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:51.488 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:51.490 INFO:teuthology.orchestra.run.smithi134.stdout:12 May 10:45:51 ntpd[17699]: ntpd: time slew -0.002577 s 2024-05-12T10:45:51.490 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time slew -0.002577s 2024-05-12T10:45:51.490 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-12T10:45:51.490 INFO:teuthology.orchestra.run.smithi134.stderr:12 May 10:45:51 ntpd[17699]: can't open /var/log/ntpstats/loopstats.20240512: Permission denied 2024-05-12T10:45:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-05-12T10:45:51.572 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-05-12T10:45:51.572 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T10:45:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T10:45:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T10:45:51.573 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T10:45:52.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:52 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:52.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:52 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:52.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:52 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:52.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:52 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:52.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:52 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:52.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:52 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:53.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:53 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:53.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:53 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:53.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:53 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:53.465 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:53 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:53.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:53 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T10:45:53.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:53 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T10:45:53.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:53 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T10:45:53.466 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:53 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T10:45:53.466 INFO:teuthology.orchestra.run.smithi115.stdout:12 May 10:45:53 ntpd[17243]: ntpd: time slew -0.000683 s 2024-05-12T10:45:53.466 INFO:teuthology.orchestra.run.smithi115.stdout:ntpd: time slew -0.000683s 2024-05-12T10:45:53.467 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:53 ntpd[17243]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-12T10:45:53.467 INFO:teuthology.orchestra.run.smithi115.stderr:12 May 10:45:53 ntpd[17243]: can't open /var/log/ntpstats/loopstats.20240512: Permission denied 2024-05-12T10:45:53.557 INFO:teuthology.orchestra.run.smithi115.stdout: remote refid st t when poll reach delay offset jitter 2024-05-12T10:45:53.557 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================== 2024-05-12T10:45:53.558 INFO:teuthology.orchestra.run.smithi115.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T10:45:53.558 INFO:teuthology.orchestra.run.smithi115.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T10:45:53.558 INFO:teuthology.orchestra.run.smithi115.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T10:45:53.558 INFO:teuthology.orchestra.run.smithi115.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T10:45:53.559 INFO:teuthology.run_tasks:Running task install... 2024-05-12T10:45:53.567 DEBUG:teuthology.task.install:project ceph 2024-05-12T10:45:53.568 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a'}} 2024-05-12T10:45:53.568 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a'} 2024-05-12T10:45:53.568 INFO:teuthology.task.install:Using flavor: default 2024-05-12T10:45:53.573 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-12T10:45:53.574 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-12T10:45:53.574 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-key list | grep Ceph 2024-05-12T10:45:53.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-key list | grep Ceph 2024-05-12T10:45:53.641 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-12T10:45:53.669 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-12T10:45:53.669 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph.com (release key) 2024-05-12T10:45:53.670 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-12T10:45:53.670 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-12T10:45:53.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:45:53.705 INFO:teuthology.orchestra.run.smithi115.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-12T10:45:53.755 INFO:teuthology.orchestra.run.smithi115.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-12T10:45:53.755 INFO:teuthology.orchestra.run.smithi115.stdout:uid [ unknown] Ceph.com (release key) 2024-05-12T10:45:53.756 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-12T10:45:53.756 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-12T10:45:53.756 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:45:53.898 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default/ 2024-05-12T10:45:53.898 INFO:teuthology.task.install.deb:Package version is 19.0.0-3517-gf1ec8823-1jammy 2024-05-12T10:45:53.967 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default/ 2024-05-12T10:45:53.967 INFO:teuthology.task.install.deb:Package version is 19.0.0-3517-gf1ec8823-1jammy 2024-05-12T10:45:54.017 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:45:54.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-12T10:45:54.032 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-05-12T10:45:54.140 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:45:54.140 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-12T10:45:54.161 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2024-05-12T10:45:54.204 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-12T10:45:54.217 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-12T10:45:54.236 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-12T10:45:54.317 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy InRelease 2024-05-12T10:45:54.321 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-12T10:45:54.347 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-12T10:45:54.353 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-12T10:45:54.357 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-12T10:45:54.378 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-12T10:45:54.390 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-12T10:45:54.391 INFO:teuthology.orchestra.run.smithi115.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy InRelease 2024-05-12T10:45:54.412 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-12T10:45:54.427 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-05-12T10:45:54.435 INFO:teuthology.orchestra.run.smithi115.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-12T10:45:54.456 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-05-12T10:45:54.467 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-12T10:45:54.472 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-12T10:45:54.489 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-12T10:45:54.560 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 29.2 kB in 0s (83.9 kB/s) 2024-05-12T10:45:54.935 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 29.2 kB in 1s (52.6 kB/s) 2024-05-12T10:45:55.564 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-05-12T10:45:55.580 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3517-gf1ec8823-1jammy cephadm=19.0.0-3517-gf1ec8823-1jammy ceph-mds=19.0.0-3517-gf1ec8823-1jammy ceph-mgr=19.0.0-3517-gf1ec8823-1jammy ceph-common=19.0.0-3517-gf1ec8823-1jammy ceph-fuse=19.0.0-3517-gf1ec8823-1jammy ceph-test=19.0.0-3517-gf1ec8823-1jammy ceph-volume=19.0.0-3517-gf1ec8823-1jammy radosgw=19.0.0-3517-gf1ec8823-1jammy python3-rados=19.0.0-3517-gf1ec8823-1jammy python3-rgw=19.0.0-3517-gf1ec8823-1jammy python3-cephfs=19.0.0-3517-gf1ec8823-1jammy python3-rbd=19.0.0-3517-gf1ec8823-1jammy libcephfs2=19.0.0-3517-gf1ec8823-1jammy libcephfs-dev=19.0.0-3517-gf1ec8823-1jammy librados2=19.0.0-3517-gf1ec8823-1jammy librbd1=19.0.0-3517-gf1ec8823-1jammy rbd-fuse=19.0.0-3517-gf1ec8823-1jammy python3-cephfs=19.0.0-3517-gf1ec8823-1jammy cephfs-shell=19.0.0-3517-gf1ec8823-1jammy cephfs-top=19.0.0-3517-gf1ec8823-1jammy cephfs-mirror=19.0.0-3517-gf1ec8823-1jammy 2024-05-12T10:45:55.642 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-05-12T10:45:55.841 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-05-12T10:45:55.841 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-05-12T10:45:55.921 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-12T10:45:55.936 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3517-gf1ec8823-1jammy cephadm=19.0.0-3517-gf1ec8823-1jammy ceph-mds=19.0.0-3517-gf1ec8823-1jammy ceph-mgr=19.0.0-3517-gf1ec8823-1jammy ceph-common=19.0.0-3517-gf1ec8823-1jammy ceph-fuse=19.0.0-3517-gf1ec8823-1jammy ceph-test=19.0.0-3517-gf1ec8823-1jammy ceph-volume=19.0.0-3517-gf1ec8823-1jammy radosgw=19.0.0-3517-gf1ec8823-1jammy python3-rados=19.0.0-3517-gf1ec8823-1jammy python3-rgw=19.0.0-3517-gf1ec8823-1jammy python3-cephfs=19.0.0-3517-gf1ec8823-1jammy python3-rbd=19.0.0-3517-gf1ec8823-1jammy libcephfs2=19.0.0-3517-gf1ec8823-1jammy libcephfs-dev=19.0.0-3517-gf1ec8823-1jammy librados2=19.0.0-3517-gf1ec8823-1jammy librbd1=19.0.0-3517-gf1ec8823-1jammy rbd-fuse=19.0.0-3517-gf1ec8823-1jammy python3-cephfs=19.0.0-3517-gf1ec8823-1jammy cephfs-shell=19.0.0-3517-gf1ec8823-1jammy cephfs-top=19.0.0-3517-gf1ec8823-1jammy cephfs-mirror=19.0.0-3517-gf1ec8823-1jammy 2024-05-12T10:45:56.009 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-12T10:45:56.036 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T10:45:56.036 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T10:45:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T10:45:56.037 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T10:45:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-12T10:45:56.038 INFO:teuthology.orchestra.run.smithi134.stdout: python2.7-minimal 2024-05-12T10:45:56.038 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T10:45:56.041 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-05-12T10:45:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-12T10:45:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-12T10:45:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-12T10:45:56.041 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-12T10:45:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-12T10:45:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-12T10:45:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-12T10:45:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-12T10:45:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-12T10:45:56.042 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-12T10:45:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-12T10:45:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-12T10:45:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-12T10:45:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-12T10:45:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-12T10:45:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-12T10:45:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-12T10:45:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-12T10:45:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-12T10:45:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-12T10:45:56.044 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-12T10:45:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-12T10:45:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-12T10:45:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-12T10:45:56.045 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-05-12T10:45:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-12T10:45:56.045 INFO:teuthology.orchestra.run.smithi134.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-12T10:45:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-12T10:45:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-12T10:45:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-12T10:45:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-12T10:45:56.046 INFO:teuthology.orchestra.run.smithi134.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-12T10:45:56.046 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-05-12T10:45:56.047 INFO:teuthology.orchestra.run.smithi134.stdout: btrfs-tools 2024-05-12T10:45:56.146 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-05-12T10:45:56.147 INFO:teuthology.orchestra.run.smithi134.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-12T10:45:56.147 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-12T10:45:56.147 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-12T10:45:56.147 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-12T10:45:56.147 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-12T10:45:56.147 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-12T10:45:56.147 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-12T10:45:56.147 INFO:teuthology.orchestra.run.smithi134.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-12T10:45:56.148 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-12T10:45:56.148 INFO:teuthology.orchestra.run.smithi134.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-12T10:45:56.148 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-12T10:45:56.148 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-12T10:45:56.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-12T10:45:56.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-12T10:45:56.150 INFO:teuthology.orchestra.run.smithi134.stdout: socat unzip xmlstarlet zip 2024-05-12T10:45:56.183 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2024-05-12T10:45:56.184 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2024-05-12T10:45:56.291 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-12T10:45:56.291 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 182 MB of archives. 2024-05-12T10:45:56.291 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 831 MB of additional disk space will be used. 2024-05-12T10:45:56.291 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3517-gf1ec8823-1jammy [3,555 kB] 2024-05-12T10:45:56.335 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-12T10:45:56.358 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T10:45:56.358 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T10:45:56.358 INFO:teuthology.orchestra.run.smithi115.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T10:45:56.358 INFO:teuthology.orchestra.run.smithi115.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T10:45:56.359 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-12T10:45:56.359 INFO:teuthology.orchestra.run.smithi115.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-12T10:45:56.359 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T10:45:56.359 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2024-05-12T10:45:56.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-12T10:45:56.361 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-12T10:45:56.361 INFO:teuthology.orchestra.run.smithi115.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-12T10:45:56.361 INFO:teuthology.orchestra.run.smithi115.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-12T10:45:56.361 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-12T10:45:56.361 INFO:teuthology.orchestra.run.smithi115.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-12T10:45:56.361 INFO:teuthology.orchestra.run.smithi115.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-12T10:45:56.362 INFO:teuthology.orchestra.run.smithi115.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-12T10:45:56.363 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-12T10:45:56.363 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-12T10:45:56.363 INFO:teuthology.orchestra.run.smithi115.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-12T10:45:56.363 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2024-05-12T10:45:56.363 INFO:teuthology.orchestra.run.smithi115.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-12T10:45:56.363 INFO:teuthology.orchestra.run.smithi115.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-12T10:45:56.363 INFO:teuthology.orchestra.run.smithi115.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-12T10:45:56.363 INFO:teuthology.orchestra.run.smithi115.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-12T10:45:56.363 INFO:teuthology.orchestra.run.smithi115.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-12T10:45:56.363 INFO:teuthology.orchestra.run.smithi115.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-12T10:45:56.364 INFO:teuthology.orchestra.run.smithi115.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-12T10:45:56.364 INFO:teuthology.orchestra.run.smithi115.stdout:Recommended packages: 2024-05-12T10:45:56.364 INFO:teuthology.orchestra.run.smithi115.stdout: btrfs-tools 2024-05-12T10:45:56.417 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-12T10:45:56.463 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-12T10:45:56.511 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2024-05-12T10:45:56.511 INFO:teuthology.orchestra.run.smithi115.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-12T10:45:56.511 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-12T10:45:56.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-12T10:45:56.513 INFO:teuthology.orchestra.run.smithi115.stdout: socat unzip xmlstarlet zip 2024-05-12T10:45:56.517 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3517-gf1ec8823-1jammy [3,223 kB] 2024-05-12T10:45:56.616 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3517-gf1ec8823-1jammy [713 kB] 2024-05-12T10:45:56.638 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3517-gf1ec8823-1jammy [356 kB] 2024-05-12T10:45:56.650 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3517-gf1ec8823-1jammy [32.8 kB] 2024-05-12T10:45:56.651 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3517-gf1ec8823-1jammy [180 kB] 2024-05-12T10:45:56.657 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3517-gf1ec8823-1jammy [67.4 kB] 2024-05-12T10:45:56.658 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3517-gf1ec8823-1jammy [330 kB] 2024-05-12T10:45:56.665 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-12T10:45:56.669 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3517-gf1ec8823-1jammy [6,892 kB] 2024-05-12T10:45:56.715 INFO:teuthology.orchestra.run.smithi115.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-12T10:45:56.715 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 182 MB of archives. 2024-05-12T10:45:56.715 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 831 MB of additional disk space will be used. 2024-05-12T10:45:56.715 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-12T10:45:56.757 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3517-gf1ec8823-1jammy [3,555 kB] 2024-05-12T10:45:56.759 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-12T10:45:56.772 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-12T10:45:56.797 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-12T10:45:56.824 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-12T10:45:56.843 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-12T10:45:56.905 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3517-gf1ec8823-1jammy [112 kB] 2024-05-12T10:45:56.908 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3517-gf1ec8823-1jammy [466 kB] 2024-05-12T10:45:56.922 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3517-gf1ec8823-1jammy [25.8 MB] 2024-05-12T10:45:56.998 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-12T10:45:57.007 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-12T10:45:57.034 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-12T10:45:57.043 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-12T10:45:57.048 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-12T10:45:57.148 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-12T10:45:57.162 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-12T10:45:57.207 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-12T10:45:57.214 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-12T10:45:57.388 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-12T10:45:57.397 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-12T10:45:57.426 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-12T10:45:57.434 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-12T10:45:57.601 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-12T10:45:57.778 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-12T10:45:57.793 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-12T10:45:57.808 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-12T10:45:57.817 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-12T10:45:57.817 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-12T10:45:57.834 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-12T10:45:57.874 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-12T10:45:57.949 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-12T10:45:57.950 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-12T10:45:58.012 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-12T10:45:58.012 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3517-gf1ec8823-1jammy [5,095 kB] 2024-05-12T10:45:58.091 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3517-gf1ec8823-1jammy [244 kB] 2024-05-12T10:45:58.093 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3517-gf1ec8823-1jammy [124 kB] 2024-05-12T10:45:58.095 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3517-gf1ec8823-1jammy [1,544 kB] 2024-05-12T10:45:58.128 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3517-gf1ec8823-1jammy [6,259 kB] 2024-05-12T10:45:58.179 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-12T10:45:58.190 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-12T10:45:58.205 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-12T10:45:58.221 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-12T10:45:58.230 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-12T10:45:58.230 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-12T10:45:58.247 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-12T10:45:58.264 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-12T10:45:58.284 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-12T10:45:58.285 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-12T10:45:58.298 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-12T10:45:58.302 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-12T10:45:58.303 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-12T10:45:58.346 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-12T10:45:58.347 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3517-gf1ec8823-1jammy [22.8 MB] 2024-05-12T10:45:58.380 INFO:teuthology.orchestra.run.smithi134.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-12T10:45:58.401 INFO:teuthology.orchestra.run.smithi134.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-12T10:45:58.426 INFO:teuthology.orchestra.run.smithi134.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-12T10:45:58.472 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-12T10:45:58.555 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-12T10:45:58.569 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-12T10:45:58.610 INFO:teuthology.orchestra.run.smithi134.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-12T10:45:58.626 INFO:teuthology.orchestra.run.smithi134.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-12T10:45:58.633 INFO:teuthology.orchestra.run.smithi134.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-12T10:45:58.636 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-12T10:45:58.638 INFO:teuthology.orchestra.run.smithi134.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-12T10:45:58.665 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-12T10:45:58.682 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-12T10:45:58.718 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-12T10:45:58.823 INFO:teuthology.orchestra.run.smithi134.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-12T10:45:58.890 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-12T10:45:58.905 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-12T10:45:58.906 INFO:teuthology.orchestra.run.smithi134.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-12T10:45:58.911 INFO:teuthology.orchestra.run.smithi115.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-12T10:45:58.916 INFO:teuthology.orchestra.run.smithi115.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-12T10:45:58.922 INFO:teuthology.orchestra.run.smithi134.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-12T10:45:59.030 INFO:teuthology.orchestra.run.smithi115.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3517-gf1ec8823-1jammy [3,223 kB] 2024-05-12T10:45:59.102 INFO:teuthology.orchestra.run.smithi115.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-12T10:45:59.108 INFO:teuthology.orchestra.run.smithi134.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-12T10:45:59.185 INFO:teuthology.orchestra.run.smithi115.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-12T10:45:59.199 INFO:teuthology.orchestra.run.smithi115.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-12T10:45:59.215 INFO:teuthology.orchestra.run.smithi134.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-12T10:45:59.216 INFO:teuthology.orchestra.run.smithi134.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-12T10:45:59.216 INFO:teuthology.orchestra.run.smithi134.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3517-gf1ec8823-1jammy [14.0 kB] 2024-05-12T10:45:59.218 INFO:teuthology.orchestra.run.smithi134.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3517-gf1ec8823-1jammy [870 kB] 2024-05-12T10:45:59.234 INFO:teuthology.orchestra.run.smithi134.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3517-gf1ec8823-1jammy [2,441 kB] 2024-05-12T10:45:59.275 INFO:teuthology.orchestra.run.smithi134.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3517-gf1ec8823-1jammy [792 kB] 2024-05-12T10:45:59.284 INFO:teuthology.orchestra.run.smithi134.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3517-gf1ec8823-1jammy [148 kB] 2024-05-12T10:45:59.288 INFO:teuthology.orchestra.run.smithi134.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3517-gf1ec8823-1jammy [2,279 kB] 2024-05-12T10:45:59.338 INFO:teuthology.orchestra.run.smithi134.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-12T10:45:59.338 INFO:teuthology.orchestra.run.smithi134.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-12T10:45:59.343 INFO:teuthology.orchestra.run.smithi134.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-12T10:45:59.347 INFO:teuthology.orchestra.run.smithi134.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-12T10:45:59.361 INFO:teuthology.orchestra.run.smithi134.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-12T10:45:59.367 INFO:teuthology.orchestra.run.smithi134.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3517-gf1ec8823-1jammy [8,625 kB] 2024-05-12T10:45:59.376 INFO:teuthology.orchestra.run.smithi115.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-12T10:45:59.425 INFO:teuthology.orchestra.run.smithi115.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-12T10:45:59.438 INFO:teuthology.orchestra.run.smithi115.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-12T10:45:59.550 INFO:teuthology.orchestra.run.smithi134.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-12T10:45:59.597 INFO:teuthology.orchestra.run.smithi115.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-12T10:45:59.601 INFO:teuthology.orchestra.run.smithi115.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-12T10:45:59.602 INFO:teuthology.orchestra.run.smithi115.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-12T10:45:59.607 INFO:teuthology.orchestra.run.smithi115.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-12T10:45:59.621 INFO:teuthology.orchestra.run.smithi115.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-12T10:45:59.669 INFO:teuthology.orchestra.run.smithi134.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3517-gf1ec8823-1jammy [14.2 kB] 2024-05-12T10:45:59.670 INFO:teuthology.orchestra.run.smithi134.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3517-gf1ec8823-1jammy [51.7 MB] 2024-05-12T10:45:59.805 INFO:teuthology.orchestra.run.smithi134.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-12T10:45:59.807 INFO:teuthology.orchestra.run.smithi115.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-12T10:45:59.918 INFO:teuthology.orchestra.run.smithi134.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-12T10:45:59.961 INFO:teuthology.orchestra.run.smithi134.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-12T10:46:00.043 INFO:teuthology.orchestra.run.smithi134.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-12T10:46:00.056 INFO:teuthology.orchestra.run.smithi134.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-12T10:46:00.069 INFO:teuthology.orchestra.run.smithi134.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-12T10:46:00.074 INFO:teuthology.orchestra.run.smithi115.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-12T10:46:00.109 INFO:teuthology.orchestra.run.smithi134.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-12T10:46:00.201 INFO:teuthology.orchestra.run.smithi115.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-12T10:46:00.244 INFO:teuthology.orchestra.run.smithi115.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-12T10:46:00.333 INFO:teuthology.orchestra.run.smithi115.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-12T10:46:00.344 INFO:teuthology.orchestra.run.smithi115.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-12T10:46:00.355 INFO:teuthology.orchestra.run.smithi115.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-12T10:46:00.379 INFO:teuthology.orchestra.run.smithi134.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-12T10:46:00.381 INFO:teuthology.orchestra.run.smithi134.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-12T10:46:00.386 INFO:teuthology.orchestra.run.smithi134.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-12T10:46:00.397 INFO:teuthology.orchestra.run.smithi115.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-12T10:46:00.549 INFO:teuthology.orchestra.run.smithi134.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-12T10:46:00.664 INFO:teuthology.orchestra.run.smithi115.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-12T10:46:00.665 INFO:teuthology.orchestra.run.smithi115.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-12T10:46:00.666 INFO:teuthology.orchestra.run.smithi115.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-12T10:46:00.831 INFO:teuthology.orchestra.run.smithi115.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-12T10:46:00.849 INFO:teuthology.orchestra.run.smithi115.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3517-gf1ec8823-1jammy [713 kB] 2024-05-12T10:46:00.874 INFO:teuthology.orchestra.run.smithi134.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-12T10:46:01.180 INFO:teuthology.orchestra.run.smithi115.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-12T10:46:01.284 INFO:teuthology.orchestra.run.smithi134.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-12T10:46:01.287 INFO:teuthology.orchestra.run.smithi115.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3517-gf1ec8823-1jammy [356 kB] 2024-05-12T10:46:01.293 INFO:teuthology.orchestra.run.smithi134.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-12T10:46:01.294 INFO:teuthology.orchestra.run.smithi134.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-12T10:46:01.364 INFO:teuthology.orchestra.run.smithi134.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-12T10:46:01.364 INFO:teuthology.orchestra.run.smithi134.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-12T10:46:01.365 INFO:teuthology.orchestra.run.smithi134.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-12T10:46:01.367 INFO:teuthology.orchestra.run.smithi134.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-12T10:46:01.367 INFO:teuthology.orchestra.run.smithi134.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-12T10:46:01.369 INFO:teuthology.orchestra.run.smithi134.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-12T10:46:01.507 INFO:teuthology.orchestra.run.smithi115.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3517-gf1ec8823-1jammy [32.8 kB] 2024-05-12T10:46:01.530 INFO:teuthology.orchestra.run.smithi115.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3517-gf1ec8823-1jammy [180 kB] 2024-05-12T10:46:01.533 INFO:teuthology.orchestra.run.smithi134.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-12T10:46:01.588 INFO:teuthology.orchestra.run.smithi115.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-12T10:46:01.599 INFO:teuthology.orchestra.run.smithi115.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-12T10:46:01.599 INFO:teuthology.orchestra.run.smithi115.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-12T10:46:01.601 INFO:teuthology.orchestra.run.smithi115.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3517-gf1ec8823-1jammy [67.4 kB] 2024-05-12T10:46:01.614 INFO:teuthology.orchestra.run.smithi115.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3517-gf1ec8823-1jammy [330 kB] 2024-05-12T10:46:01.672 INFO:teuthology.orchestra.run.smithi115.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-12T10:46:01.673 INFO:teuthology.orchestra.run.smithi115.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-12T10:46:01.674 INFO:teuthology.orchestra.run.smithi115.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-12T10:46:01.674 INFO:teuthology.orchestra.run.smithi115.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-12T10:46:01.675 INFO:teuthology.orchestra.run.smithi115.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-12T10:46:01.700 INFO:teuthology.orchestra.run.smithi134.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3517-gf1ec8823-1jammy [124 kB] 2024-05-12T10:46:01.702 INFO:teuthology.orchestra.run.smithi134.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3517-gf1ec8823-1jammy [232 kB] 2024-05-12T10:46:01.708 INFO:teuthology.orchestra.run.smithi134.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3517-gf1ec8823-1jammy [33.9 kB] 2024-05-12T10:46:01.708 INFO:teuthology.orchestra.run.smithi115.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3517-gf1ec8823-1jammy [6,892 kB] 2024-05-12T10:46:01.709 INFO:teuthology.orchestra.run.smithi134.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3517-gf1ec8823-1jammy [23.4 kB] 2024-05-12T10:46:01.709 INFO:teuthology.orchestra.run.smithi134.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3517-gf1ec8823-1jammy [38.9 kB] 2024-05-12T10:46:01.749 INFO:teuthology.orchestra.run.smithi134.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3517-gf1ec8823-1jammy [13.6 MB] 2024-05-12T10:46:01.782 INFO:teuthology.orchestra.run.smithi134.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-12T10:46:01.840 INFO:teuthology.orchestra.run.smithi115.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-12T10:46:01.927 INFO:teuthology.orchestra.run.smithi115.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-12T10:46:02.021 INFO:teuthology.orchestra.run.smithi115.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-12T10:46:02.086 INFO:teuthology.orchestra.run.smithi134.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-12T10:46:02.102 INFO:teuthology.orchestra.run.smithi134.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3517-gf1ec8823-1jammy [91.4 kB] 2024-05-12T10:46:02.172 INFO:teuthology.orchestra.run.smithi134.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-12T10:46:02.175 INFO:teuthology.orchestra.run.smithi134.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-12T10:46:02.177 INFO:teuthology.orchestra.run.smithi134.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-12T10:46:02.212 INFO:teuthology.orchestra.run.smithi134.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-12T10:46:02.237 INFO:teuthology.orchestra.run.smithi134.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-12T10:46:02.238 INFO:teuthology.orchestra.run.smithi134.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-12T10:46:02.245 INFO:teuthology.orchestra.run.smithi134.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-12T10:46:02.248 INFO:teuthology.orchestra.run.smithi134.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-12T10:46:02.275 INFO:teuthology.orchestra.run.smithi115.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-12T10:46:02.341 INFO:teuthology.orchestra.run.smithi115.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-12T10:46:02.364 INFO:teuthology.orchestra.run.smithi115.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-12T10:46:02.372 INFO:teuthology.orchestra.run.smithi115.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-12T10:46:02.420 INFO:teuthology.orchestra.run.smithi115.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-12T10:46:02.447 INFO:teuthology.orchestra.run.smithi134.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-12T10:46:02.450 INFO:teuthology.orchestra.run.smithi115.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-12T10:46:02.452 INFO:teuthology.orchestra.run.smithi115.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-12T10:46:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-12T10:46:02.627 INFO:teuthology.orchestra.run.smithi115.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-12T10:46:02.707 INFO:teuthology.orchestra.run.smithi134.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-12T10:46:02.946 INFO:teuthology.orchestra.run.smithi134.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-12T10:46:02.949 INFO:teuthology.orchestra.run.smithi134.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-12T10:46:02.968 INFO:teuthology.orchestra.run.smithi134.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-12T10:46:02.973 INFO:teuthology.orchestra.run.smithi134.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-12T10:46:03.019 INFO:teuthology.orchestra.run.smithi134.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-12T10:46:03.032 INFO:teuthology.orchestra.run.smithi134.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-12T10:46:03.125 INFO:teuthology.orchestra.run.smithi134.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-12T10:46:03.127 INFO:teuthology.orchestra.run.smithi134.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-12T10:46:03.128 INFO:teuthology.orchestra.run.smithi134.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-12T10:46:03.178 INFO:teuthology.orchestra.run.smithi115.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-12T10:46:03.184 INFO:teuthology.orchestra.run.smithi115.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-12T10:46:03.223 INFO:teuthology.orchestra.run.smithi115.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-12T10:46:03.224 INFO:teuthology.orchestra.run.smithi115.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-12T10:46:03.230 INFO:teuthology.orchestra.run.smithi115.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-12T10:46:03.232 INFO:teuthology.orchestra.run.smithi115.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-12T10:46:03.273 INFO:teuthology.orchestra.run.smithi115.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-12T10:46:03.282 INFO:teuthology.orchestra.run.smithi115.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-12T10:46:03.310 INFO:teuthology.orchestra.run.smithi134.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-12T10:46:03.357 INFO:teuthology.orchestra.run.smithi115.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-12T10:46:03.357 INFO:teuthology.orchestra.run.smithi115.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-12T10:46:03.510 INFO:teuthology.orchestra.run.smithi115.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3517-gf1ec8823-1jammy [112 kB] 2024-05-12T10:46:03.522 INFO:teuthology.orchestra.run.smithi115.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-12T10:46:03.541 INFO:teuthology.orchestra.run.smithi115.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3517-gf1ec8823-1jammy [466 kB] 2024-05-12T10:46:03.575 INFO:teuthology.orchestra.run.smithi134.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-12T10:46:03.648 INFO:teuthology.orchestra.run.smithi115.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3517-gf1ec8823-1jammy [25.8 MB] 2024-05-12T10:46:03.974 INFO:teuthology.orchestra.run.smithi115.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-12T10:46:03.989 INFO:teuthology.orchestra.run.smithi115.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-12T10:46:04.626 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 182 MB in 8s (23.1 MB/s) 2024-05-12T10:46:04.777 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-12T10:46:04.862 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-05-12T10:46:04.866 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-12T10:46:04.926 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-12T10:46:05.211 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-12T10:46:05.232 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-12T10:46:05.261 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-12T10:46:05.530 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cmd2. 2024-05-12T10:46:05.542 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-12T10:46:05.580 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-12T10:46:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-12T10:46:05.937 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-12T10:46:06.017 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-12T10:46:06.479 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-12T10:46:06.499 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-12T10:46:06.537 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-12T10:46:06.848 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-12T10:46:06.868 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-12T10:46:06.906 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-12T10:46:07.293 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-12T10:46:07.314 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T10:46:07.360 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:46:07.771 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-12T10:46:07.792 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T10:46:07.829 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:46:07.980 INFO:teuthology.orchestra.run.smithi115.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3517-gf1ec8823-1jammy [5,095 kB] 2024-05-12T10:46:08.182 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-12T10:46:08.203 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T10:46:08.241 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:46:08.619 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-12T10:46:08.639 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-12T10:46:08.662 INFO:teuthology.orchestra.run.smithi115.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3517-gf1ec8823-1jammy [244 kB] 2024-05-12T10:46:08.668 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-12T10:46:08.699 INFO:teuthology.orchestra.run.smithi115.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3517-gf1ec8823-1jammy [124 kB] 2024-05-12T10:46:08.699 INFO:teuthology.orchestra.run.smithi115.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3517-gf1ec8823-1jammy [1,544 kB] 2024-05-12T10:46:08.897 INFO:teuthology.orchestra.run.smithi115.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3517-gf1ec8823-1jammy [6,259 kB] 2024-05-12T10:46:08.980 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librados2. 2024-05-12T10:46:09.000 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../010-librados2_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:09.038 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librados2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:09.499 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librbd1. 2024-05-12T10:46:09.519 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../011-librbd1_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:09.566 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librbd1 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:09.587 INFO:teuthology.orchestra.run.smithi115.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3517-gf1ec8823-1jammy [22.8 MB] 2024-05-12T10:46:10.027 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs2. 2024-05-12T10:46:10.047 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:10.085 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:10.354 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rados. 2024-05-12T10:46:10.366 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:10.395 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rados (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:10.706 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-12T10:46:10.727 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:10.764 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-argparse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:11.025 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cephfs. 2024-05-12T10:46:11.037 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:11.101 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cephfs (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:11.390 INFO:teuthology.orchestra.run.smithi115.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3517-gf1ec8823-1jammy [14.0 kB] 2024-05-12T10:46:11.390 INFO:teuthology.orchestra.run.smithi115.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3517-gf1ec8823-1jammy [870 kB] 2024-05-12T10:46:11.420 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-12T10:46:11.440 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:11.443 INFO:teuthology.orchestra.run.smithi115.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3517-gf1ec8823-1jammy [2,441 kB] 2024-05-12T10:46:11.478 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-common (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:11.587 INFO:teuthology.orchestra.run.smithi115.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3517-gf1ec8823-1jammy [792 kB] 2024-05-12T10:46:11.645 INFO:teuthology.orchestra.run.smithi115.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3517-gf1ec8823-1jammy [148 kB] 2024-05-12T10:46:11.649 INFO:teuthology.orchestra.run.smithi115.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3517-gf1ec8823-1jammy [2,279 kB] 2024-05-12T10:46:11.787 INFO:teuthology.orchestra.run.smithi115.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3517-gf1ec8823-1jammy [8,625 kB] 2024-05-12T10:46:11.789 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-prettytable. 2024-05-12T10:46:11.801 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-12T10:46:11.839 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-12T10:46:12.125 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rbd. 2024-05-12T10:46:12.146 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:12.184 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rbd (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:12.286 INFO:teuthology.orchestra.run.smithi115.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3517-gf1ec8823-1jammy [14.2 kB] 2024-05-12T10:46:12.286 INFO:teuthology.orchestra.run.smithi115.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3517-gf1ec8823-1jammy [51.7 MB] 2024-05-12T10:46:12.536 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-12T10:46:12.557 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-12T10:46:12.594 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-12T10:46:12.872 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-12T10:46:12.884 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-12T10:46:12.922 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-12T10:46:13.250 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-12T10:46:13.262 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-12T10:46:13.300 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-12T10:46:13.620 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua5.1. 2024-05-12T10:46:13.640 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-12T10:46:13.678 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-12T10:46:13.997 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-any. 2024-05-12T10:46:14.009 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-12T10:46:14.047 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-12T10:46:14.291 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package zip. 2024-05-12T10:46:14.303 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-12T10:46:14.342 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking zip (3.0-12build2) ... 2024-05-12T10:46:14.353 INFO:teuthology.orchestra.run.smithi115.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3517-gf1ec8823-1jammy [124 kB] 2024-05-12T10:46:14.354 INFO:teuthology.orchestra.run.smithi115.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3517-gf1ec8823-1jammy [232 kB] 2024-05-12T10:46:14.357 INFO:teuthology.orchestra.run.smithi115.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3517-gf1ec8823-1jammy [33.9 kB] 2024-05-12T10:46:14.357 INFO:teuthology.orchestra.run.smithi115.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3517-gf1ec8823-1jammy [23.4 kB] 2024-05-12T10:46:14.357 INFO:teuthology.orchestra.run.smithi115.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3517-gf1ec8823-1jammy [38.9 kB] 2024-05-12T10:46:14.358 INFO:teuthology.orchestra.run.smithi115.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3517-gf1ec8823-1jammy [13.6 MB] 2024-05-12T10:46:14.628 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package unzip. 2024-05-12T10:46:14.640 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-12T10:46:14.669 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-12T10:46:14.810 INFO:teuthology.orchestra.run.smithi115.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3517-gf1ec8823-1jammy [91.4 kB] 2024-05-12T10:46:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package luarocks. 2024-05-12T10:46:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-12T10:46:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-12T10:46:15.409 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librgw2. 2024-05-12T10:46:15.430 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../027-librgw2_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:15.441 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 182 MB in 18s (9,931 kB/s) 2024-05-12T10:46:15.472 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librgw2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:15.584 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-12T10:46:15.651 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-05-12T10:46:15.654 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-12T10:46:15.708 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-12T10:46:16.010 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-12T10:46:16.024 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-12T10:46:16.032 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rgw. 2024-05-12T10:46:16.045 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:16.069 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-12T10:46:16.083 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rgw (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:16.346 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cmd2. 2024-05-12T10:46:16.362 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-12T10:46:16.377 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-12T10:46:16.398 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-12T10:46:16.405 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-12T10:46:16.427 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-12T10:46:16.680 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libradosstriper1. 2024-05-12T10:46:16.701 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:16.716 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-12T10:46:16.730 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-12T10:46:16.738 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libradosstriper1 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:16.816 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-12T10:46:17.170 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-12T10:46:17.175 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-common. 2024-05-12T10:46:17.186 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-12T10:46:17.195 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:17.228 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-12T10:46:17.241 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-common (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:17.548 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-12T10:46:17.562 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-12T10:46:17.623 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-12T10:46:18.026 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-12T10:46:18.041 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T10:46:18.092 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:46:18.496 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-12T10:46:18.510 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T10:46:18.554 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:46:18.696 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-base. 2024-05-12T10:46:18.717 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:18.764 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-base (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:18.907 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-12T10:46:18.922 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T10:46:18.966 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:46:19.277 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-12T10:46:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-12T10:46:19.335 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-12T10:46:19.351 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-12T10:46:19.372 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-12T10:46:19.401 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-12T10:46:19.680 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librados2. 2024-05-12T10:46:19.687 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cheroot. 2024-05-12T10:46:19.695 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../010-librados2_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:19.707 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-12T10:46:19.738 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librados2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:19.745 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-12T10:46:20.064 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-12T10:46:20.085 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-12T10:46:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-12T10:46:20.115 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librbd1. 2024-05-12T10:46:20.129 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../011-librbd1_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:20.174 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librbd1 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:20.384 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-12T10:46:20.405 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-12T10:46:20.442 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-12T10:46:20.602 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libcephfs2. 2024-05-12T10:46:20.615 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:20.660 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libcephfs2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:20.728 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-12T10:46:20.749 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-12T10:46:20.786 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-12T10:46:20.937 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rados. 2024-05-12T10:46:20.951 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:20.996 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rados (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:21.097 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempora. 2024-05-12T10:46:21.118 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-12T10:46:21.156 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-12T10:46:21.298 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-12T10:46:21.312 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:21.357 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-ceph-argparse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:21.601 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cephfs. 2024-05-12T10:46:21.614 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:21.659 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cephfs (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:21.800 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-portend. 2024-05-12T10:46:21.821 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-12T10:46:21.858 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-12T10:46:21.962 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-12T10:46:21.976 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:22.020 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-ceph-common (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:22.111 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-12T10:46:22.132 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-12T10:46:22.169 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-12T10:46:22.357 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-prettytable. 2024-05-12T10:46:22.371 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-12T10:46:22.415 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-12T10:46:22.472 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-12T10:46:22.493 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-12T10:46:22.530 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-12T10:46:22.701 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rbd. 2024-05-12T10:46:22.716 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:22.751 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rbd (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:22.909 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-natsort. 2024-05-12T10:46:22.930 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-12T10:46:22.959 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-12T10:46:23.029 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-12T10:46:23.043 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-12T10:46:23.087 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-12T10:46:23.245 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-logutils. 2024-05-12T10:46:23.266 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-12T10:46:23.304 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-12T10:46:23.340 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-12T10:46:23.355 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-12T10:46:23.398 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-12T10:46:23.606 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-12T10:46:23.627 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-12T10:46:23.664 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-12T10:46:23.701 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-12T10:46:23.716 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-12T10:46:23.751 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-12T10:46:23.967 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-mako. 2024-05-12T10:46:23.989 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-12T10:46:24.026 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-12T10:46:24.062 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua5.1. 2024-05-12T10:46:24.077 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-12T10:46:24.121 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-12T10:46:24.345 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-12T10:46:24.367 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-12T10:46:24.404 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-12T10:46:24.457 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua-any. 2024-05-12T10:46:24.472 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-12T10:46:24.515 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-12T10:46:24.665 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-12T10:46:24.686 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-12T10:46:24.723 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-12T10:46:24.726 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package zip. 2024-05-12T10:46:24.741 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-12T10:46:24.776 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking zip (3.0-12build2) ... 2024-05-12T10:46:25.026 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webob. 2024-05-12T10:46:25.046 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-12T10:46:25.084 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-12T10:46:25.113 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package unzip. 2024-05-12T10:46:25.128 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-12T10:46:25.179 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-12T10:46:25.445 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-waitress. 2024-05-12T10:46:25.466 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-12T10:46:25.515 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-12T10:46:25.567 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package luarocks. 2024-05-12T10:46:25.582 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-12T10:46:25.642 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-12T10:46:25.840 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempita. 2024-05-12T10:46:25.860 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-12T10:46:25.898 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-12T10:46:26.066 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librgw2. 2024-05-12T10:46:26.080 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../027-librgw2_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:26.124 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librgw2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:26.210 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-paste. 2024-05-12T10:46:26.230 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-12T10:46:26.259 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-12T10:46:26.595 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-12T10:46:26.602 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rgw. 2024-05-12T10:46:26.608 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-12T10:46:26.616 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:26.645 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-12T10:46:26.685 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rgw (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:26.923 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-12T10:46:26.944 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-12T10:46:26.972 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-12T10:46:26.981 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-12T10:46:26.986 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-12T10:46:27.021 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-12T10:46:27.268 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webtest. 2024-05-12T10:46:27.289 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-12T10:46:27.324 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libradosstriper1. 2024-05-12T10:46:27.326 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-12T10:46:27.339 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:27.383 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libradosstriper1 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:27.836 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-common. 2024-05-12T10:46:27.851 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:27.894 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-common (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:28.497 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pecan. 2024-05-12T10:46:28.518 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-12T10:46:28.554 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-12T10:46:28.916 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-base. 2024-05-12T10:46:28.918 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-certifi. 2024-05-12T10:46:28.931 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:28.939 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-12T10:46:28.975 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-base (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:28.976 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-12T10:46:29.320 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-idna. 2024-05-12T10:46:29.342 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-12T10:46:29.378 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-12T10:46:29.682 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-urllib3. 2024-05-12T10:46:29.703 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-12T10:46:29.740 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-12T10:46:30.101 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests. 2024-05-12T10:46:30.123 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-12T10:46:30.168 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-12T10:46:30.187 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-12T10:46:30.202 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-12T10:46:30.245 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-12T10:46:30.479 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-12T10:46:30.500 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-12T10:46:30.532 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cheroot. 2024-05-12T10:46:30.537 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-12T10:46:30.547 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-12T10:46:30.582 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-12T10:46:30.832 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-12T10:46:30.844 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:30.881 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:30.902 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-12T10:46:30.916 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-12T10:46:30.976 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-12T10:46:31.237 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-12T10:46:31.254 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-12T10:46:31.257 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:31.268 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-12T10:46:31.286 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:31.312 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-12T10:46:31.598 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-12T10:46:31.609 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-12T10:46:31.619 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-12T10:46:31.622 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-12T10:46:31.655 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-12T10:46:31.667 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-12T10:46:31.942 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-openssl. 2024-05-12T10:46:31.963 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-12T10:46:31.995 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-tempora. 2024-05-12T10:46:32.008 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-12T10:46:32.009 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-12T10:46:32.053 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-12T10:46:32.314 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-portend. 2024-05-12T10:46:32.329 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-12T10:46:32.353 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr. 2024-05-12T10:46:32.364 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-12T10:46:32.374 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:32.411 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:32.684 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-12T10:46:32.698 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-12T10:46:32.742 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-12T10:46:32.773 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mon. 2024-05-12T10:46:32.794 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:32.822 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mon (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:33.303 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-12T10:46:33.318 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-12T10:46:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-12T10:46:33.510 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-osd. 2024-05-12T10:46:33.531 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:33.609 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-osd (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:33.664 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-natsort. 2024-05-12T10:46:33.679 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-12T10:46:33.714 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-12T10:46:34.042 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-logutils. 2024-05-12T10:46:34.056 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-12T10:46:34.101 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-12T10:46:34.428 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-12T10:46:34.443 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-12T10:46:34.487 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-12T10:46:34.679 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph. 2024-05-12T10:46:34.700 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../068-ceph_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:34.737 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:34.789 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-mako. 2024-05-12T10:46:34.806 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-12T10:46:34.847 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-12T10:46:35.031 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-fuse. 2024-05-12T10:46:35.052 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:35.089 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-fuse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:35.209 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-12T10:46:35.224 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-12T10:46:35.259 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-12T10:46:35.451 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mds. 2024-05-12T10:46:35.472 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:35.509 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mds (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:35.511 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-12T10:46:35.525 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-12T10:46:35.561 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-12T10:46:35.872 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webob. 2024-05-12T10:46:35.886 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-12T10:46:35.922 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-12T10:46:35.946 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephadm. 2024-05-12T10:46:35.966 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../071-cephadm_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:36.004 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephadm (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:36.234 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-waitress. 2024-05-12T10:46:36.248 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-12T10:46:36.286 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-12T10:46:36.323 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-12T10:46:36.344 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-12T10:46:36.381 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-12T10:46:36.561 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-tempita. 2024-05-12T10:46:36.575 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-12T10:46:36.619 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-12T10:46:36.718 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-12T10:46:36.739 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-12T10:46:36.784 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-12T10:46:36.922 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-paste. 2024-05-12T10:46:36.936 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-12T10:46:36.980 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-12T10:46:37.283 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-12T10:46:37.297 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-12T10:46:37.367 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-12T10:46:37.636 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-12T10:46:37.650 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-12T10:46:37.686 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-12T10:46:37.822 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-babel. 2024-05-12T10:46:37.844 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-12T10:46:37.882 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-12T10:46:37.922 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webtest. 2024-05-12T10:46:37.936 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-12T10:46:37.980 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-12T10:46:38.175 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jinja2. 2024-05-12T10:46:38.187 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-12T10:46:38.216 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-12T10:46:38.325 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pecan. 2024-05-12T10:46:38.339 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-12T10:46:38.383 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-12T10:46:38.578 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-12T10:46:38.599 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:38.636 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:38.746 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-certifi. 2024-05-12T10:46:38.760 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-12T10:46:38.804 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-12T10:46:38.939 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-12T10:46:38.952 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-12T10:46:38.989 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-12T10:46:39.174 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-idna. 2024-05-12T10:46:39.187 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-12T10:46:39.232 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-12T10:46:39.292 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-routes. 2024-05-12T10:46:39.313 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-12T10:46:39.358 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-12T10:46:39.502 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-urllib3. 2024-05-12T10:46:39.516 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-12T10:46:39.551 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-12T10:46:39.696 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-12T10:46:39.717 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:39.762 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:39.899 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-requests. 2024-05-12T10:46:39.902 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-12T10:46:39.939 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-12T10:46:40.249 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-12T10:46:40.263 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-12T10:46:40.308 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-12T10:46:40.602 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-12T10:46:40.616 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:40.660 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:41.024 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-12T10:46:41.038 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:41.067 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-12T10:46:41.079 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-12T10:46:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:41.116 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-12T10:46:41.325 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-12T10:46:41.339 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-12T10:46:41.375 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-12T10:46:41.595 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-joblib. 2024-05-12T10:46:41.617 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-12T10:46:41.662 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-12T10:46:41.703 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-openssl. 2024-05-12T10:46:41.717 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-12T10:46:41.761 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-12T10:46:42.015 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-12T10:46:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-12T10:46:42.097 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr. 2024-05-12T10:46:42.112 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:42.155 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:42.175 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-12T10:46:42.488 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn. 2024-05-12T10:46:42.509 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-12T10:46:42.546 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-12T10:46:42.550 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mon. 2024-05-12T10:46:42.565 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:42.600 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mon (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:43.120 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-osd. 2024-05-12T10:46:43.134 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:43.178 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-osd (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:43.222 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-12T10:46:43.244 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:43.289 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:44.056 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph. 2024-05-12T10:46:44.070 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../068-ceph_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:44.114 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:44.184 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cachetools. 2024-05-12T10:46:44.205 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-12T10:46:44.242 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-12T10:46:44.433 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-fuse. 2024-05-12T10:46:44.447 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:44.492 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-fuse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:44.578 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-12T10:46:44.599 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-12T10:46:44.645 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-12T10:46:44.861 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mds. 2024-05-12T10:46:44.876 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:44.919 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mds (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-12T10:46:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-12T10:46:45.065 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-12T10:46:45.305 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephadm. 2024-05-12T10:46:45.321 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../071-cephadm_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:45.364 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephadm (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:45.410 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rsa. 2024-05-12T10:46:45.431 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-12T10:46:45.484 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-12T10:46:45.683 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-12T10:46:45.698 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-12T10:46:45.733 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-12T10:46:45.855 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-google-auth. 2024-05-12T10:46:45.877 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-12T10:46:45.930 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-12T10:46:46.044 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-12T10:46:46.058 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-12T10:46:46.093 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-12T10:46:46.558 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-12T10:46:46.580 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-12T10:46:46.624 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-12T10:46:46.936 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-websocket. 2024-05-12T10:46:46.958 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-12T10:46:47.003 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-12T10:46:47.140 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-babel. 2024-05-12T10:46:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-12T10:46:47.206 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-12T10:46:47.323 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-12T10:46:47.345 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-12T10:46:47.389 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-12T10:46:47.518 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jinja2. 2024-05-12T10:46:47.531 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-12T10:46:47.576 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-12T10:46:47.920 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-12T10:46:47.934 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:47.978 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:48.061 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-12T10:46:48.074 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:48.111 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:48.298 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-12T10:46:48.312 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-12T10:46:48.357 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-12T10:46:48.414 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-12T10:46:48.436 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-12T10:46:48.481 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-12T10:46:48.801 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-routes. 2024-05-12T10:46:48.811 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-12T10:46:48.851 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-12T10:46:49.018 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-12T10:46:49.040 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-12T10:46:49.084 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-12T10:46:49.179 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-12T10:46:49.193 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:49.237 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:49.337 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package jq. 2024-05-12T10:46:49.358 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-12T10:46:49.403 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-12T10:46:49.656 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package socat. 2024-05-12T10:46:49.678 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-12T10:46:49.722 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-12T10:46:50.017 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package xmlstarlet. 2024-05-12T10:46:50.030 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-12T10:46:50.067 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-12T10:46:50.397 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-test. 2024-05-12T10:46:50.409 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-12T10:46:50.409 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:50.420 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-12T10:46:50.446 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-test (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:50.458 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-12T10:46:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-joblib. 2024-05-12T10:46:50.923 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-12T10:46:50.953 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-12T10:46:51.323 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-12T10:46:51.334 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-12T10:46:51.458 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-12T10:46:51.728 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-sklearn. 2024-05-12T10:46:51.742 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-12T10:46:51.777 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-12T10:46:52.453 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-12T10:46:52.468 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:52.511 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:52.759 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-volume. 2024-05-12T10:46:52.781 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:52.825 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-volume (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:53.197 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-12T10:46:53.218 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:53.263 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-mirror (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:53.472 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cachetools. 2024-05-12T10:46:53.490 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-12T10:46:53.530 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-12T10:46:53.558 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-colorama. 2024-05-12T10:46:53.580 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-12T10:46:53.624 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-12T10:46:53.825 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-12T10:46:53.841 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-12T10:46:53.875 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-12T10:46:53.885 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-shell. 2024-05-12T10:46:53.898 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:53.935 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-shell (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:54.145 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-12T10:46:54.160 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-12T10:46:54.195 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-12T10:46:54.204 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-top. 2024-05-12T10:46:54.226 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:54.271 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-top (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:54.481 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rsa. 2024-05-12T10:46:54.496 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-12T10:46:54.524 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-12T10:46:54.530 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-12T10:46:54.541 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:54.582 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs-dev (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:54.860 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-12T10:46:54.867 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-google-auth. 2024-05-12T10:46:54.882 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-12T10:46:54.883 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-12T10:46:54.926 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-12T10:46:54.926 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-12T10:46:55.245 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-12T10:46:55.261 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-12T10:46:55.295 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-12T10:46:55.315 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-12T10:46:55.327 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-12T10:46:55.364 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-12T10:46:55.565 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-websocket. 2024-05-12T10:46:55.580 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-12T10:46:55.614 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-12T10:46:55.744 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package nvme-cli. 2024-05-12T10:46:55.765 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-12T10:46:55.810 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-12T10:46:55.960 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-12T10:46:55.975 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-12T10:46:56.017 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-12T10:46:56.241 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package pkg-config. 2024-05-12T10:46:56.263 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-12T10:46:56.299 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-12T10:46:56.535 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-12T10:46:56.547 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-12T10:46:56.585 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-12T10:46:56.681 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-12T10:46:56.695 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:46:56.739 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:57.075 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-12T10:46:57.089 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-12T10:46:57.134 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-12T10:46:57.255 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-12T10:46:57.277 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-12T10:46:57.321 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-12T10:46:57.503 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-12T10:46:57.517 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-12T10:46:57.561 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-12T10:46:57.582 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastescript. 2024-05-12T10:46:57.595 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-12T10:46:57.624 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-12T10:46:57.805 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package jq. 2024-05-12T10:46:57.819 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-12T10:46:57.863 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-12T10:46:57.885 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pluggy. 2024-05-12T10:46:57.907 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-12T10:46:57.952 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-12T10:46:58.166 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package socat. 2024-05-12T10:46:58.180 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-12T10:46:58.249 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-12T10:46:58.255 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-psutil. 2024-05-12T10:46:58.268 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-12T10:46:58.305 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-12T10:46:58.511 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package xmlstarlet. 2024-05-12T10:46:58.525 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-12T10:46:58.561 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-12T10:46:58.700 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-py. 2024-05-12T10:46:58.721 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-12T10:46:58.758 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-12T10:46:58.898 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-test. 2024-05-12T10:46:58.910 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:46:58.947 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-test (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:46:59.020 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pygments. 2024-05-12T10:46:59.042 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-12T10:46:59.095 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-12T10:46:59.566 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-12T10:46:59.587 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-12T10:46:59.632 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-12T10:46:59.951 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-toml. 2024-05-12T10:46:59.973 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-12T10:47:00.018 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-12T10:47:00.288 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pytest. 2024-05-12T10:47:00.300 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-12T10:47:00.329 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-12T10:47:00.641 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplejson. 2024-05-12T10:47:00.663 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-12T10:47:00.708 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-12T10:47:00.845 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-volume. 2024-05-12T10:47:00.859 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:47:00.893 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-volume (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:00.985 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-12T10:47:00.998 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-12T10:47:01.035 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-12T10:47:01.239 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-12T10:47:01.252 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:47:01.297 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephfs-mirror (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:01.617 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-colorama. 2024-05-12T10:47:01.631 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-12T10:47:01.675 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-12T10:47:01.756 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package radosgw. 2024-05-12T10:47:01.779 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../122-radosgw_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:47:01.822 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking radosgw (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:01.902 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephfs-shell. 2024-05-12T10:47:01.918 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:47:01.960 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephfs-shell (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:02.213 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephfs-top. 2024-05-12T10:47:02.227 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3517-gf1ec8823-1jammy_all.deb ... 2024-05-12T10:47:02.296 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephfs-top (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:02.549 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-12T10:47:02.563 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:47:02.607 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libcephfs-dev (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:02.651 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package rbd-fuse. 2024-05-12T10:47:02.663 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:47:02.700 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking rbd-fuse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:02.901 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-12T10:47:02.916 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-12T10:47:02.951 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-12T10:47:03.020 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-12T10:47:03.272 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-12T10:47:03.272 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-12T10:47:03.286 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-12T10:47:03.321 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-12T10:47:03.399 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-12T10:47:03.658 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-12T10:47:03.709 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package nvme-cli. 2024-05-12T10:47:03.724 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-12T10:47:03.758 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-12T10:47:04.006 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-12T10:47:04.413 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package pkg-config. 2024-05-12T10:47:04.428 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-12T10:47:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-12T10:47:04.471 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-12T10:47:04.567 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephadm (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:04.741 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-12T10:47:04.756 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-12T10:47:04.791 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-12T10:47:05.117 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user cephadm....done 2024-05-12T10:47:05.210 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-12T10:47:05.224 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-12T10:47:05.269 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-12T10:47:05.273 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-12T10:47:05.549 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-12T10:47:05.571 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pastescript. 2024-05-12T10:47:05.585 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-12T10:47:05.629 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-12T10:47:05.801 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-12T10:47:05.935 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-12T10:47:05.949 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pluggy. 2024-05-12T10:47:05.963 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-12T10:47:06.007 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-12T10:47:06.170 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-12T10:47:06.344 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-psutil. 2024-05-12T10:47:06.357 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-12T10:47:06.402 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-12T10:47:06.421 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-12T10:47:06.547 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-12T10:47:06.729 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-py. 2024-05-12T10:47:06.743 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-12T10:47:06.788 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-12T10:47:06.849 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-12T10:47:07.158 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pygments. 2024-05-12T10:47:07.171 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-12T10:47:07.184 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-12T10:47:07.216 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-12T10:47:07.435 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-12T10:47:07.670 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-12T10:47:07.683 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-12T10:47:07.686 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-12T10:47:07.728 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-12T10:47:07.979 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-12T10:47:08.039 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-toml. 2024-05-12T10:47:08.052 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-12T10:47:08.097 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-12T10:47:08.239 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-12T10:47:08.393 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pytest. 2024-05-12T10:47:08.407 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-12T10:47:08.451 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-12T10:47:08.491 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-12T10:47:08.741 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-12T10:47:08.788 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-simplejson. 2024-05-12T10:47:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-12T10:47:08.838 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-12T10:47:09.034 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-argparse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:09.082 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-12T10:47:09.095 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-12T10:47:09.132 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-12T10:47:09.277 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-12T10:47:09.394 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-12T10:47:09.529 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-12T10:47:09.780 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-12T10:47:09.836 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package radosgw. 2024-05-12T10:47:09.849 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../122-radosgw_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:47:09.894 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking radosgw (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:09.906 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-12T10:47:10.174 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-12T10:47:10.531 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package rbd-fuse. 2024-05-12T10:47:10.544 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3517-gf1ec8823-1jammy_amd64.deb ... 2024-05-12T10:47:10.566 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-12T10:47:10.589 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking rbd-fuse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:10.596 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-12T10:47:10.669 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-12T10:47:10.795 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-12T10:47:10.874 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-12T10:47:11.128 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-12T10:47:11.147 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-12T10:47:11.253 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-12T10:47:11.273 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-12T10:47:11.508 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-12T10:47:11.540 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-12T10:47:11.799 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-12T10:47:11.919 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-12T10:47:12.384 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up zip (3.0-12build2) ... 2024-05-12T10:47:12.510 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-12T10:47:12.556 INFO:teuthology.orchestra.run.smithi115.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-12T10:47:12.605 INFO:teuthology.orchestra.run.smithi115.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-05-12T10:47:12.647 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephadm (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:13.196 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-12T10:47:13.447 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-12T10:47:13.573 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-12T10:47:13.592 INFO:teuthology.orchestra.run.smithi115.stdout:Adding system user cephadm....done 2024-05-12T10:47:13.682 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-12T10:47:13.729 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-12T10:47:13.958 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-12T10:47:14.005 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-12T10:47:14.343 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-12T10:47:14.531 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-12T10:47:14.594 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-12T10:47:14.657 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-12T10:47:14.916 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-12T10:47:14.971 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-12T10:47:15.186 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-12T10:47:15.280 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-12T10:47:15.318 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-12T10:47:15.598 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-12T10:47:15.612 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-12T10:47:15.941 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-12T10:47:16.021 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-12T10:47:16.184 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-12T10:47:16.289 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-12T10:47:16.310 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-common (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:16.637 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-idna (3.3-1) ... 2024-05-12T10:47:16.690 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-12T10:47:16.937 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-12T10:47:17.000 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-12T10:47:17.226 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-12T10:47:17.486 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-12T10:47:17.754 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-12T10:47:18.013 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-ceph-argparse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:18.110 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-12T10:47:18.281 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-12T10:47:18.353 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:47:18.431 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-12T10:47:18.471 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-12T10:47:18.558 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-12T10:47:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-12T10:47:18.825 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-12T10:47:18.873 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-12T10:47:18.951 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-12T10:47:18.974 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-12T10:47:19.228 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-12T10:47:19.250 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-12T10:47:19.502 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-12T10:47:19.595 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-12T10:47:19.624 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-12T10:47:19.689 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-12T10:47:19.744 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:47:19.815 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-12T10:47:19.854 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-12T10:47:20.155 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-12T10:47:20.191 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-12T10:47:20.317 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-12T10:47:20.431 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-12T10:47:20.585 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-12T10:47:20.699 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-12T10:47:20.844 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-12T10:47:20.942 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-12T10:47:21.155 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up zip (3.0-12build2) ... 2024-05-12T10:47:21.185 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-12T10:47:21.313 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-12T10:47:21.444 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-12T10:47:21.562 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-12T10:47:21.830 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-12T10:47:21.956 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-12T10:47:21.999 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-12T10:47:22.265 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-12T10:47:22.267 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-12T10:47:22.387 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-12T10:47:22.510 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-12T10:47:22.650 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-12T10:47:22.811 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-12T10:47:22.893 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-12T10:47:23.018 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-12T10:47:23.145 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-12T10:47:23.217 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-12T10:47:23.221 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-12T10:47:23.455 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-12T10:47:23.480 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-12T10:47:23.581 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-12T10:47:23.873 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-12T10:47:23.966 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-12T10:47:24.166 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-12T10:47:24.233 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-12T10:47:24.359 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-12T10:47:24.484 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-12T10:47:24.627 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:47:24.745 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-12T10:47:24.835 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-12T10:47:25.037 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-12T10:47:25.087 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-12T10:47:25.212 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-ceph-common (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:25.322 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-12T10:47:25.514 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-idna (3.3-1) ... 2024-05-12T10:47:25.624 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-12T10:47:25.843 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-12T10:47:25.890 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-12T10:47:26.111 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-12T10:47:26.404 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-12T10:47:26.655 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-12T10:47:27.092 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-12T10:47:27.112 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-12T10:47:27.389 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:47:27.400 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-12T10:47:27.532 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-12T10:47:27.761 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-12T10:47:27.800 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-12T10:47:27.887 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librados2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:27.909 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-12T10:47:28.013 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:28.068 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-12T10:47:28.139 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-12T10:47:28.369 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-12T10:47:28.476 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:28.585 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libradosstriper1 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:28.645 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-12T10:47:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-12T10:47:28.905 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:47:28.990 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librbd1 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:29.031 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-12T10:47:29.116 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-modules-core (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:29.266 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-fuse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:29.333 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-12T10:47:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-12T10:47:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-12T10:47:29.633 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-12T10:47:29.901 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-12T10:47:30.093 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs-dev (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:30.160 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-12T10:47:30.219 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rados (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:30.362 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librgw2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:30.462 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-12T10:47:30.496 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-top (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:30.639 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-12T10:47:30.738 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-12T10:47:30.863 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-12T10:47:31.156 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-12T10:47:31.299 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-12T10:47:31.592 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-12T10:47:31.814 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rbd (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:31.902 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-12T10:47:31.928 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up rbd-fuse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:32.054 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rgw (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:32.163 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-12T10:47:32.179 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cephfs (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:32.286 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-12T10:47:32.305 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-shell (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:32.412 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-12T10:47:32.431 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-common (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:32.501 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-12T10:47:32.739 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-12T10:47:32.882 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-12T10:47:32.957 INFO:teuthology.orchestra.run.smithi134.stdout:Adding group ceph....done 2024-05-12T10:47:33.276 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-12T10:47:33.342 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user ceph....done 2024-05-12T10:47:33.543 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-12T10:47:33.561 INFO:teuthology.orchestra.run.smithi134.stdout:Setting system user ceph properties....done 2024-05-12T10:47:33.578 INFO:teuthology.orchestra.run.smithi134.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-12T10:47:33.702 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-12T10:47:33.719 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-12T10:47:33.970 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T10:47:34.049 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-12T10:47:34.096 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-12T10:47:34.447 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-12T10:47:34.616 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-mirror (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:34.773 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-12T10:47:34.823 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-12T10:47:34.823 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-12T10:47:35.050 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-12T10:47:35.277 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-12T10:47:35.395 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-test (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:35.553 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-12T10:47:35.623 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up radosgw (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:35.830 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-12T10:47:36.089 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-12T10:47:36.277 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-12T10:47:36.277 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-12T10:47:36.458 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-12T10:47:36.751 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-12T10:47:36.788 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-base (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:37.128 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-12T10:47:37.136 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-12T10:47:37.254 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librados2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:37.380 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:37.490 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-12T10:47:37.648 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mds (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:37.818 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libcephfs2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:37.881 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-12T10:47:37.881 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-12T10:47:37.943 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libradosstriper1 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:38.069 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-12T10:47:38.371 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librbd1 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:38.401 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:38.522 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-modules-core (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:38.631 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-fuse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:38.633 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-12T10:47:38.633 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-12T10:47:38.822 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-12T10:47:38.822 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-12T10:47:39.152 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-osd (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:39.474 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libcephfs-dev (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:39.481 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-12T10:47:39.481 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-12T10:47:39.575 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rados (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:39.693 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librgw2 (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:39.819 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephfs-top (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:39.945 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-12T10:47:40.087 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:40.213 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:40.381 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mon (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:40.617 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-12T10:47:40.617 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-12T10:47:41.115 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-cephadm (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:41.249 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rbd (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:41.266 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:41.358 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up rbd-fuse (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:41.392 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-dashboard (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:41.484 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rgw (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:41.518 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-volume (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:41.706 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cephfs (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:41.836 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephfs-shell (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:41.896 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-12T10:47:41.962 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-common (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:42.005 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-12T10:47:42.166 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-12T10:47:42.490 INFO:teuthology.orchestra.run.smithi115.stdout:Adding group ceph....done 2024-05-12T10:47:42.866 INFO:teuthology.orchestra.run.smithi115.stdout:Adding system user ceph....done 2024-05-12T10:47:43.041 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-12T10:47:43.043 INFO:teuthology.orchestra.run.smithi115.stdout:Setting system user ceph properties....done 2024-05-12T10:47:43.060 INFO:teuthology.orchestra.run.smithi115.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-12T10:47:43.203 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-12T10:47:43.602 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-12T10:47:43.741 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-12T10:47:43.745 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-12T10:47:43.804 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-05-12T10:47:44.006 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-05-12T10:47:44.006 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-05-12T10:47:44.189 INFO:teuthology.orchestra.run.smithi134.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-12T10:47:44.189 INFO:teuthology.orchestra.run.smithi134.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-12T10:47:44.189 INFO:teuthology.orchestra.run.smithi134.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-12T10:47:44.189 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T10:47:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T10:47:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T10:47:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T10:47:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-12T10:47:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: python2.7-minimal 2024-05-12T10:47:44.191 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T10:47:44.191 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-05-12T10:47:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-12T10:47:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-12T10:47:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-12T10:47:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-12T10:47:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-12T10:47:44.192 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-05-12T10:47:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-12T10:47:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-12T10:47:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-12T10:47:44.234 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-05-12T10:47:44.234 INFO:teuthology.orchestra.run.smithi134.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-12T10:47:44.234 INFO:teuthology.orchestra.run.smithi134.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-12T10:47:44.234 INFO:teuthology.orchestra.run.smithi134.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-12T10:47:44.234 INFO:teuthology.orchestra.run.smithi134.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-12T10:47:44.234 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-12T10:47:44.235 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-12T10:47:44.235 INFO:teuthology.orchestra.run.smithi134.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-12T10:47:44.235 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-05-12T10:47:44.236 INFO:teuthology.orchestra.run.smithi134.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-12T10:47:44.271 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephfs-mirror (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-12T10:47:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 55.7 MB of archives. 2024-05-12T10:47:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-12T10:47:44.295 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-12T10:47:44.456 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-12T10:47:44.463 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-12T10:47:44.481 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-12T10:47:44.481 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-12T10:47:44.503 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-12T10:47:44.503 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-12T10:47:44.504 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-12T10:47:44.515 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-12T10:47:44.516 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-12T10:47:44.518 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-12T10:47:44.520 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-12T10:47:44.520 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-12T10:47:44.522 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-12T10:47:44.525 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-12T10:47:44.544 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-12T10:47:44.544 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-12T10:47:44.545 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-12T10:47:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-12T10:47:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-12T10:47:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-12T10:47:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-12T10:47:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-12T10:47:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-12T10:47:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-12T10:47:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-12T10:47:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-12T10:47:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-12T10:47:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-12T10:47:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-12T10:47:45.063 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-12T10:47:45.066 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-12T10:47:45.066 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-12T10:47:45.067 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-12T10:47:45.067 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-12T10:47:45.080 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-12T10:47:45.082 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-12T10:47:45.290 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-test (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:45.314 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-12T10:47:45.314 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-12T10:47:45.314 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-12T10:47:45.314 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-12T10:47:45.314 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-12T10:47:45.314 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-12T10:47:45.326 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-12T10:47:45.326 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-12T10:47:45.407 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up radosgw (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:45.729 INFO:teuthology.orchestra.run.smithi134.stdout:Preconfiguring packages ... 2024-05-12T10:47:45.895 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 55.7 MB in 1s (51.4 MB/s) 2024-05-12T10:47:45.920 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-12T10:47:45.920 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-12T10:47:46.204 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-05-12T10:47:46.209 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T10:47:46.347 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T10:47:46.576 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-base (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:46.937 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-12T10:47:46.957 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-12T10:47:47.752 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mds (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:47.896 INFO:teuthology.orchestra.run.smithi134.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-12T10:47:47.991 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-12T10:47:47.992 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-12T10:47:48.362 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package flex. 2024-05-12T10:47:48.452 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-05-12T10:47:48.457 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-12T10:47:48.510 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-12T10:47:48.637 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:48.850 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-12T10:47:48.851 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-12T10:47:49.161 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-12T10:47:49.365 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-12T10:47:49.488 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-osd (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:49.823 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T10:47:49.824 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-12T10:47:49.824 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-12T10:47:50.366 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-05-12T10:47:50.370 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T10:47:50.465 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:50.506 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T10:47:50.591 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:50.734 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mon (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:50.916 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T10:47:50.943 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-12T10:47:50.944 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-12T10:47:51.029 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T10:47:51.369 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-12T10:47:51.593 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-cephadm (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:51.736 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:51.746 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package bison. 2024-05-12T10:47:51.835 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-05-12T10:47:51.839 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-12T10:47:51.845 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-dashboard (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:51.880 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-12T10:47:51.980 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-volume (19.0.0-3517-gf1ec8823-1jammy) ... 2024-05-12T10:47:52.307 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-12T10:47:52.329 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-12T10:47:52.373 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-12T10:47:52.382 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-12T10:47:52.491 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-12T10:47:52.627 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-12T10:47:52.811 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package dump. 2024-05-12T10:47:52.833 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-12T10:47:52.884 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking dump (0.4b47-3) ... 2024-05-12T10:47:53.188 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package indent. 2024-05-12T10:47:53.201 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:47:53.238 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-12T10:47:53.566 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-12T10:47:53.588 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-12T10:47:53.727 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-12T10:47:53.865 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-12T10:47:54.401 INFO:teuthology.orchestra.run.smithi115.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-12T10:47:54.405 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-12T10:47:54.453 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-12T10:47:54.475 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-12T10:47:54.479 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-12T10:47:54.520 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-12T10:47:54.653 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2024-05-12T10:47:54.654 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2024-05-12T10:47:54.789 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-12T10:47:54.802 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-12T10:47:54.825 INFO:teuthology.orchestra.run.smithi115.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-12T10:47:54.825 INFO:teuthology.orchestra.run.smithi115.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-12T10:47:54.826 INFO:teuthology.orchestra.run.smithi115.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-12T10:47:54.826 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T10:47:54.826 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T10:47:54.826 INFO:teuthology.orchestra.run.smithi115.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T10:47:54.826 INFO:teuthology.orchestra.run.smithi115.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T10:47:54.826 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-12T10:47:54.826 INFO:teuthology.orchestra.run.smithi115.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-12T10:47:54.826 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T10:47:54.826 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2024-05-12T10:47:54.826 INFO:teuthology.orchestra.run.smithi115.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-12T10:47:54.826 INFO:teuthology.orchestra.run.smithi115.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-12T10:47:54.827 INFO:teuthology.orchestra.run.smithi115.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-12T10:47:54.827 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-12T10:47:54.827 INFO:teuthology.orchestra.run.smithi115.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-12T10:47:54.827 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2024-05-12T10:47:54.827 INFO:teuthology.orchestra.run.smithi115.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-12T10:47:54.828 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-12T10:47:54.828 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-12T10:47:54.839 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-12T10:47:54.881 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2024-05-12T10:47:54.882 INFO:teuthology.orchestra.run.smithi115.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-12T10:47:54.882 INFO:teuthology.orchestra.run.smithi115.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-12T10:47:54.883 INFO:teuthology.orchestra.run.smithi115.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-12T10:47:54.883 INFO:teuthology.orchestra.run.smithi115.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-12T10:47:54.883 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-12T10:47:54.883 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-12T10:47:54.883 INFO:teuthology.orchestra.run.smithi115.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-12T10:47:54.884 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages will be upgraded: 2024-05-12T10:47:54.885 INFO:teuthology.orchestra.run.smithi115.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-12T10:47:55.073 INFO:teuthology.orchestra.run.smithi115.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-12T10:47:55.073 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 55.7 MB of archives. 2024-05-12T10:47:55.073 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-12T10:47:55.073 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-12T10:47:55.168 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-12T10:47:55.190 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-12T10:47:55.234 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-12T10:47:55.503 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-12T10:47:55.525 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-12T10:47:55.570 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-12T10:47:55.754 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-12T10:47:55.790 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-12T10:47:55.798 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjson-perl. 2024-05-12T10:47:55.811 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-12T10:47:55.848 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-12T10:47:55.916 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-12T10:47:55.918 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-12T10:47:55.918 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-12T10:47:55.954 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-12T10:47:55.954 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-12T10:47:55.960 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-12T10:47:55.965 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-12T10:47:55.965 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-12T10:47:56.139 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-12T10:47:56.192 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-12T10:47:56.214 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-12T10:47:56.259 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-12T10:47:56.444 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-12T10:47:56.454 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-12T10:47:56.459 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-12T10:47:56.548 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-12T10:47:57.759 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-12T10:47:57.774 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-12T10:47:57.775 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-12T10:47:57.777 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-12T10:47:57.778 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-12T10:47:57.782 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-12T10:47:57.948 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-12T10:47:57.995 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-12T10:47:58.017 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-12T10:47:58.070 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T10:47:58.364 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-12T10:47:58.386 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-12T10:47:58.431 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T10:47:58.556 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-12T10:47:58.557 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-12T10:47:58.736 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-12T10:47:58.737 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-12T10:47:58.775 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-12T10:47:58.792 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-12T10:47:58.813 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-12T10:47:58.837 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-12T10:47:58.843 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-12T10:47:58.843 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-12T10:47:58.844 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-12T10:47:58.845 INFO:teuthology.orchestra.run.smithi115.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-12T10:47:58.975 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T10:47:59.052 INFO:teuthology.orchestra.run.smithi115.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-12T10:47:59.329 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-12T10:47:59.351 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-12T10:47:59.395 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-12T10:47:59.478 INFO:teuthology.orchestra.run.smithi115.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-12T10:47:59.732 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-12T10:47:59.754 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-12T10:47:59.790 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-12T10:48:00.185 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-12T10:48:00.197 INFO:teuthology.orchestra.run.smithi115.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-12T10:48:00.197 INFO:teuthology.orchestra.run.smithi115.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-12T10:48:00.197 INFO:teuthology.orchestra.run.smithi115.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-12T10:48:00.197 INFO:teuthology.orchestra.run.smithi115.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-12T10:48:00.198 INFO:teuthology.orchestra.run.smithi115.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-12T10:48:00.198 INFO:teuthology.orchestra.run.smithi115.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-12T10:48:00.206 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:48:00.235 INFO:teuthology.orchestra.run.smithi115.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-12T10:48:00.235 INFO:teuthology.orchestra.run.smithi115.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-12T10:48:00.259 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:00.610 INFO:teuthology.orchestra.run.smithi115.stdout:Preconfiguring packages ... 2024-05-12T10:48:00.621 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-12T10:48:00.643 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:48:00.696 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T10:48:00.753 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 55.7 MB in 5s (10.4 MB/s) 2024-05-12T10:48:01.048 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-12T10:48:01.070 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:48:01.074 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-05-12T10:48:01.077 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T10:48:01.123 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T10:48:01.219 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T10:48:01.401 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-12T10:48:01.422 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-12T10:48:01.475 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T10:48:01.879 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-12T10:48:02.046 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-12T10:48:02.068 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-12T10:48:02.121 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-12T10:48:02.540 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package modemmanager. 2024-05-12T10:48:02.562 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-12T10:48:02.615 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T10:48:03.038 INFO:teuthology.orchestra.run.smithi115.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-12T10:48:03.325 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package flex. 2024-05-12T10:48:03.380 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package network-manager. 2024-05-12T10:48:03.400 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-05-12T10:48:03.402 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-12T10:48:03.403 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-12T10:48:03.441 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-12T10:48:03.463 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-12T10:48:04.179 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-12T10:48:04.355 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ppp. 2024-05-12T10:48:04.377 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-12T10:48:04.434 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-12T10:48:04.676 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-12T10:48:04.993 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package pptp-linux. 2024-05-12T10:48:05.006 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-12T10:48:05.043 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-12T10:48:05.060 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T10:48:05.270 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-12T10:48:05.283 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-12T10:48:05.320 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-12T10:48:05.640 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-12T10:48:05.662 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-12T10:48:05.706 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client-common (238) ... 2024-05-12T10:48:05.748 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-05-12T10:48:05.752 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T10:48:05.882 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T10:48:05.994 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-12T10:48:06.016 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:48:06.060 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:06.227 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T10:48:06.389 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T10:48:06.657 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-common. 2024-05-12T10:48:06.679 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-12T10:48:06.737 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-12T10:48:06.742 INFO:teuthology.orchestra.run.smithi134.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-12T10:48:06.791 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-common (238) ... 2024-05-12T10:48:07.097 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package bison. 2024-05-12T10:48:07.170 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-05-12T10:48:07.174 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-12T10:48:07.250 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-12T10:48:07.255 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-14. 2024-05-12T10:48:07.277 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:48:07.325 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:07.642 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-12T10:48:07.658 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-12T10:48:07.701 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-12T10:48:08.129 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package dump. 2024-05-12T10:48:08.145 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-12T10:48:08.195 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking dump (0.4b47-3) ... 2024-05-12T10:48:08.475 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package indent. 2024-05-12T10:48:08.490 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:48:08.524 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-12T10:48:08.666 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql. 2024-05-12T10:48:08.689 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-12T10:48:08.732 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql (14+238) ... 2024-05-12T10:48:08.760 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-12T10:48:08.776 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-12T10:48:08.818 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-12T10:48:08.976 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client. 2024-05-12T10:48:08.998 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-12T10:48:09.043 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client (14+238) ... 2024-05-12T10:48:09.172 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-12T10:48:09.188 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-12T10:48:09.231 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-12T10:48:09.261 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-12T10:48:09.274 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-12T10:48:09.311 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-12T10:48:09.491 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-12T10:48:09.507 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-12T10:48:09.567 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-12T10:48:09.647 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package tcl8.6. 2024-05-12T10:48:09.669 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-12T10:48:09.714 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-12T10:48:09.903 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-12T10:48:09.922 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-12T10:48:09.961 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-12T10:48:09.991 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package tcl. 2024-05-12T10:48:10.011 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-12T10:48:10.054 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-12T10:48:10.206 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-12T10:48:10.221 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-12T10:48:10.264 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-12T10:48:10.377 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package wpasupplicant. 2024-05-12T10:48:10.399 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-12T10:48:10.435 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-12T10:48:10.542 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjson-perl. 2024-05-12T10:48:10.558 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-12T10:48:10.668 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-12T10:48:10.806 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-12T10:48:10.828 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-12T10:48:10.874 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-12T10:48:11.021 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-12T10:48:11.037 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-12T10:48:11.087 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-12T10:48:11.244 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-12T10:48:11.266 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-12T10:48:11.327 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-12T10:48:11.596 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client-common (238) ... 2024-05-12T10:48:11.816 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-12T10:48:11.943 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-12T10:48:12.068 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:12.186 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-12T10:48:12.296 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-12T10:48:12.422 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:12.541 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-12T10:48:12.556 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-12T10:48:12.599 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T10:48:12.860 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-12T10:48:12.875 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-12T10:48:12.918 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T10:48:12.948 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-12T10:48:13.035 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-12T10:48:13.254 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-12T10:48:13.270 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-12T10:48:13.304 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T10:48:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-12T10:48:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-12T10:48:13.649 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-12T10:48:13.664 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-12T10:48:13.707 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-12T10:48:13.980 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-12T10:48:14.060 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-12T10:48:14.076 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-12T10:48:14.105 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-12T10:48:14.118 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-12T10:48:14.231 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T10:48:14.357 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-12T10:48:14.454 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-12T10:48:14.470 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:48:14.504 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:14.800 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-12T10:48:14.832 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-12T10:48:14.848 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:48:14.890 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T10:48:15.143 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-12T10:48:15.185 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-12T10:48:15.201 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:48:15.243 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T10:48:15.269 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-12T10:48:15.395 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-12T10:48:15.554 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-12T10:48:15.570 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-12T10:48:15.612 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T10:48:16.100 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-12T10:48:16.227 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up dump (0.4b47-3) ... 2024-05-12T10:48:16.320 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-12T10:48:16.386 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T10:48:16.476 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-12T10:48:16.491 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-12T10:48:16.513 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-12T10:48:16.526 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-12T10:48:16.630 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-12T10:48:16.731 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-12T10:48:16.832 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-12T10:48:16.882 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package modemmanager. 2024-05-12T10:48:16.894 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-12T10:48:16.905 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-12T10:48:16.937 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T10:48:16.975 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-12T10:48:17.101 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-12T10:48:17.277 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-12T10:48:17.403 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T10:48:17.543 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package network-manager. 2024-05-12T10:48:17.554 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-12T10:48:17.560 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-12T10:48:17.610 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-12T10:48:17.698 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client (14+238) ... 2024-05-12T10:48:17.798 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-12T10:48:18.234 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ppp. 2024-05-12T10:48:18.250 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-12T10:48:18.268 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:18.268 INFO:teuthology.orchestra.run.smithi134.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-12T10:48:18.268 INFO:teuthology.orchestra.run.smithi134.stdout:which means they are currently configured by ifupdown: 2024-05-12T10:48:18.268 INFO:teuthology.orchestra.run.smithi134.stdout:- enp3s0f1 2024-05-12T10:48:18.268 INFO:teuthology.orchestra.run.smithi134.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-12T10:48:18.268 INFO:teuthology.orchestra.run.smithi134.stdout:remove their configuration from /etc/network/interfaces. 2024-05-12T10:48:18.269 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:18.387 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-12T10:48:18.699 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-12T10:48:18.705 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-12T10:48:18.989 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package pptp-linux. 2024-05-12T10:48:19.003 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-12T10:48:19.042 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-12T10:48:19.047 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-12T10:48:19.283 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-12T10:48:19.297 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-12T10:48:19.342 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-12T10:48:19.576 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T10:48:19.661 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-12T10:48:19.675 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-12T10:48:19.711 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-12T10:48:19.719 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-client-common (238) ... 2024-05-12T10:48:19.837 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-12T10:48:19.963 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-common (238) ... 2024-05-12T10:48:19.990 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-12T10:48:20.004 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:48:20.040 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:20.628 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-common. 2024-05-12T10:48:20.642 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-12T10:48:20.703 INFO:teuthology.orchestra.run.smithi115.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-12T10:48:20.734 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-common (238) ... 2024-05-12T10:48:20.887 INFO:teuthology.orchestra.run.smithi134.stdout:Adding user postgres to group ssl-cert 2024-05-12T10:48:21.070 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:21.070 INFO:teuthology.orchestra.run.smithi134.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-12T10:48:21.168 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-14. 2024-05-12T10:48:21.182 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T10:48:21.221 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:21.254 INFO:teuthology.orchestra.run.smithi134.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-12T10:48:21.254 INFO:teuthology.orchestra.run.smithi134.stdout:Removing obsolete dictionary files: 2024-05-12T10:48:21.831 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-12T10:48:22.255 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:22.279 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql. 2024-05-12T10:48:22.294 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-12T10:48:22.338 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql (14+238) ... 2024-05-12T10:48:22.581 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-client. 2024-05-12T10:48:22.582 INFO:teuthology.orchestra.run.smithi134.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-12T10:48:22.596 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-12T10:48:22.601 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-12T10:48:22.640 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-client (14+238) ... 2024-05-12T10:48:22.640 INFO:teuthology.orchestra.run.smithi134.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-12T10:48:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:This user must also own the server process. 2024-05-12T10:48:22.641 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:The database cluster will be initialized with locale "en_US". 2024-05-12T10:48:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-12T10:48:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:The default text search configuration will be set to "english". 2024-05-12T10:48:22.641 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:Data page checksums are disabled. 2024-05-12T10:48:22.641 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-12T10:48:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:creating subdirectories ... ok 2024-05-12T10:48:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:selecting dynamic shared memory implementation ... posix 2024-05-12T10:48:22.656 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default max_connections ... 100 2024-05-12T10:48:22.676 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default shared_buffers ... 128MB 2024-05-12T10:48:22.684 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default time zone ... Etc/UTC 2024-05-12T10:48:22.684 INFO:teuthology.orchestra.run.smithi134.stdout:creating configuration files ... ok 2024-05-12T10:48:22.797 INFO:teuthology.orchestra.run.smithi134.stdout:running bootstrap script ... ok 2024-05-12T10:48:22.858 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-12T10:48:22.873 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-12T10:48:22.908 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-12T10:48:23.228 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package tcl8.6. 2024-05-12T10:48:23.280 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-12T10:48:23.285 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-12T10:48:23.516 INFO:teuthology.orchestra.run.smithi134.stdout:performing post-bootstrap initialization ... ok 2024-05-12T10:48:23.572 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package tcl. 2024-05-12T10:48:23.587 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-12T10:48:23.635 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-12T10:48:23.949 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package wpasupplicant. 2024-05-12T10:48:23.965 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-12T10:48:23.999 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-12T10:48:24.267 INFO:teuthology.orchestra.run.smithi134.stdout:syncing data to disk ... ok 2024-05-12T10:48:24.395 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-12T10:48:24.411 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-12T10:48:24.453 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-12T10:48:24.684 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-12T10:48:24.823 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-12T10:48:24.839 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-12T10:48:24.890 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-12T10:48:25.208 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-client-common (238) ... 2024-05-12T10:48:25.412 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-12T10:48:25.521 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-12T10:48:25.652 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:25.774 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-12T10:48:25.966 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-12T10:48:26.117 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:27.410 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-12T10:48:27.506 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-12T10:48:27.936 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T10:48:27.960 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-12T10:48:27.960 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-12T10:48:28.054 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-12T10:48:28.155 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql (14+238) ... 2024-05-12T10:48:28.256 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T10:48:28.390 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T10:48:28.650 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-12T10:48:28.650 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-12T10:48:28.676 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-12T10:48:28.827 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-12T10:48:28.978 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T10:48:29.112 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-12T10:48:29.260 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-12T10:48:29.288 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-12T10:48:29.354 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-12T10:48:29.414 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-12T10:48:29.540 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-12T10:48:29.691 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-12T10:48:29.696 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-12T10:48:29.840 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-12T10:48:30.497 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-12T10:48:30.623 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up dump (0.4b47-3) ... 2024-05-12T10:48:30.718 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-12T10:48:30.816 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T10:48:30.942 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-12T10:48:31.068 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-12T10:48:31.194 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-12T10:48:31.337 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-12T10:48:31.409 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-12T10:48:31.410 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-12T10:48:31.497 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-12T10:48:31.517 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-12T10:48:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-12T10:48:31.832 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-12T10:48:31.958 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T10:48:31.984 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-12T10:48:31.991 DEBUG:teuthology.parallel:result is None 2024-05-12T10:48:32.084 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-12T10:48:32.252 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-client (14+238) ... 2024-05-12T10:48:32.394 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-12T10:48:32.932 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:32.933 INFO:teuthology.orchestra.run.smithi115.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-12T10:48:32.933 INFO:teuthology.orchestra.run.smithi115.stdout:which means they are currently configured by ifupdown: 2024-05-12T10:48:32.933 INFO:teuthology.orchestra.run.smithi115.stdout:- enp3s0f1 2024-05-12T10:48:32.933 INFO:teuthology.orchestra.run.smithi115.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-12T10:48:32.933 INFO:teuthology.orchestra.run.smithi115.stdout:remove their configuration from /etc/network/interfaces. 2024-05-12T10:48:32.933 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:33.066 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-12T10:48:33.453 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-12T10:48:33.897 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-12T10:48:34.647 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T10:48:34.815 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-12T10:48:34.941 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-12T10:48:35.067 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-common (238) ... 2024-05-12T10:48:36.027 INFO:teuthology.orchestra.run.smithi115.stdout:Adding user postgres to group ssl-cert 2024-05-12T10:48:36.285 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:36.285 INFO:teuthology.orchestra.run.smithi115.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-12T10:48:36.541 INFO:teuthology.orchestra.run.smithi115.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-12T10:48:36.541 INFO:teuthology.orchestra.run.smithi115.stdout:Removing obsolete dictionary files: 2024-05-12T10:48:37.220 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-12T10:48:37.693 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T10:48:38.055 INFO:teuthology.orchestra.run.smithi115.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-12T10:48:38.076 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-12T10:48:38.143 INFO:teuthology.orchestra.run.smithi115.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-12T10:48:38.145 INFO:teuthology.orchestra.run.smithi115.stdout:This user must also own the server process. 2024-05-12T10:48:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:38.145 INFO:teuthology.orchestra.run.smithi115.stdout:The database cluster will be initialized with locale "en_US". 2024-05-12T10:48:38.145 INFO:teuthology.orchestra.run.smithi115.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-12T10:48:38.145 INFO:teuthology.orchestra.run.smithi115.stdout:The default text search configuration will be set to "english". 2024-05-12T10:48:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:38.145 INFO:teuthology.orchestra.run.smithi115.stdout:Data page checksums are disabled. 2024-05-12T10:48:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:38.145 INFO:teuthology.orchestra.run.smithi115.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-12T10:48:38.146 INFO:teuthology.orchestra.run.smithi115.stdout:creating subdirectories ... ok 2024-05-12T10:48:38.146 INFO:teuthology.orchestra.run.smithi115.stdout:selecting dynamic shared memory implementation ... posix 2024-05-12T10:48:38.168 INFO:teuthology.orchestra.run.smithi115.stdout:selecting default max_connections ... 100 2024-05-12T10:48:38.201 INFO:teuthology.orchestra.run.smithi115.stdout:selecting default shared_buffers ... 128MB 2024-05-12T10:48:38.215 INFO:teuthology.orchestra.run.smithi115.stdout:selecting default time zone ... Etc/UTC 2024-05-12T10:48:38.216 INFO:teuthology.orchestra.run.smithi115.stdout:creating configuration files ... ok 2024-05-12T10:48:38.380 INFO:teuthology.orchestra.run.smithi115.stdout:running bootstrap script ... ok 2024-05-12T10:48:38.990 INFO:teuthology.orchestra.run.smithi115.stdout:performing post-bootstrap initialization ... ok 2024-05-12T10:48:39.502 INFO:teuthology.orchestra.run.smithi115.stdout:syncing data to disk ... ok 2024-05-12T10:48:39.999 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-12T10:48:42.975 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T10:48:43.126 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-12T10:48:43.277 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql (14+238) ... 2024-05-12T10:48:43.428 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T10:48:43.579 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T10:48:43.857 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-12T10:48:43.857 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-12T10:48:44.615 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-12T10:48:44.708 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-12T10:48:45.051 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-12T10:48:45.236 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-12T10:48:46.605 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-12T10:48:46.706 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-12T10:48:47.246 INFO:teuthology.orchestra.run.smithi115.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-12T10:48:47.252 DEBUG:teuthology.parallel:result is None 2024-05-12T10:48:47.253 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:48:47.479 DEBUG:teuthology.orchestra.run.smithi115:> dpkg-query -W -f '${Version}' ceph 2024-05-12T10:48:47.500 INFO:teuthology.orchestra.run.smithi115.stdout:19.0.0-3517-gf1ec8823-1jammy 2024-05-12T10:48:47.501 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3517-gf1ec8823-1jammy 2024-05-12T10:48:47.501 INFO:teuthology.task.install:The correct ceph version 19.0.0-3517-gf1ec8823-1jammy is installed. 2024-05-12T10:48:47.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:48:47.735 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-query -W -f '${Version}' ceph 2024-05-12T10:48:47.755 INFO:teuthology.orchestra.run.smithi134.stdout:19.0.0-3517-gf1ec8823-1jammy 2024-05-12T10:48:47.755 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3517-gf1ec8823-1jammy 2024-05-12T10:48:47.756 INFO:teuthology.task.install:The correct ceph version 19.0.0-3517-gf1ec8823-1jammy is installed. 2024-05-12T10:48:47.757 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-12T10:48:47.758 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:48:47.758 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-12T10:48:47.778 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:48:47.778 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-12T10:48:47.810 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-12T10:48:47.810 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:48:47.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-05-12T10:48:47.844 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-12T10:48:47.907 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:48:47.908 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-05-12T10:48:47.921 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-12T10:48:47.976 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-12T10:48:47.976 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:48:47.976 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-12T10:48:47.995 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-12T10:48:48.059 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:48:48.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-12T10:48:48.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-12T10:48:48.125 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-12T10:48:48.126 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:48:48.126 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-05-12T10:48:48.145 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-12T10:48:48.203 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:48:48.203 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-05-12T10:48:48.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-12T10:48:48.273 INFO:teuthology.run_tasks:Running task ceph... 2024-05-12T10:48:48.357 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-12T10:48:48.357 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2024-05-12T10:48:48.360 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-05-12T10:48:48.376 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-12T10:48:48.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-12T10:48:48.420 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-12T10:48:48.435 INFO:tasks.ceph:Creating extra log directories... 2024-05-12T10:48:48.435 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-12T10:48:48.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-12T10:48:48.507 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-12T10:48:48.507 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-12T10:48:48.507 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-12T10:48:48.507 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:48:48.508 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-12T10:48:48.553 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-12T10:48:48.637 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:48:48.637 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-12T10:48:48.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-12T10:48:48.722 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-12T10:48:48.722 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-12T10:48:48.722 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265', 'branch': 'wip-lusov-quiesce-lock-auth', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}}', 'email': None, 'first_in_suite': False, 'job_id': '7703265', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiesce-lock-auth'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiesce-lock-auth', 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 7749, 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiesce-lock-auth', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_f1ec882358465db8f363a3865fa83f099183688a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'f1ec882358465db8f363a3865fa83f099183688a', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi115.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAAhLey9zL+rUEFGqEJN9UUvpB74fVIlQTJfICdHw2JmRxlVgEfzm7Vlau2fhNBm5mE2LEqCyYcMPWwPtnEyz5k=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJIWz+Ox8RR+0LrFeazc09VwoQJqY2FtkklVyDVmvp99VsPeY6GqMyqANcGMN0WZHHLFJjfleWSc30AHq2By7HM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-12_10:14:03', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-12T10:48:48.723 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-12T10:48:48.727 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-12T10:48:48.762 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2024-05-12T10:48:48.776 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-05-12T10:48:48.822 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:48:48.822 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-05-12T10:48:48.845 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-12T10:48:48.845 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-05-12T10:48:48.897 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-12T10:48:48.897 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:48:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 887 Links: 1 2024-05-12T10:48:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:48:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-12 10:42:19.525544263 +0000 2024-05-12T10:48:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-12 10:42:19.229546908 +0000 2024-05-12T10:48:48.898 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-12 10:42:19.229546908 +0000 2024-05-12T10:48:48.898 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-05-12 10:42:19.229546908 +0000 2024-05-12T10:48:48.898 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-12T10:48:48.958 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-12T10:48:48.958 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-12T10:48:48.958 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000343543 s, 1.5 MB/s 2024-05-12T10:48:48.960 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-12T10:48:49.015 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-05-12T10:48:49.069 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-12T10:48:49.069 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:48:49.070 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 906 Links: 1 2024-05-12T10:48:49.070 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:48:49.070 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-12 10:42:20.121538939 +0000 2024-05-12T10:48:49.070 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-12 10:42:19.797541834 +0000 2024-05-12T10:48:49.070 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-12 10:42:19.797541834 +0000 2024-05-12T10:48:49.070 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-05-12 10:42:19.797541834 +0000 2024-05-12T10:48:49.070 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-12T10:48:49.134 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-12T10:48:49.134 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-12T10:48:49.134 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000355336 s, 1.4 MB/s 2024-05-12T10:48:49.136 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-12T10:48:49.192 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-05-12T10:48:49.246 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-12T10:48:49.246 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:48:49.247 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 921 Links: 1 2024-05-12T10:48:49.247 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:48:49.247 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-12 10:42:20.705533724 +0000 2024-05-12T10:48:49.247 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-12 10:42:20.429536189 +0000 2024-05-12T10:48:49.247 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-12 10:42:20.429536189 +0000 2024-05-12T10:48:49.247 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-05-12 10:42:20.429536189 +0000 2024-05-12T10:48:49.248 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-12T10:48:49.306 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-12T10:48:49.307 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-12T10:48:49.307 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000351365 s, 1.5 MB/s 2024-05-12T10:48:49.309 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-12T10:48:49.363 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-05-12T10:48:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-12T10:48:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:48:49.417 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 939 Links: 1 2024-05-12T10:48:49.417 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:48:49.418 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-12 10:42:21.269528685 +0000 2024-05-12T10:48:49.418 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-12 10:42:20.997531115 +0000 2024-05-12T10:48:49.418 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-12 10:42:20.997531115 +0000 2024-05-12T10:48:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-05-12 10:42:20.997531115 +0000 2024-05-12T10:48:49.418 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-12T10:48:49.478 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-12T10:48:49.479 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-12T10:48:49.479 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000655163 s, 781 kB/s 2024-05-12T10:48:49.480 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-12T10:48:49.535 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-12T10:48:49.535 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:48:49.535 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-05-12T10:48:49.541 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-12T10:48:49.541 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-05-12T10:48:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-12T10:48:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:48:49.590 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-05-12T10:48:49.590 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:48:49.590 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-12 10:42:05.178854520 +0000 2024-05-12T10:48:49.590 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-12 10:42:04.922862694 +0000 2024-05-12T10:48:49.590 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-12 10:42:04.922862694 +0000 2024-05-12T10:48:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-05-12T10:48:49.591 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-12T10:48:49.645 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-12T10:48:49.645 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-12T10:48:49.645 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000452618 s, 1.1 MB/s 2024-05-12T10:48:49.646 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-12T10:48:49.699 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-05-12T10:48:49.745 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-12T10:48:49.745 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:48:49.745 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-05-12T10:48:49.745 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:48:49.746 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-12 10:42:05.646839576 +0000 2024-05-12T10:48:49.746 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-12 10:42:05.402847367 +0000 2024-05-12T10:48:49.746 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-12 10:42:05.402847367 +0000 2024-05-12T10:48:49.746 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-05-12T10:48:49.746 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-12T10:48:49.803 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-12T10:48:49.803 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-12T10:48:49.803 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000542023 s, 945 kB/s 2024-05-12T10:48:49.804 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-12T10:48:49.851 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-05-12T10:48:49.897 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-12T10:48:49.897 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:48:49.897 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-05-12T10:48:49.897 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:48:49.898 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-12 10:42:06.150826867 +0000 2024-05-12T10:48:49.898 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-12 10:42:05.886831912 +0000 2024-05-12T10:48:49.898 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-12 10:42:05.886831912 +0000 2024-05-12T10:48:49.898 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-05-12T10:48:49.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-12T10:48:49.951 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-12T10:48:49.951 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-12T10:48:49.951 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000461995 s, 1.1 MB/s 2024-05-12T10:48:49.953 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-12T10:48:50.003 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-05-12T10:48:50.053 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-12T10:48:50.053 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:48:50.053 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-05-12T10:48:50.053 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:48:50.053 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-12 10:42:06.630822579 +0000 2024-05-12T10:48:50.053 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-12 10:42:06.394824687 +0000 2024-05-12T10:48:50.054 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-12 10:42:06.394824687 +0000 2024-05-12T10:48:50.054 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-05-12T10:48:50.054 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-12T10:48:50.107 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-12T10:48:50.107 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-12T10:48:50.107 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000402814 s, 1.3 MB/s 2024-05-12T10:48:50.108 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-12T10:48:50.163 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-12T10:48:50.163 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-12T10:48:50.163 INFO:tasks.ceph:Generating config... 2024-05-12T10:48:50.164 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-12T10:48:50.164 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-05-12T10:48:50.164 INFO:tasks.ceph:[client] debug client = 20 2024-05-12T10:48:50.164 INFO:tasks.ceph:[client] debug ms = 1 2024-05-12T10:48:50.164 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-12T10:48:50.164 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-12T10:48:50.164 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-12T10:48:50.164 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-05-12T10:48:50.165 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-12T10:48:50.166 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-12T10:48:50.166 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-12T10:48:50.167 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-12T10:48:50.168 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-12T10:48:50.168 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-12T10:48:50.168 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-12T10:48:50.168 INFO:tasks.ceph:Setting up mon.a... 2024-05-12T10:48:50.168 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-12T10:48:50.212 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.keyring 2024-05-12T10:48:50.223 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-12T10:48:50.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-12T10:48:50.331 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.115'), ('mon.b', '172.21.15.134'), ('mon.c', '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]')] 2024-05-12T10:48:50.331 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.115,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-12T10:48:50.332 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:48:50.332 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-12T10:48:50.385 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.115 --add b 172.21.15.134 --addv c '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:48:50.470 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:48:50.470 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: generated fsid afd333ea-2e10-495a-8d22-6858d0930293 2024-05-12T10:48:50.470 INFO:teuthology.orchestra.run.smithi115.stdout:setting min_mon_release = quincy 2024-05-12T10:48:50.470 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 0 2024-05-12T10:48:50.471 INFO:teuthology.orchestra.run.smithi115.stdout:fsid afd333ea-2e10-495a-8d22-6858d0930293 2024-05-12T10:48:50.471 INFO:teuthology.orchestra.run.smithi115.stdout:last_changed 2024-05-12T10:48:50.480051+0000 2024-05-12T10:48:50.471 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-05-12T10:48:50.480051+0000 2024-05-12T10:48:50.471 INFO:teuthology.orchestra.run.smithi115.stdout:min_mon_release 17 (quincy) 2024-05-12T10:48:50.471 INFO:teuthology.orchestra.run.smithi115.stdout:election_strategy: 1 2024-05-12T10:48:50.471 INFO:teuthology.orchestra.run.smithi115.stdout:0: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.a 2024-05-12T10:48:50.471 INFO:teuthology.orchestra.run.smithi115.stdout:1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-05-12T10:48:50.471 INFO:teuthology.orchestra.run.smithi115.stdout:2: [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] mon.c 2024-05-12T10:48:50.471 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-12T10:48:50.473 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-12T10:48:50.520 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID afd333ea-2e10-495a-8d22-6858d0930293... 2024-05-12T10:48:50.521 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-12T10:48:50.568 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-05-12T10:48:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-05-12T10:48:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.115,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on skipped message = False 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = afd333ea-2e10-495a-8d22-6858d0930293 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-05-12T10:48:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2024-05-12T10:48:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: mon client directed command retry = 5 2024-05-12T10:48:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-05-12T10:48:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-05-12T10:48:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-05-12T10:48:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay max = 1 2024-05-12T10:48:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay probability = 0.005 2024-05-12T10:48:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay type = client mds 2024-05-12T10:48:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject socket failures = 2500 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: osd blocked scrub grace period = 3600 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: osd max markdown count = 1000 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-05-12T10:48:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-05-12T10:48:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon down mkfs grace = 300 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-05-12T10:48:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: client_shutdown_timeout = 120 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-05-12T10:48:50.610 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.e] 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.f] 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds balancer = 20 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal fragment size max = 10000 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal merge size = 5 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal split bits = 3 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal split size = 100 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2024-05-12T10:48:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: mds oft prefetch dirfrags = True 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: mds_dir_prefetch = True 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: mds_sleep_rank_change = 5000000.0 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: mon client directed command retry = 5 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay max = 1 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay probability = 0.005 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay type = client mds osd 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject socket failures = 2500 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-05-12T10:48:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-05-12T10:48:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2024-05-12T10:48:50.613 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2024-05-12T10:48:50.613 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-12T10:48:50.613 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2024-05-12T10:48:50.613 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.613 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2024-05-12T10:48:50.613 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.614 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2024-05-12T10:48:50.614 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.614 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2024-05-12T10:48:50.614 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2024-05-12T10:48:50.614 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.614 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2024-05-12T10:48:50.614 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2024-05-12T10:48:50.614 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.614 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-12T10:48:50.614 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2024-05-12T10:48:50.614 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.618 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-12T10:48:50.619 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.115,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on skipped message = False 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = afd333ea-2e10-495a-8d22-6858d0930293 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.620 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd mclock profile = high_recovery_ops 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug trim objects = true 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2024-05-12T10:48:50.621 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2024-05-12T10:48:50.622 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 20 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 20 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 10 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: mon client directed command retry = 5 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay max = 1 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay probability = 0.005 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay type = client mds 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject socket failures = 2500 2024-05-12T10:48:50.623 INFO:teuthology.orchestra.run.smithi115.stdout: osd blocked scrub grace period = 3600 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 0.95 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: osd max markdown count = 1000 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = bluestore 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2024-05-12T10:48:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: # 1m isn't quite enough 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: mon_down_mkfs_grace = 2m 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_filestore_osds = false 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: mon down mkfs grace = 300 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: mon op complaint time = 120 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2024-05-12T10:48:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: client mount timeout = 600 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: client_shutdown_timeout = 120 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.e] 2024-05-12T10:48:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.f] 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:[mds] 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds = 20 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds balancer = 20 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal fragment size max = 10000 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal merge size = 5 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal split bits = 3 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal split size = 100 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug frag = True 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug scatterstat = True 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: mds oft prefetch dirfrags = True 2024-05-12T10:48:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: mds op complaint time = 180 2024-05-12T10:48:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: mds verify scatter = True 2024-05-12T10:48:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: mds_dir_prefetch = True 2024-05-12T10:48:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: mds_sleep_rank_change = 5000000.0 2024-05-12T10:48:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: mon client directed command retry = 5 2024-05-12T10:48:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay max = 1 2024-05-12T10:48:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay probability = 0.005 2024-05-12T10:48:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay type = client mds osd 2024-05-12T10:48:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject socket failures = 2500 2024-05-12T10:48:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2024-05-12T10:48:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2024-05-12T10:48:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2024-05-12T10:48:50.631 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-12T10:48:50.631 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-12T10:48:50.729 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-12T10:48:50.729 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:48:50.729 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-12T10:48:50.738 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:48:50.738 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-12T10:48:50.789 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:48:50.789 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:48:50.789 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-12T10:48:50.789 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-12T10:48:50.864 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:48:50.864 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:48:50.917 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-05-12T10:48:50.917 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:48:50.917 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-12T10:48:50.917 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-12T10:48:50.941 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:48:50.941 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:48:51.032 INFO:tasks.ceph:Setting up mon nodes... 2024-05-12T10:48:51.032 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-12T10:48:51.032 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-12T10:48:51.086 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-12T10:48:51.092 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-12T10:48:51.134 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-12T10:48:51.149 INFO:tasks.ceph:Setting up mds nodes... 2024-05-12T10:48:51.149 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-12T10:48:51.202 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-12T10:48:51.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-12T10:48:51.227 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-12T10:48:51.325 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-12T10:48:51.330 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-12T10:48:51.349 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-12T10:48:51.449 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-12T10:48:51.454 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-12T10:48:51.473 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-12T10:48:51.517 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-12T10:48:51.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-12T10:48:51.531 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-12T10:48:51.611 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-12T10:48:51.614 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-12T10:48:51.668 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-12T10:48:51.746 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-12T10:48:51.749 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-12T10:48:51.804 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-12T10:48:51.805 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-12T10:48:51.847 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-12T10:48:51.863 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-12T10:48:51.863 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-12T10:48:51.863 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-12T10:48:51.928 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-12T10:48:51.928 INFO:tasks.ceph:role: osd.0 2024-05-12T10:48:51.928 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:48:51.928 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-12T10:48:51.995 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T10:48:51.995 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T10:48:51.995 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T10:48:51.995 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T10:48:51.996 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T10:48:51.996 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-12T10:48:51.996 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T10:48:51.996 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T10:48:51.996 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T10:48:51.996 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T10:48:52.380 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-12T10:48:52.383 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-12T10:48:52.383 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-12T10:48:52.488 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-12T10:48:52.503 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T10:48:52.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:48:52.504 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-12T10:48:52.568 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-12T10:48:52.568 INFO:tasks.ceph:role: osd.1 2024-05-12T10:48:52.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:48:52.569 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-12T10:48:52.640 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T10:48:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T10:48:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T10:48:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T10:48:52.640 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T10:48:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-12T10:48:52.641 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T10:48:52.641 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T10:48:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T10:48:52.641 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T10:48:53.033 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-12T10:48:53.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-12T10:48:53.036 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-12T10:48:53.169 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-12T10:48:53.185 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T10:48:53.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:48:53.186 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-12T10:48:53.253 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-12T10:48:53.253 INFO:tasks.ceph:role: osd.2 2024-05-12T10:48:53.253 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:48:53.253 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-12T10:48:53.324 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T10:48:53.324 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T10:48:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T10:48:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T10:48:53.325 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T10:48:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-12T10:48:53.325 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T10:48:53.325 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T10:48:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T10:48:53.325 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T10:48:53.731 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-12T10:48:53.734 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-12T10:48:53.734 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-12T10:48:53.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-12T10:48:53.900 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T10:48:53.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:48:53.901 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-12T10:48:53.965 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-12T10:48:53.965 INFO:tasks.ceph:role: osd.3 2024-05-12T10:48:53.965 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:48:53.966 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-12T10:48:54.037 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T10:48:54.037 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T10:48:54.037 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T10:48:54.037 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T10:48:54.037 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T10:48:54.037 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-12T10:48:54.037 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T10:48:54.037 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T10:48:54.037 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T10:48:54.038 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T10:48:54.392 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-12T10:48:54.395 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-12T10:48:54.395 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-12T10:48:54.472 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-12T10:48:54.529 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T10:48:54.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:48:54.531 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:48:54.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:54.657+0000 7f9f27fa17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-12T10:48:54.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:54.661+0000 7f9f27fa17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-12T10:48:54.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:54.661+0000 7f9f27fa17c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-12T10:48:54.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:54.661+0000 7f9f27fa17c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-12T10:48:54.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:54.661+0000 7f9f27fa17c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-12T10:48:54.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:54.665+0000 7f9f27fa17c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-12T10:48:57.744 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-12T10:48:57.766 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:48:57.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:57.868+0000 7fa3e212d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-12T10:48:57.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:57.868+0000 7fa3e212d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-12T10:48:57.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:57.868+0000 7fa3e212d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-12T10:48:57.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:57.868+0000 7fa3e212d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-12T10:48:57.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:57.868+0000 7fa3e212d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-12T10:48:57.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:48:57.872+0000 7fa3e212d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-12T10:49:00.888 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-12T10:49:00.909 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:49:01.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:01.008+0000 7f67cda2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-12T10:49:01.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:01.008+0000 7f67cda2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-12T10:49:01.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:01.008+0000 7f67cda2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-12T10:49:01.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:01.008+0000 7f67cda2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-12T10:49:01.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:01.008+0000 7f67cda2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-12T10:49:01.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:01.012+0000 7f67cda2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-12T10:49:04.031 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-12T10:49:04.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:49:04.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:04.200+0000 7f32580677c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-12T10:49:04.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:04.200+0000 7f32580677c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-12T10:49:04.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:04.200+0000 7f32580677c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-12T10:49:04.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:04.200+0000 7f32580677c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-12T10:49:04.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:04.200+0000 7f32580677c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-12T10:49:04.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:04.204+0000 7f32580677c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-12T10:49:07.240 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-12T10:49:07.262 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-12T10:49:07.278 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-12T10:49:07.278 INFO:tasks.ceph:role: osd.4 2024-05-12T10:49:07.278 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-05-12T10:49:07.279 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-12T10:49:07.340 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T10:49:07.340 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T10:49:07.340 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T10:49:07.340 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T10:49:07.340 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T10:49:07.340 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-05-12T10:49:07.340 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T10:49:07.341 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T10:49:07.341 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T10:49:07.341 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T10:49:07.792 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-05-12T10:49:07.794 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-05-12T10:49:07.794 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-12T10:49:07.890 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-12T10:49:07.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:49:07.901 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T10:49:07.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-12T10:49:07.960 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-12T10:49:07.961 INFO:tasks.ceph:role: osd.5 2024-05-12T10:49:07.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-05-12T10:49:07.961 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-12T10:49:08.030 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T10:49:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T10:49:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T10:49:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T10:49:08.030 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T10:49:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-05-12T10:49:08.030 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T10:49:08.030 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T10:49:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T10:49:08.031 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T10:49:08.495 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-05-12T10:49:08.497 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-05-12T10:49:08.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-12T10:49:08.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-12T10:49:08.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:49:08.659 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T10:49:08.659 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-12T10:49:08.713 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-12T10:49:08.713 INFO:tasks.ceph:role: osd.6 2024-05-12T10:49:08.713 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-05-12T10:49:08.714 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-12T10:49:08.778 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T10:49:08.779 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T10:49:08.779 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T10:49:08.779 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T10:49:08.779 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T10:49:08.779 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-05-12T10:49:08.779 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T10:49:08.779 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T10:49:08.779 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T10:49:08.779 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T10:49:09.249 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-05-12T10:49:09.251 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-05-12T10:49:09.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-12T10:49:09.385 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-12T10:49:09.397 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T10:49:09.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:49:09.398 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-12T10:49:09.453 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-12T10:49:09.454 INFO:tasks.ceph:role: osd.7 2024-05-12T10:49:09.454 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2024-05-12T10:49:09.454 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-12T10:49:09.517 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T10:49:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T10:49:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T10:49:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T10:49:09.517 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T10:49:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-05-12T10:49:09.517 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T10:49:09.517 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T10:49:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T10:49:09.518 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T10:49:09.940 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-05-12T10:49:09.942 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-05-12T10:49:09.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-12T10:49:10.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-12T10:49:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T10:49:10.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:49:10.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:49:10.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:10.200+0000 7efc681e47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-12T10:49:10.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:10.200+0000 7efc681e47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-12T10:49:10.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:10.200+0000 7efc681e47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-12T10:49:10.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:10.200+0000 7efc681e47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-12T10:49:10.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:10.200+0000 7efc681e47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-12T10:49:10.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:10.208+0000 7efc681e47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-12T10:49:13.181 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-12T10:49:13.195 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:49:13.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:13.280+0000 7f7f48d347c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-12T10:49:13.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:13.280+0000 7f7f48d347c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-12T10:49:13.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:13.280+0000 7f7f48d347c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-12T10:49:13.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:13.280+0000 7f7f48d347c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-12T10:49:13.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:13.280+0000 7f7f48d347c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-12T10:49:13.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:13.280+0000 7f7f48d347c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-12T10:49:16.257 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-12T10:49:16.319 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:49:16.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:16.407+0000 7fb28773f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-12T10:49:16.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:16.407+0000 7fb28773f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-12T10:49:16.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:16.407+0000 7fb28773f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-12T10:49:16.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:16.407+0000 7fb28773f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-12T10:49:16.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:16.407+0000 7fb28773f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-12T10:49:16.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:16.407+0000 7fb28773f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-12T10:49:18.724 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:49:18.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:49:19.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-12T10:49:19.415 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:49:19.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:19.503+0000 7f424eb977c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-12T10:49:19.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:19.503+0000 7f424eb977c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-12T10:49:19.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:19.503+0000 7f424eb977c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-12T10:49:19.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:19.503+0000 7f424eb977c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-12T10:49:19.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:19.503+0000 7f424eb977c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-12T10:49:19.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:19.503+0000 7f424eb977c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-12T10:49:22.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-12T10:49:22.542 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-12T10:49:22.543 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:22.543 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-12T10:49:22.565 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:22.565 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-12T10:49:22.626 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:22.627 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-12T10:49:22.690 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:22.690 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-12T10:49:22.758 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:22.758 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-12T10:49:22.822 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:22.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-12T10:49:22.886 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:22.886 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-12T10:49:22.950 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:22.950 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-12T10:49:23.018 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:23.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-12T10:49:23.031 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:23.031 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-12T10:49:23.085 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:23.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-12T10:49:23.141 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:23.142 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-12T10:49:23.197 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:23.197 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-12T10:49:23.252 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:23.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-12T10:49:23.306 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:23.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-12T10:49:23.361 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:23.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-12T10:49:23.417 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:23.417 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-12T10:49:23.426 INFO:tasks.ceph:Adding keys to all mons... 2024-05-12T10:49:23.426 DEBUG:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-12T10:49:23.473 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-12T10:49:23.484 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2024-05-12T10:49:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCTnkBmD+G/BRAAxVIJ7+rqwJXkzkHPprupPg== 2024-05-12T10:49:23.484 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-05-12T10:49:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCTnkBm9mKtDBAAK5pya/oUekBVylEwpdgJog== 2024-05-12T10:49:23.484 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-05-12T10:49:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCTnkBmQ9wAFBAAfxB7i82ZmyLb+YE9RTKEgg== 2024-05-12T10:49:23.484 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.e] 2024-05-12T10:49:23.484 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCTnkBmGY1gGxAA5bL35MAEhafzvu2XxXSTSg== 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCWnkBm5WmHJxAAoc7icrbzRZzcRsoR8dyvGg== 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCZnkBmkcsONBAAkVDSeQ1s9ay2jrJqWbw+MQ== 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCdnkBm1+jOABAA4XKZbMYfumHXQ9XGW2f2LA== 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCgnkBmWy5KDBAAaLICPhcJfklS5BjuBKST8g== 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCTnkBmIUWiCBAAqzs9cvuxx1uTxRV5tiETUQ== 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCTnkBmapp3HxAAWnObnHMXoArGWPmyyIBodA== 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCTnkBmJz4ZJRAAjG2bVeSvaePvmw1bbZ51KQ== 2024-05-12T10:49:23.485 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.f] 2024-05-12T10:49:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCTnkBmVvkkLRAAQhs0FIbhDk1AS+Ql7Jo6HA== 2024-05-12T10:49:23.486 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2024-05-12T10:49:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCmnkBmtuswDBAAsxuAKaeNw3+dcMeOzyegpg== 2024-05-12T10:49:23.486 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2024-05-12T10:49:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCpnkBm+KcOERAA0n6hfk7qNKDDE1dJBgH4Qg== 2024-05-12T10:49:23.486 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2024-05-12T10:49:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCsnkBmeymoGBAAyOB0pPL8LqbiNPCGhurmQw== 2024-05-12T10:49:23.486 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2024-05-12T10:49:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCvnkBm1mIVHhAArVpqtcEwZU2oUuRKJqQAUA== 2024-05-12T10:49:23.486 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-05-12T10:49:23.486 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCTnkBmKGwOMxAAmLs4IubykIwQqBf02PKTHg== 2024-05-12T10:49:23.488 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.y] 2024-05-12T10:49:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCTnkBmD+G/BRAAxVIJ7+rqwJXkzkHPprupPg== 2024-05-12T10:49:23.488 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2024-05-12T10:49:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCTnkBm9mKtDBAAK5pya/oUekBVylEwpdgJog== 2024-05-12T10:49:23.488 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2024-05-12T10:49:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCTnkBmQ9wAFBAAfxB7i82ZmyLb+YE9RTKEgg== 2024-05-12T10:49:23.488 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.e] 2024-05-12T10:49:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCTnkBmGY1gGxAA5bL35MAEhafzvu2XxXSTSg== 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCWnkBm5WmHJxAAoc7icrbzRZzcRsoR8dyvGg== 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCZnkBmkcsONBAAkVDSeQ1s9ay2jrJqWbw+MQ== 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCdnkBm1+jOABAA4XKZbMYfumHXQ9XGW2f2LA== 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.3] 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCgnkBmWy5KDBAAaLICPhcJfklS5BjuBKST8g== 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCTnkBmIUWiCBAAqzs9cvuxx1uTxRV5tiETUQ== 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCTnkBmapp3HxAAWnObnHMXoArGWPmyyIBodA== 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCTnkBmJz4ZJRAAjG2bVeSvaePvmw1bbZ51KQ== 2024-05-12T10:49:23.489 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.f] 2024-05-12T10:49:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCTnkBmVvkkLRAAQhs0FIbhDk1AS+Ql7Jo6HA== 2024-05-12T10:49:23.490 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.4] 2024-05-12T10:49:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCmnkBmtuswDBAAsxuAKaeNw3+dcMeOzyegpg== 2024-05-12T10:49:23.490 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.5] 2024-05-12T10:49:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCpnkBm+KcOERAA0n6hfk7qNKDDE1dJBgH4Qg== 2024-05-12T10:49:23.490 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.6] 2024-05-12T10:49:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCsnkBmeymoGBAAyOB0pPL8LqbiNPCGhurmQw== 2024-05-12T10:49:23.490 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.7] 2024-05-12T10:49:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCvnkBm1mIVHhAArVpqtcEwZU2oUuRKJqQAUA== 2024-05-12T10:49:23.490 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2024-05-12T10:49:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCTnkBmKGwOMxAAmLs4IubykIwQqBf02PKTHg== 2024-05-12T10:49:23.491 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-12T10:49:23.536 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-12T10:49:23.592 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:23.595 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:23.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:23.681 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:23.734 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:23.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:23.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:23.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:23.895 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:23.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:23.976 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:23.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:24.058 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:24.061 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:24.139 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-12T10:49:24.142 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-12T10:49:24.219 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:24.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:24.306 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:24.310 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:24.363 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:24.366 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T10:49:24.438 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:24.444 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:24.519 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:24.523 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:24.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:24.609 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:24.660 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:24.664 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T10:49:24.736 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-12T10:49:24.739 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-12T10:49:24.822 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-12T10:49:24.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-12T10:49:24.842 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-12T10:49:24.956 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-12T10:49:24.975 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-12T10:49:24.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-12T10:49:25.083 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-12T10:49:25.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-12T10:49:25.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-12T10:49:25.237 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-12T10:49:25.248 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:49:25.251 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-12T10:49:25.294 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-12T10:49:25.294 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-12T10:49:25.294 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-12T10:49:25.300 INFO:tasks.ceph.mon.a:Started 2024-05-12T10:49:25.300 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-12T10:49:25.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-12T10:49:25.339 INFO:tasks.ceph.mon.b:Started 2024-05-12T10:49:25.339 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-12T10:49:25.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-12T10:49:25.341 INFO:tasks.ceph.mon.c:Started 2024-05-12T10:49:25.341 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-12T10:49:25.341 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-12T10:49:25.341 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-12T10:49:25.344 INFO:tasks.ceph.mgr.y:Started 2024-05-12T10:49:25.344 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-12T10:49:25.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-12T10:49:25.346 INFO:tasks.ceph.mgr.x:Started 2024-05-12T10:49:25.346 INFO:tasks.ceph:Setting crush tunables to default 2024-05-12T10:49:25.347 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd crush tunables default 2024-05-12T10:49:25.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a3cc00640 1 Processor -- start 2024-05-12T10:49:25.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a3cc00640 1 -- start start 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a3cc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a3cc00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3815be20 con 0x7f4a38073820 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a3cc00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a38072cf0 con 0x7f4a38152df0 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a3cc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4a38072fd0 con 0x7f4a38152a10 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a36800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4a38073820 0x7f4a3815c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38880/0 (socket says 172.21.15.115:38880) 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a36800640 1 -- 172.21.15.115:0/302371551 learned_addr learned my addr 172.21.15.115:0/302371551 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a35400640 1 --1- 172.21.15.115:0/302371551 >> v1:172.21.15.134:6789/0 conn(0x7f4a38152df0 0x7f4a38073d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:32856/0 (socket says 172.21.15.115:32856) 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 msgr2=0x7f4a38159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 msgr2=0x7f4a38159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.491+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T10:49:25.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.695+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:25.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.695+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 msgr2=0x7f4a38159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T10:49:25.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.695+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 msgr2=0x7f4a38159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:25.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.695+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:25.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:25.695+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T10:49:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:26.099+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:26.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:26.099+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 msgr2=0x7f4a38159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T10:49:26.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:26.099+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 msgr2=0x7f4a38159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:26.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:26.099+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:26.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:26.099+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-12T10:49:26.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:26.903+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:26.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:26.903+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 msgr2=0x7f4a38159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T10:49:26.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:26.903+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 msgr2=0x7f4a38159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:26.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:26.903+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:26.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:26.903+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-12T10:49:28.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a2f400640 1 -- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 msgr2=0x7f4a38159310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-12T10:49:28.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a2f400640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38152a10 0x7f4a38159310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:28.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a2f400640 1 -- 172.21.15.115:0/302371551 >> v1:172.21.15.134:6789/0 conn(0x7f4a38152df0 legacy=0x7f4a38073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a2f400640 1 -- 172.21.15.115:0/302371551 >> v1:172.21.15.115:6789/0 conn(0x7f4a38073820 legacy=0x7f4a3815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a2f400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a2f400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a2f400640 1 -- 172.21.15.115:0/302371551 --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f4a38072fd0 con 0x7f4a18003720 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a2f400640 1 -- 172.21.15.115:0/302371551 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4a18008d20 con 0x7f4a180061d0 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 msgr2=0x7f4a18005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 msgr2=0x7f4a18005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a35400640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 msgr2=0x7f4a18008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-12T10:49:28.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a35400640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 msgr2=0x7f4a18008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:28.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:28.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.491+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T10:49:28.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.695+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:28.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.695+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 msgr2=0x7f4a18005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T10:49:28.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.695+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 msgr2=0x7f4a18005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:28.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.695+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:28.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.695+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:28.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.695+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T10:49:28.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.695+0000 7f4a35400640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 msgr2=0x7f4a18008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-12T10:49:28.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.695+0000 7f4a35400640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 msgr2=0x7f4a18008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:28.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.695+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:28.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:28.695+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T10:49:29.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.099+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:29.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.099+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 msgr2=0x7f4a18005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T10:49:29.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.099+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 msgr2=0x7f4a18005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:29.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.099+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:29.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.099+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:29.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.099+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-12T10:49:29.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.099+0000 7f4a35400640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 msgr2=0x7f4a18008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-12T10:49:29.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.099+0000 7f4a35400640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 msgr2=0x7f4a18008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:29.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.099+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:29.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.099+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-12T10:49:29.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.903+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:29.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.903+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.903+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 msgr2=0x7f4a18005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-12T10:49:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.903+0000 7f4a35e00640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 msgr2=0x7f4a18005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.903+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.903+0000 7f4a35e00640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-12T10:49:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.903+0000 7f4a35400640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 msgr2=0x7f4a18008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T10:49:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.903+0000 7f4a35400640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 msgr2=0x7f4a18008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:49:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.903+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:49:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:29.903+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-12T10:49:30.966 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:30.971+0000 7f1ba4f2a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T10:49:31.455 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:31.463+0000 7f1ba4f2a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T10:49:31.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.491+0000 7f4a2f400640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 msgr2=0x7f4a18008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-12T10:49:31.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.491+0000 7f4a2f400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a180061d0 0x7f4a18008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:31.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.491+0000 7f4a2f400640 1 -- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 msgr2=0x7f4a18005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-12T10:49:31.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.491+0000 7f4a2f400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.115:3300/0 conn(0x7f4a18003720 0x7f4a18005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:31.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.491+0000 7f4a36800640 1 -- 172.21.15.115:0/302371551 reap_dead start 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.491+0000 7f4a2f400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a18003b70 0x7f4a18006660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.491+0000 7f4a2f400640 1 -- 172.21.15.115:0/302371551 --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a380c4990 con 0x7f4a38073820 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.491+0000 7f4a2f400640 1 -- 172.21.15.115:0/302371551 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a180088c0 con 0x7f4a18006ba0 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.491+0000 7f4a2f400640 1 -- 172.21.15.115:0/302371551 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4a38072fd0 con 0x7f4a18003b70 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.491+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> v2:172.21.15.134:3300/0 conn(0x7f4a18003b70 0x7f4a18006660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a34a00640 1 -- 172.21.15.115:0/302371551 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625586369 0 0) 0x7f4a380c4990 con 0x7f4a38073820 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a34a00640 1 -- 172.21.15.115:0/302371551 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a1c003530 con 0x7f4a38073820 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a34a00640 1 -- 172.21.15.115:0/302371551 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3312482971 0 0) 0x7f4a180088c0 con 0x7f4a18006ba0 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a34a00640 1 -- 172.21.15.115:0/302371551 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a380c4990 con 0x7f4a18006ba0 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a34a00640 1 -- 172.21.15.115:0/302371551 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1915013779 0 0) 0x7f4a1c003530 con 0x7f4a38073820 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a35400640 1 -- 172.21.15.115:0/302371551 >> v1:172.21.15.134:6789/0 conn(0x7f4a18006ba0 legacy=0x7f4a18007050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a35400640 1 -- 172.21.15.115:0/302371551 >> v1:172.21.15.115:6789/0 conn(0x7f4a38073820 legacy=0x7f4a1800b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a35400640 1 -- 172.21.15.115:0/302371551 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a18010930 con 0x7f4a18003b70 2024-05-12T10:49:31.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a35400640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a18003b70 0x7f4a18006660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4a381531d0 tx=0x7f4a2401ce90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a12e92ab6cad104 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:31.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a34a00640 1 -- 172.21.15.115:0/302371551 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a240ab070 con 0x7f4a18003b70 2024-05-12T10:49:31.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a34a00640 1 -- 172.21.15.115:0/302371551 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a240a5ad0 con 0x7f4a18003b70 2024-05-12T10:49:31.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.495+0000 7f4a34a00640 1 -- 172.21.15.115:0/302371551 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28009a80 con 0x7f4a18003b70 2024-05-12T10:49:31.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 -- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a18003b70 msgr2=0x7f4a18006660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:31.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a18003b70 0x7f4a18006660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4a381531d0 tx=0x7f4a2401ce90 comp rx=0 tx=0).stop 2024-05-12T10:49:31.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 -- 172.21.15.115:0/302371551 shutdown_connections 2024-05-12T10:49:31.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 --2- 172.21.15.115:0/302371551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a18003b70 0x7f4a18006660 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:31.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 -- 172.21.15.115:0/302371551 >> 172.21.15.115:0/302371551 conn(0x7f4a38076830 msgr2=0x7f4a380681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:31.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 -- 172.21.15.115:0/302371551 shutdown_connections 2024-05-12T10:49:31.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 -- 172.21.15.115:0/302371551 wait complete. 2024-05-12T10:49:31.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 Processor -- start 2024-05-12T10:49:31.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 -- start start 2024-05-12T10:49:31.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a18006ba0 0x7f4a381f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:31.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38073820 0x7f4a38157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:31.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a38156fb0 0x7f4a38157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:31.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4a380735e0 con 0x7f4a18006ba0 2024-05-12T10:49:31.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4a38073460 con 0x7f4a38156fb0 2024-05-12T10:49:31.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a3cc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3815c300 con 0x7f4a38073820 2024-05-12T10:49:31.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a35e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a18006ba0 0x7f4a381f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:31.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a35e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a18006ba0 0x7f4a381f5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50338/0 (socket says 172.21.15.115:50338) 2024-05-12T10:49:31.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a35e00640 1 -- 172.21.15.115:0/1893838111 learned_addr learned my addr 172.21.15.115:0/1893838111 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:31.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.499+0000 7f4a36800640 1 --2- 172.21.15.115:0/1893838111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a38156fb0 0x7f4a38157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:31.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a35400640 1 --2- 172.21.15.115:0/1893838111 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38073820 0x7f4a38157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:31.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a35e00640 1 -- 172.21.15.115:0/1893838111 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38073820 msgr2=0x7f4a38157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:31.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a35e00640 1 --2- 172.21.15.115:0/1893838111 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38073820 0x7f4a38157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:31.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a35e00640 1 -- 172.21.15.115:0/1893838111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a38156fb0 msgr2=0x7f4a38157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:31.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a35e00640 1 --2- 172.21.15.115:0/1893838111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a38156fb0 0x7f4a38157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:31.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a35e00640 1 -- 172.21.15.115:0/1893838111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a38151560 con 0x7f4a18006ba0 2024-05-12T10:49:31.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a35e00640 1 --2- 172.21.15.115:0/1893838111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a18006ba0 0x7f4a381f5350 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4a280071c0 tx=0x7f4a28018790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:31.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a2e000640 1 -- 172.21.15.115:0/1893838111 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28024680 con 0x7f4a18006ba0 2024-05-12T10:49:31.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a2e000640 1 -- 172.21.15.115:0/1893838111 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a28024840 con 0x7f4a18006ba0 2024-05-12T10:49:31.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a3cc00640 1 -- 172.21.15.115:0/1893838111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a38151840 con 0x7f4a18006ba0 2024-05-12T10:49:31.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a2e000640 1 -- 172.21.15.115:0/1893838111 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28024c30 con 0x7f4a18006ba0 2024-05-12T10:49:31.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a3cc00640 1 -- 172.21.15.115:0/1893838111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a381567b0 con 0x7f4a18006ba0 2024-05-12T10:49:31.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a2e000640 1 -- 172.21.15.115:0/1893838111 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4a28015040 con 0x7f4a18006ba0 2024-05-12T10:49:31.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a2e000640 1 -- 172.21.15.115:0/1893838111 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4a2802d950 con 0x7f4a18006ba0 2024-05-12T10:49:31.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.503+0000 7f4a3cc00640 1 -- 172.21.15.115:0/1893838111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a38069730 con 0x7f4a18006ba0 2024-05-12T10:49:31.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.507+0000 7f4a2e000640 1 -- 172.21.15.115:0/1893838111 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4a28010040 con 0x7f4a18006ba0 2024-05-12T10:49:31.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.567+0000 7f4a3cc00640 1 -- 172.21.15.115:0/1893838111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f4a380c52f0 con 0x7f4a18006ba0 2024-05-12T10:49:31.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.567+0000 7f4a2e000640 1 -- 172.21.15.115:0/1893838111 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f4a2802dba0 con 0x7f4a18006ba0 2024-05-12T10:49:31.562 INFO:teuthology.orchestra.run.smithi115.stderr:adjusted tunables profile to default 2024-05-12T10:49:31.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.571+0000 7f4a3cc00640 1 -- 172.21.15.115:0/1893838111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a18006ba0 msgr2=0x7f4a381f5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:31.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.571+0000 7f4a3cc00640 1 --2- 172.21.15.115:0/1893838111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a18006ba0 0x7f4a381f5350 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4a280071c0 tx=0x7f4a28018790 comp rx=0 tx=0).stop 2024-05-12T10:49:31.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.571+0000 7f4a3cc00640 1 -- 172.21.15.115:0/1893838111 shutdown_connections 2024-05-12T10:49:31.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.571+0000 7f4a3cc00640 1 --2- 172.21.15.115:0/1893838111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a38156fb0 0x7f4a38157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:31.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.571+0000 7f4a3cc00640 1 --2- 172.21.15.115:0/1893838111 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a38073820 0x7f4a38157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:31.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.571+0000 7f4a3cc00640 1 --2- 172.21.15.115:0/1893838111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a18006ba0 0x7f4a381f5350 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:31.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.571+0000 7f4a3cc00640 1 -- 172.21.15.115:0/1893838111 >> 172.21.15.115:0/1893838111 conn(0x7f4a38076830 msgr2=0x7f4a380c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:31.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.571+0000 7f4a3cc00640 1 -- 172.21.15.115:0/1893838111 shutdown_connections 2024-05-12T10:49:31.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:31.571+0000 7f4a3cc00640 1 -- 172.21.15.115:0/1893838111 wait complete. 2024-05-12T10:49:31.583 INFO:tasks.ceph:check_enable_crimson: False 2024-05-12T10:49:31.583 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-12T10:49:31.583 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:31.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-12T10:49:31.602 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:31.602 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-12T10:49:31.665 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:31.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-12T10:49:31.692 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:31.699+0000 7f1ba4f2a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T10:49:31.712 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:49:31.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-12T10:49:31.773 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:31.774 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-12T10:49:31.787 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:31.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-12T10:49:31.793 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:31.798+0000 7f13f6e4a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T10:49:31.804 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:31.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-12T10:49:31.857 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-12T10:49:31.857 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-12T10:49:31.913 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new a93a5fef-2bc2-4ae6-a802-be3c7062240d 0 2024-05-12T10:49:32.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.090+0000 7fb5a67ec640 1 Processor -- start 2024-05-12T10:49:32.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.090+0000 7fb5a67ec640 1 -- start start 2024-05-12T10:49:32.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.090+0000 7fb5a67ec640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5a00c9570 0x7fb5a00cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.090+0000 7fb5a67ec640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a0072da0 con 0x7fb5a00cdb70 2024-05-12T10:49:32.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.090+0000 7fb5a67ec640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a0073080 con 0x7fb5a015ff20 2024-05-12T10:49:32.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.090+0000 7fb5a67ec640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a00c99e0 con 0x7fb5a00c9570 2024-05-12T10:49:32.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.090+0000 7fb59f7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb5a015ff20 0x7fb5a00c8e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:35938/0 (socket says 172.21.15.134:35938) 2024-05-12T10:49:32.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.090+0000 7fb59f7fe640 1 -- 172.21.15.134:0/4182652356 learned_addr learned my addr 172.21.15.134:0/4182652356 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-05-12T10:49:32.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.090+0000 7fb5a4d89640 1 --2- 172.21.15.134:0/4182652356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5a00c9570 0x7fb5a00cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb5a4d89640 1 -- 172.21.15.134:0/4182652356 >> v1:172.21.15.134:6789/0 conn(0x7fb5a015ff20 legacy=0x7fb5a00c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb5a4d89640 1 -- 172.21.15.134:0/4182652356 >> v1:172.21.15.115:6789/0 conn(0x7fb5a00cdb70 legacy=0x7fb5a015f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb59effd640 1 -- 172.21.15.134:0/4182652356 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215133528 0 0) 0x7fb5a0073080 con 0x7fb5a015ff20 2024-05-12T10:49:32.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb5a4d89640 1 -- 172.21.15.134:0/4182652356 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a0073360 con 0x7fb5a00c9570 2024-05-12T10:49:32.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb5a4d89640 1 --2- 172.21.15.134:0/4182652356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5a00c9570 0x7fb5a00cdf50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb598009dc0 tx=0x7fb59801f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62db2e7b3c260e33 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb59effd640 1 -- 172.21.15.134:0/4182652356 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5980b4070 con 0x7fb5a00c9570 2024-05-12T10:49:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb59effd640 1 -- 172.21.15.134:0/4182652356 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5980af600 con 0x7fb5a00c9570 2024-05-12T10:49:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb59effd640 1 -- 172.21.15.134:0/4182652356 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5980af9d0 con 0x7fb5a00c9570 2024-05-12T10:49:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb5a67ec640 1 -- 172.21.15.134:0/4182652356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5a00c9570 msgr2=0x7fb5a00cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb5a67ec640 1 --2- 172.21.15.134:0/4182652356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5a00c9570 0x7fb5a00cdf50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb598009dc0 tx=0x7fb59801f170 comp rx=0 tx=0).stop 2024-05-12T10:49:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb5a67ec640 1 -- 172.21.15.134:0/4182652356 shutdown_connections 2024-05-12T10:49:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb5a67ec640 1 --2- 172.21.15.134:0/4182652356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5a00c9570 0x7fb5a00cdf50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.094+0000 7fb5a67ec640 1 -- 172.21.15.134:0/4182652356 >> 172.21.15.134:0/4182652356 conn(0x7fb5a00681c0 msgr2=0x7fb5a0070840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 -- 172.21.15.134:0/4182652356 shutdown_connections 2024-05-12T10:49:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 -- 172.21.15.134:0/4182652356 wait complete. 2024-05-12T10:49:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 Processor -- start 2024-05-12T10:49:32.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 -- start start 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a00c9570 0x7fb5a00b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5a00cdb70 0x7fb5a0149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a015ff20 0x7fb5a014b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0073920 con 0x7fb5a015ff20 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a015f2f0 con 0x7fb5a00c9570 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a0071420 con 0x7fb5a00cdb70 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a00c9570 0x7fb5a00b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a00c9570 0x7fb5a00b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56376/0 (socket says 172.21.15.134:56376) 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59ffff640 1 -- 172.21.15.134:0/3808640155 learned_addr learned my addr 172.21.15.134:0/3808640155 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59f7fe640 1 --2- 172.21.15.134:0/3808640155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5a00cdb70 0x7fb5a0149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a4d89640 1 --2- 172.21.15.134:0/3808640155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a015ff20 0x7fb5a014b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59ffff640 1 -- 172.21.15.134:0/3808640155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5a00cdb70 msgr2=0x7fb5a0149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59ffff640 1 --2- 172.21.15.134:0/3808640155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5a00cdb70 0x7fb5a0149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59ffff640 1 -- 172.21.15.134:0/3808640155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a015ff20 msgr2=0x7fb5a014b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59ffff640 1 --2- 172.21.15.134:0/3808640155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a015ff20 0x7fb5a014b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59ffff640 1 -- 172.21.15.134:0/3808640155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a014a300 con 0x7fb5a00c9570 2024-05-12T10:49:32.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59ffff640 1 --2- 172.21.15.134:0/3808640155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a00c9570 0x7fb5a00b3b20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb59000c4b0 tx=0x7fb59000c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:32.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59cff9640 1 -- 172.21.15.134:0/3808640155 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5900052d0 con 0x7fb5a00c9570 2024-05-12T10:49:32.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59cff9640 1 -- 172.21.15.134:0/3808640155 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb590005470 con 0x7fb5a00c9570 2024-05-12T10:49:32.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 -- 172.21.15.134:0/3808640155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a0155360 con 0x7fb5a00c9570 2024-05-12T10:49:32.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59cff9640 1 -- 172.21.15.134:0/3808640155 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590012850 con 0x7fb5a00c9570 2024-05-12T10:49:32.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 -- 172.21.15.134:0/3808640155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a0155920 con 0x7fb5a00c9570 2024-05-12T10:49:32.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59cff9640 1 -- 172.21.15.134:0/3808640155 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb5900129f0 con 0x7fb5a00c9570 2024-05-12T10:49:32.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb59cff9640 1 -- 172.21.15.134:0/3808640155 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb59001b8b0 con 0x7fb5a00c9570 2024-05-12T10:49:32.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.098+0000 7fb5a67ec640 1 -- 172.21.15.134:0/3808640155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a0069e40 con 0x7fb5a00c9570 2024-05-12T10:49:32.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.102+0000 7fb59cff9640 1 -- 172.21.15.134:0/3808640155 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb590003600 con 0x7fb5a00c9570 2024-05-12T10:49:32.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.170+0000 7fb5a67ec640 1 -- 172.21.15.134:0/3808640155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a93a5fef-2bc2-4ae6-a802-be3c7062240d", "id": 0} v 0) -- 0x7fb5a0076aa0 con 0x7fb5a00c9570 2024-05-12T10:49:32.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.178+0000 7fb59cff9640 1 -- 172.21.15.134:0/3808640155 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a93a5fef-2bc2-4ae6-a802-be3c7062240d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb59001bb00 con 0x7fb5a00c9570 2024-05-12T10:49:32.170 INFO:teuthology.orchestra.run.smithi134.stdout:0 2024-05-12T10:49:32.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.178+0000 7fb5a67ec640 1 -- 172.21.15.134:0/3808640155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a00c9570 msgr2=0x7fb5a00b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.178+0000 7fb5a67ec640 1 --2- 172.21.15.134:0/3808640155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a00c9570 0x7fb5a00b3b20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb59000c4b0 tx=0x7fb59000c970 comp rx=0 tx=0).stop 2024-05-12T10:49:32.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.178+0000 7fb5a67ec640 1 -- 172.21.15.134:0/3808640155 shutdown_connections 2024-05-12T10:49:32.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.178+0000 7fb5a67ec640 1 --2- 172.21.15.134:0/3808640155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a015ff20 0x7fb5a014b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.178+0000 7fb5a67ec640 1 --2- 172.21.15.134:0/3808640155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5a00cdb70 0x7fb5a0149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.178+0000 7fb5a67ec640 1 --2- 172.21.15.134:0/3808640155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a00c9570 0x7fb5a00b3b20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.178+0000 7fb5a67ec640 1 -- 172.21.15.134:0/3808640155 >> 172.21.15.134:0/3808640155 conn(0x7fb5a00681c0 msgr2=0x7fb5a0070840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:32.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.178+0000 7fb5a67ec640 1 -- 172.21.15.134:0/3808640155 shutdown_connections 2024-05-12T10:49:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.178+0000 7fb5a67ec640 1 -- 172.21.15.134:0/3808640155 wait complete. 2024-05-12T10:49:32.187 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new f712194a-ad33-462b-9529-36b3b80534eb 1 2024-05-12T10:49:32.294 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:32.302+0000 7f13f6e4a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T10:49:32.301 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:32.307+0000 7f1ba4f2a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T10:49:32.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.310+0000 7f00e8e4e640 1 Processor -- start 2024-05-12T10:49:32.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.310+0000 7f00e8e4e640 1 -- start start 2024-05-12T10:49:32.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.310+0000 7f00e8e4e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f00e4155f90 0x7f00e40ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.310+0000 7f00e8e4e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f00e406c440 0x7f00e406ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.310+0000 7f00e8e4e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e4156370 con 0x7f00e415fb00 2024-05-12T10:49:32.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.310+0000 7f00e8e4e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f00e40ca5f0 con 0x7f00e4155f90 2024-05-12T10:49:32.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.310+0000 7f00e8e4e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f00e40c55c0 con 0x7f00e406c440 2024-05-12T10:49:32.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e2d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f00e406c440 0x7f00e406ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e2d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f00e406c440 0x7f00e406ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56382/0 (socket says 172.21.15.134:56382) 2024-05-12T10:49:32.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e2d9d640 1 -- 172.21.15.134:0/848690214 learned_addr learned my addr 172.21.15.134:0/848690214 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-12T10:49:32.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e259c640 1 --2- 172.21.15.134:0/848690214 >> v2:172.21.15.115:3300/0 conn(0x7f00e4155f90 0x7f00e40ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e2d9d640 1 -- 172.21.15.134:0/848690214 >> v2:172.21.15.115:3300/0 conn(0x7f00e4155f90 msgr2=0x7f00e40ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:32.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e2d9d640 1 --2- 172.21.15.134:0/848690214 >> v2:172.21.15.115:3300/0 conn(0x7f00e4155f90 0x7f00e40ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e2d9d640 1 -- 172.21.15.134:0/848690214 >> v1:172.21.15.115:6789/0 conn(0x7f00e415fb00 legacy=0x7f00e40c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e2d9d640 1 -- 172.21.15.134:0/848690214 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e415ff90 con 0x7f00e406c440 2024-05-12T10:49:32.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e2d9d640 1 --2- 172.21.15.134:0/848690214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e406c440 0x7f00e406ce00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f00e40b2520 tx=0x7f00dc01f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cb66b4ec5a4e15a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:32.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e159a640 1 -- 172.21.15.134:0/848690214 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0b4070 con 0x7f00e406c440 2024-05-12T10:49:32.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e159a640 1 -- 172.21.15.134:0/848690214 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00dc0af400 con 0x7f00e406c440 2024-05-12T10:49:32.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e159a640 1 -- 172.21.15.134:0/848690214 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0af7d0 con 0x7f00e406c440 2024-05-12T10:49:32.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e8e4e640 1 -- 172.21.15.134:0/848690214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e406c440 msgr2=0x7f00e406ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e8e4e640 1 --2- 172.21.15.134:0/848690214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e406c440 0x7f00e406ce00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f00e40b2520 tx=0x7f00dc01f1e0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e8e4e640 1 -- 172.21.15.134:0/848690214 shutdown_connections 2024-05-12T10:49:32.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e8e4e640 1 --2- 172.21.15.134:0/848690214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e406c440 0x7f00e406ce00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e8e4e640 1 --2- 172.21.15.134:0/848690214 >> v2:172.21.15.115:3300/0 conn(0x7f00e4155f90 0x7f00e40ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e8e4e640 1 -- 172.21.15.134:0/848690214 >> 172.21.15.134:0/848690214 conn(0x7f00e4072260 msgr2=0x7f00e4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:32.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e8e4e640 1 -- 172.21.15.134:0/848690214 shutdown_connections 2024-05-12T10:49:32.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.314+0000 7f00e8e4e640 1 -- 172.21.15.134:0/848690214 wait complete. 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e8e4e640 1 Processor -- start 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e8e4e640 1 -- start start 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e8e4e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e406c440 0x7f00e415d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e8e4e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00e4155f90 0x7f00e40c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e8e4e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e415cd30 0x7f00e40c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e8e4e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4070850 con 0x7f00e4155f90 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e8e4e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4070570 con 0x7f00e406c440 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e8e4e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f00e4070b30 con 0x7f00e415cd30 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e406c440 0x7f00e415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e2d9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e415cd30 0x7f00e40c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e406c440 0x7f00e415d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56384/0 (socket says 172.21.15.134:56384) 2024-05-12T10:49:32.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e259c640 1 -- 172.21.15.134:0/79861653 learned_addr learned my addr 172.21.15.134:0/79861653 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e1d9b640 1 --2- 172.21.15.134:0/79861653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00e4155f90 0x7f00e40c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e259c640 1 -- 172.21.15.134:0/79861653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e415cd30 msgr2=0x7f00e40c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e259c640 1 --2- 172.21.15.134:0/79861653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e415cd30 0x7f00e40c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e259c640 1 -- 172.21.15.134:0/79861653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00e4155f90 msgr2=0x7f00e40c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e259c640 1 --2- 172.21.15.134:0/79861653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00e4155f90 0x7f00e40c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e259c640 1 -- 172.21.15.134:0/79861653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e415e4e0 con 0x7f00e406c440 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e2d9d640 1 --2- 172.21.15.134:0/79861653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e415cd30 0x7f00e40c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e1d9b640 1 --2- 172.21.15.134:0/79861653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00e4155f90 0x7f00e40c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e259c640 1 --2- 172.21.15.134:0/79861653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e406c440 0x7f00e415d440 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f00d400d830 tx=0x7f00d400dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00daffd640 1 -- 172.21.15.134:0/79861653 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d400b6c0 con 0x7f00e406c440 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00daffd640 1 -- 172.21.15.134:0/79861653 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d4019070 con 0x7f00e406c440 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e8e4e640 1 -- 172.21.15.134:0/79861653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e415e7c0 con 0x7f00e406c440 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00daffd640 1 -- 172.21.15.134:0/79861653 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d400bae0 con 0x7f00e406c440 2024-05-12T10:49:32.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e8e4e640 1 -- 172.21.15.134:0/79861653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e40c8d70 con 0x7f00e406c440 2024-05-12T10:49:32.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.318+0000 7f00e8e4e640 1 -- 172.21.15.134:0/79861653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e4069e40 con 0x7f00e406c440 2024-05-12T10:49:32.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.322+0000 7f00daffd640 1 -- 172.21.15.134:0/79861653 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f00d400bc80 con 0x7f00e406c440 2024-05-12T10:49:32.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.322+0000 7f00daffd640 1 -- 172.21.15.134:0/79861653 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f00d4014a00 con 0x7f00e406c440 2024-05-12T10:49:32.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.322+0000 7f00daffd640 1 -- 172.21.15.134:0/79861653 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f00d4014e10 con 0x7f00e406c440 2024-05-12T10:49:32.363 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:32.371+0000 7f1ba4f2a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T10:49:32.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.390+0000 7f00e8e4e640 1 -- 172.21.15.134:0/79861653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f712194a-ad33-462b-9529-36b3b80534eb", "id": 1} v 0) -- 0x7f00e41f4a40 con 0x7f00e406c440 2024-05-12T10:49:32.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.398+0000 7f00daffd640 1 -- 172.21.15.134:0/79861653 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f712194a-ad33-462b-9529-36b3b80534eb", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f00d401e5e0 con 0x7f00e406c440 2024-05-12T10:49:32.391 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-05-12T10:49:32.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.398+0000 7f00e8e4e640 1 -- 172.21.15.134:0/79861653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e406c440 msgr2=0x7f00e415d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.398+0000 7f00e8e4e640 1 --2- 172.21.15.134:0/79861653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e406c440 0x7f00e415d440 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f00d400d830 tx=0x7f00d400dcf0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.398+0000 7f00e8e4e640 1 -- 172.21.15.134:0/79861653 shutdown_connections 2024-05-12T10:49:32.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.398+0000 7f00e8e4e640 1 --2- 172.21.15.134:0/79861653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e415cd30 0x7f00e40c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.398+0000 7f00e8e4e640 1 --2- 172.21.15.134:0/79861653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00e4155f90 0x7f00e40c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.398+0000 7f00e8e4e640 1 --2- 172.21.15.134:0/79861653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e406c440 0x7f00e415d440 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.398+0000 7f00e8e4e640 1 -- 172.21.15.134:0/79861653 >> 172.21.15.134:0/79861653 conn(0x7f00e4072260 msgr2=0x7f00e4072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:32.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.398+0000 7f00e8e4e640 1 -- 172.21.15.134:0/79861653 shutdown_connections 2024-05-12T10:49:32.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.398+0000 7f00e8e4e640 1 -- 172.21.15.134:0/79861653 wait complete. 2024-05-12T10:49:32.408 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new d412980d-26c6-43de-bc4b-83ab555bf3d0 2 2024-05-12T10:49:32.425 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:32.431+0000 7f1ba4f2a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T10:49:32.502 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:32.510+0000 7f13f6e4a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T10:49:32.513 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:32.519+0000 7f1ba4f2a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T10:49:32.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.534+0000 7f61d6ac6640 1 Processor -- start 2024-05-12T10:49:32.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.534+0000 7f61d6ac6640 1 -- start start 2024-05-12T10:49:32.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d6ac6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f61d00c7550 0x7f61d015dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d6ac6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d0154040 0x7f61d00c8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d6ac6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d00ca7f0 con 0x7f61d00c7930 2024-05-12T10:49:32.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d6ac6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f61d00caab0 con 0x7f61d00c7550 2024-05-12T10:49:32.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d6ac6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f61d00cad90 con 0x7f61d0154040 2024-05-12T10:49:32.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d5063640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d0154040 0x7f61d00c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61cffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f61d00c7930 0x7f61d0153930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:35954/0 (socket says 172.21.15.134:35954) 2024-05-12T10:49:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61cffff640 1 -- 172.21.15.134:0/1457801356 learned_addr learned my addr 172.21.15.134:0/1457801356 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-05-12T10:49:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d4862640 1 --2- 172.21.15.134:0/1457801356 >> v2:172.21.15.115:3300/0 conn(0x7f61d00c7550 0x7f61d015dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61cf7fe640 1 -- 172.21.15.134:0/1457801356 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2748276149 0 0) 0x7f61d00ca7f0 con 0x7f61d00c7930 2024-05-12T10:49:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d5063640 1 -- 172.21.15.134:0/1457801356 >> v2:172.21.15.115:3300/0 conn(0x7f61d00c7550 msgr2=0x7f61d015dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d5063640 1 --2- 172.21.15.134:0/1457801356 >> v2:172.21.15.115:3300/0 conn(0x7f61d00c7550 0x7f61d015dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d5063640 1 -- 172.21.15.134:0/1457801356 >> v1:172.21.15.134:6789/0 conn(0x7f61d00c7930 legacy=0x7f61d0153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d5063640 1 -- 172.21.15.134:0/1457801356 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d015d1a0 con 0x7f61d0154040 2024-05-12T10:49:32.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61d5063640 1 --2- 172.21.15.134:0/1457801356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d0154040 0x7f61d00c8650 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f61c80097c0 tx=0x7f61c801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dab58ab19e769e49 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:32.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61cf7fe640 1 -- 172.21.15.134:0/1457801356 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c80b5070 con 0x7f61d0154040 2024-05-12T10:49:32.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61cf7fe640 1 -- 172.21.15.134:0/1457801356 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c80a8990 con 0x7f61d0154040 2024-05-12T10:49:32.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.538+0000 7f61cf7fe640 1 -- 172.21.15.134:0/1457801356 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c80a8d60 con 0x7f61d0154040 2024-05-12T10:49:32.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 -- 172.21.15.134:0/1457801356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d0154040 msgr2=0x7f61d00c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 --2- 172.21.15.134:0/1457801356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d0154040 0x7f61d00c8650 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f61c80097c0 tx=0x7f61c801ec90 comp rx=0 tx=0).stop 2024-05-12T10:49:32.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 -- 172.21.15.134:0/1457801356 shutdown_connections 2024-05-12T10:49:32.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 --2- 172.21.15.134:0/1457801356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d0154040 0x7f61d00c8650 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 --2- 172.21.15.134:0/1457801356 >> v2:172.21.15.115:3300/0 conn(0x7f61d00c7550 0x7f61d015dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 -- 172.21.15.134:0/1457801356 >> 172.21.15.134:0/1457801356 conn(0x7f61d00681c0 msgr2=0x7f61d0070840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:32.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 -- 172.21.15.134:0/1457801356 shutdown_connections 2024-05-12T10:49:32.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 -- 172.21.15.134:0/1457801356 wait complete. 2024-05-12T10:49:32.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 Processor -- start 2024-05-12T10:49:32.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 -- start start 2024-05-12T10:49:32.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d00c7550 0x7f61d01e3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d00c7930 0x7f61d00c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61d0154040 0x7f61d00c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f61d00710e0 con 0x7f61d00c7930 2024-05-12T10:49:32.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61d015d760 con 0x7f61d0154040 2024-05-12T10:49:32.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f61d0071260 con 0x7f61d00c7550 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d4862640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d00c7550 0x7f61d01e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d5063640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61d0154040 0x7f61d00c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d4862640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d00c7550 0x7f61d01e3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:57494/0 (socket says 172.21.15.134:57494) 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d4862640 1 -- 172.21.15.134:0/2115438457 learned_addr learned my addr 172.21.15.134:0/2115438457 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61cffff640 1 --2- 172.21.15.134:0/2115438457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d00c7930 0x7f61d00c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d5063640 1 -- 172.21.15.134:0/2115438457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d00c7550 msgr2=0x7f61d01e3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d5063640 1 --2- 172.21.15.134:0/2115438457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d00c7550 0x7f61d01e3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d5063640 1 -- 172.21.15.134:0/2115438457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d00c7930 msgr2=0x7f61d00c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d5063640 1 --2- 172.21.15.134:0/2115438457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d00c7930 0x7f61d00c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d5063640 1 -- 172.21.15.134:0/2115438457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d015c9b0 con 0x7f61d0154040 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d4862640 1 --2- 172.21.15.134:0/2115438457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d00c7550 0x7f61d01e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d5063640 1 --2- 172.21.15.134:0/2115438457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61d0154040 0x7f61d00c6a40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f61c80af000 tx=0x7f61c801ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:32.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61cd7fa640 1 -- 172.21.15.134:0/2115438457 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c80bf070 con 0x7f61d0154040 2024-05-12T10:49:32.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61cd7fa640 1 -- 172.21.15.134:0/2115438457 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c80b0740 con 0x7f61d0154040 2024-05-12T10:49:32.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 -- 172.21.15.134:0/2115438457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d015cc70 con 0x7f61d0154040 2024-05-12T10:49:32.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61cd7fa640 1 -- 172.21.15.134:0/2115438457 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c80b5040 con 0x7f61d0154040 2024-05-12T10:49:32.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61d6ac6640 1 -- 172.21.15.134:0/2115438457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d015b070 con 0x7f61d0154040 2024-05-12T10:49:32.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61cd7fa640 1 -- 172.21.15.134:0/2115438457 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f61c80c2070 con 0x7f61d0154040 2024-05-12T10:49:32.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.542+0000 7f61cd7fa640 1 -- 172.21.15.134:0/2115438457 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f61c80b9810 con 0x7f61d0154040 2024-05-12T10:49:32.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.546+0000 7f61d6ac6640 1 -- 172.21.15.134:0/2115438457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d0069e40 con 0x7f61d0154040 2024-05-12T10:49:32.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.546+0000 7f61cd7fa640 1 -- 172.21.15.134:0/2115438457 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f61c80c9070 con 0x7f61d0154040 2024-05-12T10:49:32.574 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:32.579+0000 7f1ba4f2a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T10:49:32.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.614+0000 7f61d6ac6640 1 -- 172.21.15.134:0/2115438457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d412980d-26c6-43de-bc4b-83ab555bf3d0", "id": 2} v 0) -- 0x7f61d00c6260 con 0x7f61d0154040 2024-05-12T10:49:32.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.622+0000 7f61cd7fa640 1 -- 172.21.15.134:0/2115438457 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d412980d-26c6-43de-bc4b-83ab555bf3d0", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f61c80187f0 con 0x7f61d0154040 2024-05-12T10:49:32.615 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-05-12T10:49:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.622+0000 7f61d6ac6640 1 -- 172.21.15.134:0/2115438457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61d0154040 msgr2=0x7f61d00c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.622+0000 7f61d6ac6640 1 --2- 172.21.15.134:0/2115438457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61d0154040 0x7f61d00c6a40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f61c80af000 tx=0x7f61c801ba30 comp rx=0 tx=0).stop 2024-05-12T10:49:32.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.622+0000 7f61d6ac6640 1 -- 172.21.15.134:0/2115438457 shutdown_connections 2024-05-12T10:49:32.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.622+0000 7f61d6ac6640 1 --2- 172.21.15.134:0/2115438457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61d0154040 0x7f61d00c6a40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.622+0000 7f61d6ac6640 1 --2- 172.21.15.134:0/2115438457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d00c7930 0x7f61d00c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.622+0000 7f61d6ac6640 1 --2- 172.21.15.134:0/2115438457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d00c7550 0x7f61d01e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.622+0000 7f61d6ac6640 1 -- 172.21.15.134:0/2115438457 >> 172.21.15.134:0/2115438457 conn(0x7f61d00681c0 msgr2=0x7f61d0072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:32.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.622+0000 7f61d6ac6640 1 -- 172.21.15.134:0/2115438457 shutdown_connections 2024-05-12T10:49:32.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.622+0000 7f61d6ac6640 1 -- 172.21.15.134:0/2115438457 wait complete. 2024-05-12T10:49:32.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 8e841228-02a1-46d6-819a-6a1a3002468e 3 2024-05-12T10:49:32.663 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:32.671+0000 7f1ba4f2a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T10:49:32.726 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:32.731+0000 7f1ba4f2a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T10:49:32.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.750+0000 7f49f71f4640 1 Processor -- start 2024-05-12T10:49:32.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.750+0000 7f49f71f4640 1 -- start start 2024-05-12T10:49:32.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.750+0000 7f49f71f4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f00caa30 0x7f49f015ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.750+0000 7f49f71f4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f49f0071210 0x7f49f0071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.750+0000 7f49f71f4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f01599b0 con 0x7f49f0153870 2024-05-12T10:49:32.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.750+0000 7f49f71f4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f49f0073560 con 0x7f49f0071210 2024-05-12T10:49:32.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.750+0000 7f49f71f4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f49f015a2a0 con 0x7f49f00caa30 2024-05-12T10:49:32.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.750+0000 7f49effff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f00caa30 0x7f49f015ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.750+0000 7f49effff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f00caa30 0x7f49f015ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:57504/0 (socket says 172.21.15.134:57504) 2024-05-12T10:49:32.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.750+0000 7f49f5791640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f49f0071210 0x7f49f0071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.750+0000 7f49effff640 1 -- 172.21.15.134:0/1002264330 learned_addr learned my addr 172.21.15.134:0/1002264330 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-12T10:49:32.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49effff640 1 -- 172.21.15.134:0/1002264330 >> v2:172.21.15.134:3300/0 conn(0x7f49f0071210 msgr2=0x7f49f0071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:32.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49effff640 1 --2- 172.21.15.134:0/1002264330 >> v2:172.21.15.134:3300/0 conn(0x7f49f0071210 0x7f49f0071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49effff640 1 -- 172.21.15.134:0/1002264330 >> v1:172.21.15.115:6789/0 conn(0x7f49f0153870 legacy=0x7f49f00c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49effff640 1 -- 172.21.15.134:0/1002264330 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f00c8920 con 0x7f49f00caa30 2024-05-12T10:49:32.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49effff640 1 --2- 172.21.15.134:0/1002264330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f00caa30 0x7f49f015ce90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009870 tx=0x7f49dc01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fe952197e762070 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:32.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49ef7fe640 1 -- 172.21.15.134:0/1002264330 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0b5070 con 0x7f49f00caa30 2024-05-12T10:49:32.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49ef7fe640 1 -- 172.21.15.134:0/1002264330 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc0a8a50 con 0x7f49f00caa30 2024-05-12T10:49:32.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49ef7fe640 1 -- 172.21.15.134:0/1002264330 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0a8e20 con 0x7f49f00caa30 2024-05-12T10:49:32.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49f71f4640 1 -- 172.21.15.134:0/1002264330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f00caa30 msgr2=0x7f49f015ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49f71f4640 1 --2- 172.21.15.134:0/1002264330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f00caa30 0x7f49f015ce90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009870 tx=0x7f49dc01ed50 comp rx=0 tx=0).stop 2024-05-12T10:49:32.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49f71f4640 1 -- 172.21.15.134:0/1002264330 shutdown_connections 2024-05-12T10:49:32.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49f71f4640 1 --2- 172.21.15.134:0/1002264330 >> v2:172.21.15.134:3300/0 conn(0x7f49f0071210 0x7f49f0071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49f71f4640 1 --2- 172.21.15.134:0/1002264330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f00caa30 0x7f49f015ce90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49f71f4640 1 -- 172.21.15.134:0/1002264330 >> 172.21.15.134:0/1002264330 conn(0x7f49f00ce910 msgr2=0x7f49f00ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:32.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49f71f4640 1 -- 172.21.15.134:0/1002264330 shutdown_connections 2024-05-12T10:49:32.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.754+0000 7f49f71f4640 1 -- 172.21.15.134:0/1002264330 wait complete. 2024-05-12T10:49:32.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f71f4640 1 Processor -- start 2024-05-12T10:49:32.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f71f4640 1 -- start start 2024-05-12T10:49:32.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f71f4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49f0071210 0x7f49f01df980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f71f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00caa30 0x7f49f01ef790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f71f4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f0153870 0x7f49f00cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f71f4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f49f0159f30 con 0x7f49f0071210 2024-05-12T10:49:32.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f71f4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f49f0159c50 con 0x7f49f00caa30 2024-05-12T10:49:32.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f71f4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f49f0073a90 con 0x7f49f0153870 2024-05-12T10:49:32.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f5791640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f0153870 0x7f49f00cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49effff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00caa30 0x7f49f01ef790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f5791640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f0153870 0x7f49f00cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:57514/0 (socket says 172.21.15.134:57514) 2024-05-12T10:49:32.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f5791640 1 -- 172.21.15.134:0/2515497755 learned_addr learned my addr 172.21.15.134:0/2515497755 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-12T10:49:32.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f4f90640 1 --2- 172.21.15.134:0/2515497755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49f0071210 0x7f49f01df980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f5791640 1 -- 172.21.15.134:0/2515497755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00caa30 msgr2=0x7f49f01ef790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f5791640 1 --2- 172.21.15.134:0/2515497755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00caa30 0x7f49f01ef790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f5791640 1 -- 172.21.15.134:0/2515497755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49f0071210 msgr2=0x7f49f01df980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f5791640 1 --2- 172.21.15.134:0/2515497755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49f0071210 0x7f49f01df980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f5791640 1 -- 172.21.15.134:0/2515497755 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f0150770 con 0x7f49f0153870 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f4f90640 1 --2- 172.21.15.134:0/2515497755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49f0071210 0x7f49f01df980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49effff640 1 --2- 172.21.15.134:0/2515497755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00caa30 0x7f49f01ef790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f5791640 1 --2- 172.21.15.134:0/2515497755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f0153870 0x7f49f00cb270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f49e800efc0 tx=0x7f49e800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49ed7fa640 1 -- 172.21.15.134:0/2515497755 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8018020 con 0x7f49f0153870 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49ed7fa640 1 -- 172.21.15.134:0/2515497755 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e8014480 con 0x7f49f0153870 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f71f4640 1 -- 172.21.15.134:0/2515497755 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f0157aa0 con 0x7f49f0153870 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49ed7fa640 1 -- 172.21.15.134:0/2515497755 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8014870 con 0x7f49f0153870 2024-05-12T10:49:32.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f71f4640 1 -- 172.21.15.134:0/2515497755 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f01f2ea0 con 0x7f49f0153870 2024-05-12T10:49:32.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49ed7fa640 1 -- 172.21.15.134:0/2515497755 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f49e801b020 con 0x7f49f0153870 2024-05-12T10:49:32.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49ed7fa640 1 -- 172.21.15.134:0/2515497755 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f49e801ddb0 con 0x7f49f0153870 2024-05-12T10:49:32.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.758+0000 7f49f71f4640 1 -- 172.21.15.134:0/2515497755 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f0069e40 con 0x7f49f0153870 2024-05-12T10:49:32.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.762+0000 7f49ed7fa640 1 -- 172.21.15.134:0/2515497755 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f49e8022030 con 0x7f49f0153870 2024-05-12T10:49:32.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.830+0000 7f49f71f4640 1 -- 172.21.15.134:0/2515497755 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e841228-02a1-46d6-819a-6a1a3002468e", "id": 3} v 0) -- 0x7f49f0159710 con 0x7f49f0153870 2024-05-12T10:49:32.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.834+0000 7f49ed7fa640 1 -- 172.21.15.134:0/2515497755 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e841228-02a1-46d6-819a-6a1a3002468e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f49e8010040 con 0x7f49f0153870 2024-05-12T10:49:32.828 INFO:teuthology.orchestra.run.smithi134.stdout:3 2024-05-12T10:49:32.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.838+0000 7f49f71f4640 1 -- 172.21.15.134:0/2515497755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f0153870 msgr2=0x7f49f00cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.838+0000 7f49f71f4640 1 --2- 172.21.15.134:0/2515497755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f0153870 0x7f49f00cb270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f49e800efc0 tx=0x7f49e800c490 comp rx=0 tx=0).stop 2024-05-12T10:49:32.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.838+0000 7f49f71f4640 1 -- 172.21.15.134:0/2515497755 shutdown_connections 2024-05-12T10:49:32.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.838+0000 7f49f71f4640 1 --2- 172.21.15.134:0/2515497755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49f0153870 0x7f49f00cb270 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.838+0000 7f49f71f4640 1 --2- 172.21.15.134:0/2515497755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00caa30 0x7f49f01ef790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.838+0000 7f49f71f4640 1 --2- 172.21.15.134:0/2515497755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49f0071210 0x7f49f01df980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.838+0000 7f49f71f4640 1 -- 172.21.15.134:0/2515497755 >> 172.21.15.134:0/2515497755 conn(0x7f49f00ce910 msgr2=0x7f49f0151ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:32.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.838+0000 7f49f71f4640 1 -- 172.21.15.134:0/2515497755 shutdown_connections 2024-05-12T10:49:32.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.838+0000 7f49f71f4640 1 -- 172.21.15.134:0/2515497755 wait complete. 2024-05-12T10:49:32.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 8da67b2b-0ff3-4c28-897c-a8258a921018 4 2024-05-12T10:49:32.891 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:32.899+0000 7f1ba4f2a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T10:49:32.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9c56f5640 1 Processor -- start 2024-05-12T10:49:32.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9c56f5640 1 -- start start 2024-05-12T10:49:32.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9c56f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c0152b60 0x7fb9c00c5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9c56f5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9c015c0e0 0x7fb9c015c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9c56f5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9c015cab0 con 0x7fb9c0159350 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9c56f5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c006da20 con 0x7fb9c015c0e0 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9c56f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c006dd00 con 0x7fb9c0152b60 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9bf7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9c015c0e0 0x7fb9c015c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9beffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c0152b60 0x7fb9c00c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9be7fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb9c0159350 0x7fb9c00c77b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:35956/0 (socket says 172.21.15.134:35956) 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9beffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c0152b60 0x7fb9c00c5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:57524/0 (socket says 172.21.15.134:57524) 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9bf7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9c015c0e0 0x7fb9c015c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56426/0 (socket says 172.21.15.134:56426) 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9be7fc640 1 -- 172.21.15.134:0/2379927190 learned_addr learned my addr 172.21.15.134:0/2379927190 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9bf7fe640 1 -- 172.21.15.134:0/2379927190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c0152b60 msgr2=0x7fb9c00c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9bf7fe640 1 --2- 172.21.15.134:0/2379927190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c0152b60 0x7fb9c00c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9bf7fe640 1 -- 172.21.15.134:0/2379927190 >> v1:172.21.15.134:6789/0 conn(0x7fb9c0159350 legacy=0x7fb9c00c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9bf7fe640 1 -- 172.21.15.134:0/2379927190 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c00c5af0 con 0x7fb9c015c0e0 2024-05-12T10:49:32.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9bdffb640 1 -- 172.21.15.134:0/2379927190 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1077986695 0 0) 0x7fb9c015cab0 con 0x7fb9c0159350 2024-05-12T10:49:32.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.962+0000 7fb9beffd640 1 --2- 172.21.15.134:0/2379927190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c0152b60 0x7fb9c00c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:49:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9bf7fe640 1 --2- 172.21.15.134:0/2379927190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c015c0e0 0x7fb9c015c570 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009d90 tx=0x7fb9b801f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d6d0f9890828f89 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9bdffb640 1 -- 172.21.15.134:0/2379927190 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80b4070 con 0x7fb9c015c0e0 2024-05-12T10:49:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9bdffb640 1 -- 172.21.15.134:0/2379927190 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b80af600 con 0x7fb9c015c0e0 2024-05-12T10:49:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9bdffb640 1 -- 172.21.15.134:0/2379927190 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80af9d0 con 0x7fb9c015c0e0 2024-05-12T10:49:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9c56f5640 1 -- 172.21.15.134:0/2379927190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c015c0e0 msgr2=0x7fb9c015c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9c56f5640 1 --2- 172.21.15.134:0/2379927190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c015c0e0 0x7fb9c015c570 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009d90 tx=0x7fb9b801f150 comp rx=0 tx=0).stop 2024-05-12T10:49:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9c56f5640 1 -- 172.21.15.134:0/2379927190 shutdown_connections 2024-05-12T10:49:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9c56f5640 1 --2- 172.21.15.134:0/2379927190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c015c0e0 0x7fb9c015c570 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9c56f5640 1 --2- 172.21.15.134:0/2379927190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c0152b60 0x7fb9c00c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9c56f5640 1 -- 172.21.15.134:0/2379927190 >> 172.21.15.134:0/2379927190 conn(0x7fb9c00cb0f0 msgr2=0x7fb9c00cb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:32.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9c56f5640 1 -- 172.21.15.134:0/2379927190 shutdown_connections 2024-05-12T10:49:32.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.966+0000 7fb9c56f5640 1 -- 172.21.15.134:0/2379927190 wait complete. 2024-05-12T10:49:32.963 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:32.967+0000 7f1ba4f2a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T10:49:32.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9c56f5640 1 Processor -- start 2024-05-12T10:49:32.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9c56f5640 1 -- start start 2024-05-12T10:49:32.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9c56f5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c0152b60 0x7fb9c0147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9c56f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c0159350 0x7fb9c01f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9c56f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c015c0e0 0x7fb9c0157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:32.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9c56f5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c0152f40 con 0x7fb9c0152b60 2024-05-12T10:49:32.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9c56f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c00c60b0 con 0x7fb9c0159350 2024-05-12T10:49:32.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9c56f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c0159790 con 0x7fb9c015c0e0 2024-05-12T10:49:32.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9bf7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c015c0e0 0x7fb9c0157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9bf7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c015c0e0 0x7fb9c0157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:57530/0 (socket says 172.21.15.134:57530) 2024-05-12T10:49:32.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9bf7fe640 1 -- 172.21.15.134:0/1480602830 learned_addr learned my addr 172.21.15.134:0/1480602830 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-12T10:49:32.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9be7fc640 1 --2- 172.21.15.134:0/1480602830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c0159350 0x7fb9c01f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9beffd640 1 --2- 172.21.15.134:0/1480602830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c0152b60 0x7fb9c0147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:32.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9bf7fe640 1 -- 172.21.15.134:0/1480602830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c0159350 msgr2=0x7fb9c01f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9bf7fe640 1 --2- 172.21.15.134:0/1480602830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c0159350 0x7fb9c01f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9bf7fe640 1 -- 172.21.15.134:0/1480602830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c0152b60 msgr2=0x7fb9c0147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:32.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9bf7fe640 1 --2- 172.21.15.134:0/1480602830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c0152b60 0x7fb9c0147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:32.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9bf7fe640 1 -- 172.21.15.134:0/1480602830 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c0150200 con 0x7fb9c015c0e0 2024-05-12T10:49:32.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9be7fc640 1 --2- 172.21.15.134:0/1480602830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c0159350 0x7fb9c01f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:49:32.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9bf7fe640 1 --2- 172.21.15.134:0/1480602830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c015c0e0 0x7fb9c0157850 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80b2040 tx=0x7fb9b801bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:32.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9a77fe640 1 -- 172.21.15.134:0/1480602830 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80b4040 con 0x7fb9c015c0e0 2024-05-12T10:49:32.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9a77fe640 1 -- 172.21.15.134:0/1480602830 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b80c1070 con 0x7fb9c015c0e0 2024-05-12T10:49:32.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9a77fe640 1 -- 172.21.15.134:0/1480602830 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8009450 con 0x7fb9c015c0e0 2024-05-12T10:49:32.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9c56f5640 1 -- 172.21.15.134:0/1480602830 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c0151b60 con 0x7fb9c015c0e0 2024-05-12T10:49:32.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9c56f5640 1 -- 172.21.15.134:0/1480602830 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c01507a0 con 0x7fb9c015c0e0 2024-05-12T10:49:32.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9a77fe640 1 -- 172.21.15.134:0/1480602830 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb9b80ba6b0 con 0x7fb9c015c0e0 2024-05-12T10:49:32.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9c56f5640 1 -- 172.21.15.134:0/1480602830 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c0069e40 con 0x7fb9c015c0e0 2024-05-12T10:49:32.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.970+0000 7fb9a77fe640 1 -- 172.21.15.134:0/1480602830 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb9b80c6b50 con 0x7fb9c015c0e0 2024-05-12T10:49:32.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:32.974+0000 7fb9a77fe640 1 -- 172.21.15.134:0/1480602830 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb9b8018cb0 con 0x7fb9c015c0e0 2024-05-12T10:49:33.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.042+0000 7fb9c56f5640 1 -- 172.21.15.134:0/1480602830 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8da67b2b-0ff3-4c28-897c-a8258a921018", "id": 4} v 0) -- 0x7fb9c00745d0 con 0x7fb9c015c0e0 2024-05-12T10:49:33.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.046+0000 7fb9a77fe640 1 -- 172.21.15.134:0/1480602830 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8da67b2b-0ff3-4c28-897c-a8258a921018", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb9b80baae0 con 0x7fb9c015c0e0 2024-05-12T10:49:33.040 INFO:teuthology.orchestra.run.smithi134.stdout:4 2024-05-12T10:49:33.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.046+0000 7fb9c56f5640 1 -- 172.21.15.134:0/1480602830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c015c0e0 msgr2=0x7fb9c0157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.046+0000 7fb9c56f5640 1 --2- 172.21.15.134:0/1480602830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c015c0e0 0x7fb9c0157850 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80b2040 tx=0x7fb9b801bef0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.046+0000 7fb9c56f5640 1 -- 172.21.15.134:0/1480602830 shutdown_connections 2024-05-12T10:49:33.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.046+0000 7fb9c56f5640 1 --2- 172.21.15.134:0/1480602830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9c015c0e0 0x7fb9c0157850 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.046+0000 7fb9c56f5640 1 --2- 172.21.15.134:0/1480602830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c0159350 0x7fb9c01f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.046+0000 7fb9c56f5640 1 --2- 172.21.15.134:0/1480602830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c0152b60 0x7fb9c0147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.046+0000 7fb9c56f5640 1 -- 172.21.15.134:0/1480602830 >> 172.21.15.134:0/1480602830 conn(0x7fb9c00cb0f0 msgr2=0x7fb9c00686e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:33.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.046+0000 7fb9c56f5640 1 -- 172.21.15.134:0/1480602830 shutdown_connections 2024-05-12T10:49:33.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.046+0000 7fb9c56f5640 1 -- 172.21.15.134:0/1480602830 wait complete. 2024-05-12T10:49:33.056 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new fbeadb06-c696-4622-9d01-afd560a079b1 5 2024-05-12T10:49:33.072 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:33.078+0000 7f13f6e4a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T10:49:33.127 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:33.134+0000 7f13f6e4a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T10:49:33.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae23e67640 1 Processor -- start 2024-05-12T10:49:33.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae23e67640 1 -- start start 2024-05-12T10:49:33.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae23e67640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae1c155d80 0x7fae1c15fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae23e67640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fae1c0ce9c0 0x7fae1c0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae23e67640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fae1c073b20 0x7fae1c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae23e67640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fae1c15cb20 con 0x7fae1c073b20 2024-05-12T10:49:33.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae23e67640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fae1c15bf10 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae23e67640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fae1c15c1f0 con 0x7fae1c155d80 2024-05-12T10:49:33.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae21402640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fae1c0ce9c0 0x7fae1c0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae21402640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fae1c0ce9c0 0x7fae1c0735e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56434/0 (socket says 172.21.15.134:56434) 2024-05-12T10:49:33.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae21402640 1 -- 172.21.15.134:0/340141268 learned_addr learned my addr 172.21.15.134:0/340141268 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-12T10:49:33.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae21c03640 1 --2- 172.21.15.134:0/340141268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae1c155d80 0x7fae1c15fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae21402640 1 -- 172.21.15.134:0/340141268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae1c155d80 msgr2=0x7fae1c15fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:33.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae21402640 1 --2- 172.21.15.134:0/340141268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae1c155d80 0x7fae1c15fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae21402640 1 -- 172.21.15.134:0/340141268 >> v2:172.21.15.115:3300/0 conn(0x7fae1c073b20 msgr2=0x7fae1c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:33.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae21402640 1 --2- 172.21.15.134:0/340141268 >> v2:172.21.15.115:3300/0 conn(0x7fae1c073b20 0x7fae1c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.178+0000 7fae21402640 1 -- 172.21.15.134:0/340141268 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c15c4d0 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae21402640 1 --2- 172.21.15.134:0/340141268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae1c0ce9c0 0x7fae1c0735e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fae1c08e700 tx=0x7fae0c01ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a8c4fbaf95c19f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:33.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae20c01640 1 -- 172.21.15.134:0/340141268 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0b5070 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae20c01640 1 -- 172.21.15.134:0/340141268 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c0a89d0 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae20c01640 1 -- 172.21.15.134:0/340141268 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0a8da0 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae23e67640 1 -- 172.21.15.134:0/340141268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae1c0ce9c0 msgr2=0x7fae1c0735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae23e67640 1 --2- 172.21.15.134:0/340141268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae1c0ce9c0 0x7fae1c0735e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fae1c08e700 tx=0x7fae0c01ed10 comp rx=0 tx=0).stop 2024-05-12T10:49:33.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae23e67640 1 -- 172.21.15.134:0/340141268 shutdown_connections 2024-05-12T10:49:33.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae23e67640 1 --2- 172.21.15.134:0/340141268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae1c0ce9c0 0x7fae1c0735e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae23e67640 1 --2- 172.21.15.134:0/340141268 >> v2:172.21.15.115:3300/0 conn(0x7fae1c073b20 0x7fae1c0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae23e67640 1 --2- 172.21.15.134:0/340141268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae1c155d80 0x7fae1c15fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae23e67640 1 -- 172.21.15.134:0/340141268 >> 172.21.15.134:0/340141268 conn(0x7fae1c0681c0 msgr2=0x7fae1c072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:33.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae23e67640 1 -- 172.21.15.134:0/340141268 shutdown_connections 2024-05-12T10:49:33.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae23e67640 1 -- 172.21.15.134:0/340141268 wait complete. 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae23e67640 1 Processor -- start 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.182+0000 7fae23e67640 1 -- start start 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae23e67640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae1c073b20 0x7fae1c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae23e67640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae1c0ce9c0 0x7fae1c15cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae23e67640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae1c155d80 0x7fae1c0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae23e67640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c15bbc0 con 0x7fae1c073b20 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae23e67640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0cee20 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae23e67640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fae1c0cc170 con 0x7fae1c155d80 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae22404640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae1c155d80 0x7fae1c0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae21402640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae1c0ce9c0 0x7fae1c15cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae22404640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae1c155d80 0x7fae1c0b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:57536/0 (socket says 172.21.15.134:57536) 2024-05-12T10:49:33.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae22404640 1 -- 172.21.15.134:0/1858293224 learned_addr learned my addr 172.21.15.134:0/1858293224 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae21c03640 1 --2- 172.21.15.134:0/1858293224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae1c073b20 0x7fae1c1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae21402640 1 -- 172.21.15.134:0/1858293224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae1c155d80 msgr2=0x7fae1c0b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae21402640 1 --2- 172.21.15.134:0/1858293224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae1c155d80 0x7fae1c0b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae21402640 1 -- 172.21.15.134:0/1858293224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae1c073b20 msgr2=0x7fae1c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae21402640 1 --2- 172.21.15.134:0/1858293224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae1c073b20 0x7fae1c1588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae21402640 1 -- 172.21.15.134:0/1858293224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c156bf0 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae21402640 1 --2- 172.21.15.134:0/1858293224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae1c0ce9c0 0x7fae1c15cd20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0af000 tx=0x7fae0c01bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae127fc640 1 -- 172.21.15.134:0/1858293224 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0b5070 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae127fc640 1 -- 172.21.15.134:0/1858293224 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c0b0ab0 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae127fc640 1 -- 172.21.15.134:0/1858293224 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0bb410 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae23e67640 1 -- 172.21.15.134:0/1858293224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1c159260 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae23e67640 1 -- 172.21.15.134:0/1858293224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1c0b6630 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae127fc640 1 -- 172.21.15.134:0/1858293224 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fae0c0c2060 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae23e67640 1 -- 172.21.15.134:0/1858293224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae1c1f2570 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.186+0000 7fae127fc640 1 -- 172.21.15.134:0/1858293224 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fae0c0ba940 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.190+0000 7fae127fc640 1 -- 172.21.15.134:0/1858293224 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fae0c0daec0 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.182 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:33.190+0000 7f13f6e4a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T10:49:33.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.250+0000 7fae23e67640 1 -- 172.21.15.134:0/1858293224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fbeadb06-c696-4622-9d01-afd560a079b1", "id": 5} v 0) -- 0x7fae1c069e40 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.258+0000 7fae127fc640 1 -- 172.21.15.134:0/1858293224 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbeadb06-c696-4622-9d01-afd560a079b1", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fae0c0c9070 con 0x7fae1c0ce9c0 2024-05-12T10:49:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:5 2024-05-12T10:49:33.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.258+0000 7fae23e67640 1 -- 172.21.15.134:0/1858293224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae1c0ce9c0 msgr2=0x7fae1c15cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.258+0000 7fae23e67640 1 --2- 172.21.15.134:0/1858293224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae1c0ce9c0 0x7fae1c15cd20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0af000 tx=0x7fae0c01bab0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.258+0000 7fae23e67640 1 -- 172.21.15.134:0/1858293224 shutdown_connections 2024-05-12T10:49:33.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.258+0000 7fae23e67640 1 --2- 172.21.15.134:0/1858293224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae1c155d80 0x7fae1c0b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.258+0000 7fae23e67640 1 --2- 172.21.15.134:0/1858293224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae1c0ce9c0 0x7fae1c15cd20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.258+0000 7fae23e67640 1 --2- 172.21.15.134:0/1858293224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae1c073b20 0x7fae1c1588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.258+0000 7fae23e67640 1 -- 172.21.15.134:0/1858293224 >> 172.21.15.134:0/1858293224 conn(0x7fae1c0681c0 msgr2=0x7fae1c06ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:33.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.258+0000 7fae23e67640 1 -- 172.21.15.134:0/1858293224 shutdown_connections 2024-05-12T10:49:33.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.258+0000 7fae23e67640 1 -- 172.21.15.134:0/1858293224 wait complete. 2024-05-12T10:49:33.262 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:33.270+0000 7f13f6e4a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T10:49:33.268 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new dc049525-926c-4a7e-9565-165f10c8ae86 6 2024-05-12T10:49:33.315 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:33.322+0000 7f13f6e4a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T10:49:33.394 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:33.402+0000 7f13f6e4a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T10:49:33.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.434+0000 7fead78de640 1 Processor -- start 2024-05-12T10:49:33.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.434+0000 7fead78de640 1 -- start start 2024-05-12T10:49:33.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7fead78de640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead0152fd0 0x7fead00cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7fead78de640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead00c49d0 con 0x7fead00c92d0 2024-05-12T10:49:33.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7fead78de640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead00c4c70 con 0x7fead00c8c80 2024-05-12T10:49:33.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7fead78de640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fead00c85e0 con 0x7fead0152fd0 2024-05-12T10:49:33.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7fead567a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead0152fd0 0x7fead00cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7fead5e7b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fead00c8c80 0x7fead015c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:35970/0 (socket says 172.21.15.134:35970) 2024-05-12T10:49:33.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7fead5e7b640 1 -- 172.21.15.134:0/2500922905 learned_addr learned my addr 172.21.15.134:0/2500922905 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-05-12T10:49:33.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7feac7fff640 1 -- 172.21.15.134:0/2500922905 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847775222 0 0) 0x7fead00c4c70 con 0x7fead00c8c80 2024-05-12T10:49:33.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7feac7fff640 1 -- 172.21.15.134:0/2500922905 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feabc003530 con 0x7fead00c8c80 2024-05-12T10:49:33.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7fead567a640 1 -- 172.21.15.134:0/2500922905 >> v1:172.21.15.134:6789/0 conn(0x7fead00c8c80 legacy=0x7fead015c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7fead567a640 1 -- 172.21.15.134:0/2500922905 >> v1:172.21.15.115:6789/0 conn(0x7fead00c92d0 legacy=0x7fead0073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:33.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7fead567a640 1 -- 172.21.15.134:0/2500922905 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead00c8830 con 0x7fead0152fd0 2024-05-12T10:49:33.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7fead567a640 1 --2- 172.21.15.134:0/2500922905 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead0152fd0 0x7fead00cb200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feacc0097f0 tx=0x7feacc01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6442cfa42b92a07e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:33.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7feac7fff640 1 -- 172.21.15.134:0/2500922905 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc0ab610 con 0x7fead0152fd0 2024-05-12T10:49:33.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7feac7fff640 1 -- 172.21.15.134:0/2500922905 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feacc0b0070 con 0x7fead0152fd0 2024-05-12T10:49:33.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.438+0000 7feac7fff640 1 -- 172.21.15.134:0/2500922905 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc0ab9d0 con 0x7fead0152fd0 2024-05-12T10:49:33.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 -- 172.21.15.134:0/2500922905 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead0152fd0 msgr2=0x7fead00cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 --2- 172.21.15.134:0/2500922905 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead0152fd0 0x7fead00cb200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feacc0097f0 tx=0x7feacc01c4b0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 -- 172.21.15.134:0/2500922905 shutdown_connections 2024-05-12T10:49:33.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 --2- 172.21.15.134:0/2500922905 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead0152fd0 0x7fead00cb200 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 -- 172.21.15.134:0/2500922905 >> 172.21.15.134:0/2500922905 conn(0x7fead00681c0 msgr2=0x7fead0070840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:33.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 -- 172.21.15.134:0/2500922905 shutdown_connections 2024-05-12T10:49:33.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 -- 172.21.15.134:0/2500922905 wait complete. 2024-05-12T10:49:33.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 Processor -- start 2024-05-12T10:49:33.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 -- start start 2024-05-12T10:49:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fead00c8c80 0x7fead01f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead00c92d0 0x7fead014fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead0152fd0 0x7fead014ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fead0166cd0 con 0x7fead0152fd0 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fead0166b50 con 0x7fead00c8c80 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fead0166e50 con 0x7fead00c92d0 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead567a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fead00c8c80 0x7fead01f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead4e79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead00c92d0 0x7fead014fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead567a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fead00c8c80 0x7fead01f59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56448/0 (socket says 172.21.15.134:56448) 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead567a640 1 -- 172.21.15.134:0/2422847372 learned_addr learned my addr 172.21.15.134:0/2422847372 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead4e79640 1 -- 172.21.15.134:0/2422847372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fead00c8c80 msgr2=0x7fead01f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead4e79640 1 --2- 172.21.15.134:0/2422847372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fead00c8c80 0x7fead01f59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead4e79640 1 -- 172.21.15.134:0/2422847372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead0152fd0 msgr2=0x7fead014ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead4e79640 1 --2- 172.21.15.134:0/2422847372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead0152fd0 0x7fead014ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead4e79640 1 -- 172.21.15.134:0/2422847372 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead01f6460 con 0x7fead00c92d0 2024-05-12T10:49:33.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead4e79640 1 --2- 172.21.15.134:0/2422847372 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead00c92d0 0x7fead014fa40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feac000b470 tx=0x7feac000b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:33.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7feac5ffb640 1 -- 172.21.15.134:0/2422847372 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac0004020 con 0x7fead00c92d0 2024-05-12T10:49:33.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7feac5ffb640 1 -- 172.21.15.134:0/2422847372 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac00041c0 con 0x7fead00c92d0 2024-05-12T10:49:33.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 -- 172.21.15.134:0/2422847372 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead014ef60 con 0x7fead00c92d0 2024-05-12T10:49:33.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7feac5ffb640 1 -- 172.21.15.134:0/2422847372 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac0011630 con 0x7fead00c92d0 2024-05-12T10:49:33.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7fead78de640 1 -- 172.21.15.134:0/2422847372 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fead0152660 con 0x7fead00c92d0 2024-05-12T10:49:33.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7feac5ffb640 1 -- 172.21.15.134:0/2422847372 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feac0018020 con 0x7fead00c92d0 2024-05-12T10:49:33.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.442+0000 7feac5ffb640 1 -- 172.21.15.134:0/2422847372 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7feac001aa00 con 0x7fead00c92d0 2024-05-12T10:49:33.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.446+0000 7fead78de640 1 -- 172.21.15.134:0/2422847372 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead0069e40 con 0x7fead00c92d0 2024-05-12T10:49:33.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.446+0000 7feac5ffb640 1 -- 172.21.15.134:0/2422847372 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7feac0011d40 con 0x7fead00c92d0 2024-05-12T10:49:33.451 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:33.458+0000 7f13f6e4a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T10:49:33.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.514+0000 7fead78de640 1 -- 172.21.15.134:0/2422847372 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dc049525-926c-4a7e-9565-165f10c8ae86", "id": 6} v 0) -- 0x7fead00cafe0 con 0x7fead00c92d0 2024-05-12T10:49:33.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.522+0000 7feac5ffb640 1 -- 172.21.15.134:0/2422847372 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc049525-926c-4a7e-9565-165f10c8ae86", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7feac001a410 con 0x7fead00c92d0 2024-05-12T10:49:33.514 INFO:teuthology.orchestra.run.smithi134.stdout:6 2024-05-12T10:49:33.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.522+0000 7fead78de640 1 -- 172.21.15.134:0/2422847372 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead00c92d0 msgr2=0x7fead014fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.522+0000 7fead78de640 1 --2- 172.21.15.134:0/2422847372 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead00c92d0 0x7fead014fa40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feac000b470 tx=0x7feac000b930 comp rx=0 tx=0).stop 2024-05-12T10:49:33.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.522+0000 7fead78de640 1 -- 172.21.15.134:0/2422847372 shutdown_connections 2024-05-12T10:49:33.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.522+0000 7fead78de640 1 --2- 172.21.15.134:0/2422847372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead0152fd0 0x7fead014ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.522+0000 7fead78de640 1 --2- 172.21.15.134:0/2422847372 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fead00c92d0 0x7fead014fa40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.522+0000 7fead78de640 1 --2- 172.21.15.134:0/2422847372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fead00c8c80 0x7fead01f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.522+0000 7fead78de640 1 -- 172.21.15.134:0/2422847372 >> 172.21.15.134:0/2422847372 conn(0x7fead00681c0 msgr2=0x7fead00c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:33.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.522+0000 7fead78de640 1 -- 172.21.15.134:0/2422847372 shutdown_connections 2024-05-12T10:49:33.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.522+0000 7fead78de640 1 -- 172.21.15.134:0/2422847372 wait complete. 2024-05-12T10:49:33.530 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new b2137503-2e6b-4dfd-b795-4d1906824e7e 7 2024-05-12T10:49:33.600 INFO:tasks.ceph.mgr.y.smithi115.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-12T10:49:33.601 INFO:tasks.ceph.mgr.y.smithi115.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-12T10:49:33.601 INFO:tasks.ceph.mgr.y.smithi115.stderr: from numpy import show_config as show_numpy_config 2024-05-12T10:49:33.604 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:33.610+0000 7f13f6e4a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T10:49:33.643 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:33.651+0000 7f1ba4f2a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T10:49:33.668 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:33.674+0000 7f13f6e4a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T10:49:33.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febba142640 1 Processor -- start 2024-05-12T10:49:33.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febba142640 1 -- start start 2024-05-12T10:49:33.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febba142640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb4153f70 0x7febb40ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febba142640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb40cb0b0 con 0x7febb4070290 2024-05-12T10:49:33.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febba142640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb40cb350 con 0x7febb40cc4c0 2024-05-12T10:49:33.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febba142640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7febb40ca5f0 con 0x7febb4153f70 2024-05-12T10:49:33.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febb37fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb4153f70 0x7febb40ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febb3fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7febb40cc4c0 0x7febb40c50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:35978/0 (socket says 172.21.15.134:35978) 2024-05-12T10:49:33.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febb3fff640 1 -- 172.21.15.134:0/8913766 learned_addr learned my addr 172.21.15.134:0/8913766 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-05-12T10:49:33.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febb37fe640 1 -- 172.21.15.134:0/8913766 >> v1:172.21.15.134:6789/0 conn(0x7febb40cc4c0 legacy=0x7febb40c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febb37fe640 1 -- 172.21.15.134:0/8913766 >> v1:172.21.15.115:6789/0 conn(0x7febb4070290 legacy=0x7febb415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:33.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febb2ffd640 1 -- 172.21.15.134:0/8913766 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1885213513 0 0) 0x7febb40cb350 con 0x7febb40cc4c0 2024-05-12T10:49:33.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.694+0000 7febb37fe640 1 -- 172.21.15.134:0/8913766 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb40cb630 con 0x7febb4153f70 2024-05-12T10:49:33.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.698+0000 7febb37fe640 1 --2- 172.21.15.134:0/8913766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb4153f70 0x7febb40ca0b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feba40097f0 tx=0x7feba401ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c472d4838bf9f87 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:33.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.698+0000 7febb2ffd640 1 -- 172.21.15.134:0/8913766 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40b5070 con 0x7febb4153f70 2024-05-12T10:49:33.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.698+0000 7febb2ffd640 1 -- 172.21.15.134:0/8913766 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba40a8990 con 0x7febb4153f70 2024-05-12T10:49:33.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.698+0000 7febb2ffd640 1 -- 172.21.15.134:0/8913766 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40a8d60 con 0x7febb4153f70 2024-05-12T10:49:33.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.698+0000 7febba142640 1 -- 172.21.15.134:0/8913766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb4153f70 msgr2=0x7febb40ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.698+0000 7febba142640 1 --2- 172.21.15.134:0/8913766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb4153f70 0x7febb40ca0b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feba40097f0 tx=0x7feba401ecd0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.698+0000 7febba142640 1 -- 172.21.15.134:0/8913766 shutdown_connections 2024-05-12T10:49:33.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.698+0000 7febba142640 1 --2- 172.21.15.134:0/8913766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb4153f70 0x7febb40ca0b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.698+0000 7febba142640 1 -- 172.21.15.134:0/8913766 >> 172.21.15.134:0/8913766 conn(0x7febb4072260 msgr2=0x7febb4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:33.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.698+0000 7febba142640 1 -- 172.21.15.134:0/8913766 shutdown_connections 2024-05-12T10:49:33.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.698+0000 7febba142640 1 -- 172.21.15.134:0/8913766 wait complete. 2024-05-12T10:49:33.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febba142640 1 Processor -- start 2024-05-12T10:49:33.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febba142640 1 -- start start 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febba142640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febb4070290 0x7febb4158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febba142640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb40cc4c0 0x7febb41e4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febba142640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febb4153f70 0x7febb41525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febba142640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7febb40cbcc0 con 0x7febb4153f70 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febba142640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7febb40714a0 con 0x7febb4070290 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febba142640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7febb40cbfa0 con 0x7febb40cc4c0 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febb4070290 0x7febb4158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febabfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb40cc4c0 0x7febb41e4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febb4070290 0x7febb4158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56452/0 (socket says 172.21.15.134:56452) 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb37fe640 1 -- 172.21.15.134:0/2048680689 learned_addr learned my addr 172.21.15.134:0/2048680689 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb3fff640 1 --2- 172.21.15.134:0/2048680689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febb4153f70 0x7febb41525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:33.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb37fe640 1 -- 172.21.15.134:0/2048680689 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb40cc4c0 msgr2=0x7febb41e4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb37fe640 1 --2- 172.21.15.134:0/2048680689 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb40cc4c0 0x7febb41e4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb37fe640 1 -- 172.21.15.134:0/2048680689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febb4153f70 msgr2=0x7febb41525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb37fe640 1 --2- 172.21.15.134:0/2048680689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febb4153f70 0x7febb41525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb37fe640 1 -- 172.21.15.134:0/2048680689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb41e5ba0 con 0x7febb4070290 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febabfff640 1 --2- 172.21.15.134:0/2048680689 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb40cc4c0 0x7febb41e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb37fe640 1 --2- 172.21.15.134:0/2048680689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febb4070290 0x7febb4158490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feba401d380 tx=0x7feba401ba70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb0ff9640 1 -- 172.21.15.134:0/2048680689 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40b5040 con 0x7febb4070290 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb0ff9640 1 -- 172.21.15.134:0/2048680689 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba40c2070 con 0x7febb4070290 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febba142640 1 -- 172.21.15.134:0/2048680689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb41e5e80 con 0x7febb4070290 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb0ff9640 1 -- 172.21.15.134:0/2048680689 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40b0b80 con 0x7febb4070290 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febba142640 1 -- 172.21.15.134:0/2048680689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb41e4500 con 0x7febb4070290 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb0ff9640 1 -- 172.21.15.134:0/2048680689 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feba40b8070 con 0x7febb4070290 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febb0ff9640 1 -- 172.21.15.134:0/2048680689 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7feba40baac0 con 0x7febb4070290 2024-05-12T10:49:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.702+0000 7febba142640 1 -- 172.21.15.134:0/2048680689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb41e4010 con 0x7febb4070290 2024-05-12T10:49:33.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.706+0000 7febb0ff9640 1 -- 172.21.15.134:0/2048680689 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7feba4018830 con 0x7febb4070290 2024-05-12T10:49:33.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.774+0000 7febba142640 1 -- 172.21.15.134:0/2048680689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b2137503-2e6b-4dfd-b795-4d1906824e7e", "id": 7} v 0) -- 0x7febb4069e40 con 0x7febb4070290 2024-05-12T10:49:33.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.778+0000 7febb0ff9640 1 -- 172.21.15.134:0/2048680689 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b2137503-2e6b-4dfd-b795-4d1906824e7e", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7feba40b0d20 con 0x7febb4070290 2024-05-12T10:49:33.772 INFO:teuthology.orchestra.run.smithi134.stdout:7 2024-05-12T10:49:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.782+0000 7febba142640 1 -- 172.21.15.134:0/2048680689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febb4070290 msgr2=0x7febb4158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.782+0000 7febba142640 1 --2- 172.21.15.134:0/2048680689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febb4070290 0x7febb4158490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feba401d380 tx=0x7feba401ba70 comp rx=0 tx=0).stop 2024-05-12T10:49:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.782+0000 7febba142640 1 -- 172.21.15.134:0/2048680689 shutdown_connections 2024-05-12T10:49:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.782+0000 7febba142640 1 --2- 172.21.15.134:0/2048680689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febb4153f70 0x7febb41525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.782+0000 7febba142640 1 --2- 172.21.15.134:0/2048680689 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febb40cc4c0 0x7febb41e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.782+0000 7febba142640 1 --2- 172.21.15.134:0/2048680689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febb4070290 0x7febb4158490 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.782+0000 7febba142640 1 -- 172.21.15.134:0/2048680689 >> 172.21.15.134:0/2048680689 conn(0x7febb4072260 msgr2=0x7febb415a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:33.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.782+0000 7febba142640 1 -- 172.21.15.134:0/2048680689 shutdown_connections 2024-05-12T10:49:33.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-12T10:49:33.782+0000 7febba142640 1 -- 172.21.15.134:0/2048680689 wait complete. 2024-05-12T10:49:33.789 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-12T10:49:33.789 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-12T10:49:33.792 INFO:tasks.ceph.osd.0:Started 2024-05-12T10:49:33.793 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-12T10:49:33.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-12T10:49:33.793 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:33.799+0000 7f1ba4f2a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:49:33.796 INFO:tasks.ceph.osd.1:Started 2024-05-12T10:49:33.796 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-12T10:49:33.796 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-12T10:49:33.799 INFO:tasks.ceph.osd.2:Started 2024-05-12T10:49:33.799 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-12T10:49:33.799 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-12T10:49:33.806 INFO:tasks.ceph.osd.3:Started 2024-05-12T10:49:33.806 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-12T10:49:33.807 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-12T10:49:33.835 INFO:tasks.ceph.osd.4:Started 2024-05-12T10:49:33.835 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-12T10:49:33.836 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-12T10:49:33.838 INFO:tasks.ceph.osd.5:Started 2024-05-12T10:49:33.838 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-12T10:49:33.838 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-12T10:49:33.840 INFO:tasks.ceph.osd.6:Started 2024-05-12T10:49:33.841 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-12T10:49:33.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-12T10:49:33.843 INFO:tasks.ceph.osd.7:Started 2024-05-12T10:49:33.843 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:49:34.005 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:34.011+0000 7f1ba4f2a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T10:49:34.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.019+0000 7ff8b5600640 1 Processor -- start 2024-05-12T10:49:34.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.019+0000 7ff8b5600640 1 -- start start 2024-05-12T10:49:34.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8b5600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff8b0159430 0x7ff8b00cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:34.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8b5600640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8b00c5050 con 0x7ff8b015fc60 2024-05-12T10:49:34.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8b5600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8b00c52f0 con 0x7ff8b00c9fd0 2024-05-12T10:49:34.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8b5600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff8b00c5c20 con 0x7ff8b0159430 2024-05-12T10:49:34.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8aea00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff8b0159430 0x7ff8b00cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8ae000640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff8b00c9fd0 0x7ff8b015f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:48496/0 (socket says 172.21.15.115:48496) 2024-05-12T10:49:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8ae000640 1 -- 172.21.15.115:0/3229940045 learned_addr learned my addr 172.21.15.115:0/3229940045 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8af400640 1 --1- 172.21.15.115:0/3229940045 >> v1:172.21.15.115:6789/0 conn(0x7ff8b015fc60 0x7ff8b0166780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43966/0 (socket says 172.21.15.115:43966) 2024-05-12T10:49:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8aea00640 1 -- 172.21.15.115:0/3229940045 >> v1:172.21.15.134:6789/0 conn(0x7ff8b00c9fd0 legacy=0x7ff8b015f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8ad600640 1 -- 172.21.15.115:0/3229940045 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 945374915 0 0) 0x7ff8b00c5050 con 0x7ff8b015fc60 2024-05-12T10:49:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8aea00640 1 -- 172.21.15.115:0/3229940045 >> v1:172.21.15.115:6789/0 conn(0x7ff8b015fc60 legacy=0x7ff8b0166780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.023+0000 7ff8aea00640 1 -- 172.21.15.115:0/3229940045 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b00c55d0 con 0x7ff8b0159430 2024-05-12T10:49:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8aea00640 1 --2- 172.21.15.115:0/3229940045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b0159430 0x7ff8b00cf560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00097c0 tx=0x7ff8a001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6daa5939df21612 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:34.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8ad600640 1 -- 172.21.15.115:0/3229940045 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00b5070 con 0x7ff8b0159430 2024-05-12T10:49:34.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8ad600640 1 -- 172.21.15.115:0/3229940045 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a00a8990 con 0x7ff8b0159430 2024-05-12T10:49:34.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8ad600640 1 -- 172.21.15.115:0/3229940045 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00a8d60 con 0x7ff8b0159430 2024-05-12T10:49:34.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 -- 172.21.15.115:0/3229940045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b0159430 msgr2=0x7ff8b00cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:34.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 --2- 172.21.15.115:0/3229940045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b0159430 0x7ff8b00cf560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00097c0 tx=0x7ff8a001ec90 comp rx=0 tx=0).stop 2024-05-12T10:49:34.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 -- 172.21.15.115:0/3229940045 shutdown_connections 2024-05-12T10:49:34.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 --2- 172.21.15.115:0/3229940045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b0159430 0x7ff8b00cf560 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:34.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 -- 172.21.15.115:0/3229940045 >> 172.21.15.115:0/3229940045 conn(0x7ff8b006c440 msgr2=0x7ff8b006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:34.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 -- 172.21.15.115:0/3229940045 shutdown_connections 2024-05-12T10:49:34.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 -- 172.21.15.115:0/3229940045 wait complete. 2024-05-12T10:49:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 Processor -- start 2024-05-12T10:49:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 -- start start 2024-05-12T10:49:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b00c9fd0 0x7ff8b00c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b0159430 0x7ff8b014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b015fc60 0x7ff8b00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b006d180 con 0x7ff8b0159430 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b00ca580 con 0x7ff8b00c9fd0 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.027+0000 7ff8b5600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b00cbcc0 con 0x7ff8b015fc60 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8ae000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b0159430 0x7ff8b014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8ae000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b0159430 0x7ff8b014f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56792/0 (socket says 172.21.15.115:56792) 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8ae000640 1 -- 172.21.15.115:0/656273698 learned_addr learned my addr 172.21.15.115:0/656273698 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8aea00640 1 --2- 172.21.15.115:0/656273698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b00c9fd0 0x7ff8b00c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8af400640 1 --2- 172.21.15.115:0/656273698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b015fc60 0x7ff8b00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8ae000640 1 -- 172.21.15.115:0/656273698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b015fc60 msgr2=0x7ff8b00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8ae000640 1 --2- 172.21.15.115:0/656273698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b015fc60 0x7ff8b00b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8ae000640 1 -- 172.21.15.115:0/656273698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b00c9fd0 msgr2=0x7ff8b00c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8ae000640 1 --2- 172.21.15.115:0/656273698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b00c9fd0 0x7ff8b00c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8ae000640 1 -- 172.21.15.115:0/656273698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b01f22f0 con 0x7ff8b0159430 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8af400640 1 --2- 172.21.15.115:0/656273698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b015fc60 0x7ff8b00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:49:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8ae000640 1 --2- 172.21.15.115:0/656273698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b0159430 0x7ff8b014f220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00c500 tx=0x7ff89c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:34.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8a6a00640 1 -- 172.21.15.115:0/656273698 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c017070 con 0x7ff8b0159430 2024-05-12T10:49:34.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8b5600640 1 -- 172.21.15.115:0/656273698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b01f6300 con 0x7ff8b0159430 2024-05-12T10:49:34.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8a6a00640 1 -- 172.21.15.115:0/656273698 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff89c005cf0 con 0x7ff8b0159430 2024-05-12T10:49:34.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8a6a00640 1 -- 172.21.15.115:0/656273698 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0072f0 con 0x7ff8b0159430 2024-05-12T10:49:34.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8b5600640 1 -- 172.21.15.115:0/656273698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b01f2870 con 0x7ff8b0159430 2024-05-12T10:49:34.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8a6a00640 1 -- 172.21.15.115:0/656273698 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff89c01a070 con 0x7ff8b0159430 2024-05-12T10:49:34.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8a6a00640 1 -- 172.21.15.115:0/656273698 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff89c01cc10 con 0x7ff8b0159430 2024-05-12T10:49:34.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.031+0000 7ff8b5600640 1 -- 172.21.15.115:0/656273698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b0069730 con 0x7ff8b0159430 2024-05-12T10:49:34.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.035+0000 7ff8a6a00640 1 -- 172.21.15.115:0/656273698 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff89c007490 con 0x7ff8b0159430 2024-05-12T10:49:34.084 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:34.091+0000 7f1ba4f2a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T10:49:34.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.091+0000 7ff8b5600640 1 -- 172.21.15.115:0/656273698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8b0074a40 con 0x7ff8b0159430 2024-05-12T10:49:34.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.091+0000 7ff8a6a00640 1 -- 172.21.15.115:0/656273698 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff89c007670 con 0x7ff8b0159430 2024-05-12T10:49:34.086 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:49:34.086 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":10,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:49:33.776335+0000","last_up_change":"0.000000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:49:34.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.095+0000 7ff8b5600640 1 -- 172.21.15.115:0/656273698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b0159430 msgr2=0x7ff8b014f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:34.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.095+0000 7ff8b5600640 1 --2- 172.21.15.115:0/656273698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b0159430 0x7ff8b014f220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00c500 tx=0x7ff89c00c9c0 comp rx=0 tx=0).stop 2024-05-12T10:49:34.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.095+0000 7ff8b5600640 1 -- 172.21.15.115:0/656273698 shutdown_connections 2024-05-12T10:49:34.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.095+0000 7ff8b5600640 1 --2- 172.21.15.115:0/656273698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b015fc60 0x7ff8b00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:34.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.095+0000 7ff8b5600640 1 --2- 172.21.15.115:0/656273698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b0159430 0x7ff8b014f220 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:34.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.095+0000 7ff8b5600640 1 --2- 172.21.15.115:0/656273698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b00c9fd0 0x7ff8b00c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:34.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.095+0000 7ff8b5600640 1 -- 172.21.15.115:0/656273698 >> 172.21.15.115:0/656273698 conn(0x7ff8b006c440 msgr2=0x7ff8b01570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:34.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.095+0000 7ff8b5600640 1 -- 172.21.15.115:0/656273698 shutdown_connections 2024-05-12T10:49:34.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:34.095+0000 7ff8b5600640 1 -- 172.21.15.115:0/656273698 wait complete. 2024-05-12T10:49:34.105 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-12T10:49:34.106 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-12T10:49:34.237 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:34.243+0000 7f1ba4f2a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:49:34.285 INFO:tasks.ceph.mgr.x.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-12T10:49:34.285 INFO:tasks.ceph.mgr.x.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-12T10:49:34.285 INFO:tasks.ceph.mgr.x.smithi134.stderr: from numpy import show_config as show_numpy_config 2024-05-12T10:49:34.331 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:34.338+0000 7f13f6e4a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T10:49:34.431 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-05-12T10:49:34.438+0000 7f9f2a9047c0 -1 Falling back to public interface 2024-05-12T10:49:34.443 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-05-12T10:49:34.450+0000 7f45428197c0 -1 Falling back to public interface 2024-05-12T10:49:34.454 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-05-12T10:49:34.462+0000 7f8d346e07c0 -1 Falling back to public interface 2024-05-12T10:49:34.458 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-05-12T10:49:34.466+0000 7ff7829487c0 -1 Falling back to public interface 2024-05-12T10:49:34.467 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-05-12T10:49:34.474+0000 7f634a6727c0 -1 Falling back to public interface 2024-05-12T10:49:34.468 INFO:tasks.ceph.osd.3.smithi115.stderr:2024-05-12T10:49:34.474+0000 7fe455efd7c0 -1 Falling back to public interface 2024-05-12T10:49:34.479 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-05-12T10:49:34.486+0000 7f65131b67c0 -1 Falling back to public interface 2024-05-12T10:49:34.480 INFO:tasks.ceph.osd.2.smithi115.stderr:2024-05-12T10:49:34.486+0000 7f81805d87c0 -1 Falling back to public interface 2024-05-12T10:49:34.481 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:34.486+0000 7f13f6e4a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:49:34.485 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-05-12T10:49:34.490+0000 7f6511c00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6825/0: (98) Address already in use 2024-05-12T10:49:34.645 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:34.654+0000 7f13f6e4a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T10:49:34.715 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:34.722+0000 7f13f6e4a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T10:49:34.861 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:34.866+0000 7f13f6e4a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:49:34.912 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-12T10:49:34.946 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:34.950+0000 7f1ba4f2a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T10:49:35.035 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:35.042+0000 7f1ba4f2a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T10:49:35.041 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.046+0000 7f6c4ca00640 1 Processor -- start 2024-05-12T10:49:35.041 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.046+0000 7f6c4ca00640 1 -- start start 2024-05-12T10:49:35.043 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c4ca00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6c48152f10 0x7f6c480c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:35.043 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c4ca00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c480c8770 con 0x7f6c480ca280 2024-05-12T10:49:35.043 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c4ca00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c480c7870 con 0x7f6c48152b30 2024-05-12T10:49:35.043 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c4ca00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6c480c80d0 con 0x7f6c48152f10 2024-05-12T10:49:35.043 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c46800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6c480ca280 0x7f6c4815c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43974/0 (socket says 172.21.15.115:43974) 2024-05-12T10:49:35.043 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c46800640 1 -- 172.21.15.115:0/2028786867 learned_addr learned my addr 172.21.15.115:0/2028786867 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:35.043 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c3d400640 1 --2- 172.21.15.115:0/2028786867 >> v2:172.21.15.134:3300/0 conn(0x7f6c48152f10 0x7f6c480c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:35.044 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c45400640 1 -- 172.21.15.115:0/2028786867 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372550391 0 0) 0x7f6c480c8770 con 0x7f6c480ca280 2024-05-12T10:49:35.044 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c45400640 1 -- 172.21.15.115:0/2028786867 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c2c003530 con 0x7f6c480ca280 2024-05-12T10:49:35.044 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c3d400640 1 -- 172.21.15.115:0/2028786867 >> v1:172.21.15.134:6789/0 conn(0x7f6c48152b30 legacy=0x7f6c480c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:35.044 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c3d400640 1 -- 172.21.15.115:0/2028786867 >> v1:172.21.15.115:6789/0 conn(0x7f6c480ca280 legacy=0x7f6c4815c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:35.044 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.050+0000 7f6c3d400640 1 -- 172.21.15.115:0/2028786867 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c480c7b10 con 0x7f6c48152f10 2024-05-12T10:49:35.046 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c3d400640 1 --2- 172.21.15.115:0/2028786867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48152f10 0x7f6c480c9d40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6c480c8250 tx=0x7f6c3001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e14189fea692d842 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:35.047 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c45400640 1 -- 172.21.15.115:0/2028786867 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c300b1070 con 0x7f6c48152f10 2024-05-12T10:49:35.047 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c45400640 1 -- 172.21.15.115:0/2028786867 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c300ac640 con 0x7f6c48152f10 2024-05-12T10:49:35.047 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c45400640 1 -- 172.21.15.115:0/2028786867 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c300aca10 con 0x7f6c48152f10 2024-05-12T10:49:35.048 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 -- 172.21.15.115:0/2028786867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48152f10 msgr2=0x7f6c480c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:35.048 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 --2- 172.21.15.115:0/2028786867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48152f10 0x7f6c480c9d40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6c480c8250 tx=0x7f6c3001c4a0 comp rx=0 tx=0).stop 2024-05-12T10:49:35.048 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 -- 172.21.15.115:0/2028786867 shutdown_connections 2024-05-12T10:49:35.048 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 --2- 172.21.15.115:0/2028786867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48152f10 0x7f6c480c9d40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:35.048 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 -- 172.21.15.115:0/2028786867 >> 172.21.15.115:0/2028786867 conn(0x7f6c4806f450 msgr2=0x7f6c48070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:35.048 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 -- 172.21.15.115:0/2028786867 shutdown_connections 2024-05-12T10:49:35.048 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 -- 172.21.15.115:0/2028786867 wait complete. 2024-05-12T10:49:35.049 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 Processor -- start 2024-05-12T10:49:35.049 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 -- start start 2024-05-12T10:49:35.052 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c480ca280 0x7f6c481454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:35.052 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48152b30 0x7f6c4815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:35.052 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c48152f10 0x7f6c4815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:35.052 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6c481663d0 con 0x7f6c480ca280 2024-05-12T10:49:35.052 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c480ca660 con 0x7f6c48152b30 2024-05-12T10:49:35.052 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c4ca00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6c48166550 con 0x7f6c48152f10 2024-05-12T10:49:35.052 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.054+0000 7f6c45e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c480ca280 0x7f6c481454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c45e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c480ca280 0x7f6c481454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56794/0 (socket says 172.21.15.115:56794) 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c3d400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48152b30 0x7f6c4815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c45e00640 1 -- 172.21.15.115:0/1703762804 learned_addr learned my addr 172.21.15.115:0/1703762804 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c46800640 1 --2- 172.21.15.115:0/1703762804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c48152f10 0x7f6c4815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c45e00640 1 -- 172.21.15.115:0/1703762804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c48152f10 msgr2=0x7f6c4815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c45e00640 1 --2- 172.21.15.115:0/1703762804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c48152f10 0x7f6c4815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c45e00640 1 -- 172.21.15.115:0/1703762804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48152b30 msgr2=0x7f6c4815ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c45e00640 1 --2- 172.21.15.115:0/1703762804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48152b30 0x7f6c4815ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c45e00640 1 -- 172.21.15.115:0/1703762804 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c481f41b0 con 0x7f6c480ca280 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c3d400640 1 --2- 172.21.15.115:0/1703762804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48152b30 0x7f6c4815ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c45e00640 1 --2- 172.21.15.115:0/1703762804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c480ca280 0x7f6c481454a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c4e0 tx=0x7f6c3800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c3ea00640 1 -- 172.21.15.115:0/1703762804 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c380052d0 con 0x7f6c480ca280 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c3ea00640 1 -- 172.21.15.115:0/1703762804 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c38005470 con 0x7f6c480ca280 2024-05-12T10:49:35.053 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c3ea00640 1 -- 172.21.15.115:0/1703762804 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38012850 con 0x7f6c480ca280 2024-05-12T10:49:35.054 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c4ca00640 1 -- 172.21.15.115:0/1703762804 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c481459e0 con 0x7f6c480ca280 2024-05-12T10:49:35.054 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c4ca00640 1 -- 172.21.15.115:0/1703762804 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c481f4750 con 0x7f6c480ca280 2024-05-12T10:49:35.054 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c3ea00640 1 -- 172.21.15.115:0/1703762804 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c380129f0 con 0x7f6c480ca280 2024-05-12T10:49:35.054 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c3ea00640 1 -- 172.21.15.115:0/1703762804 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6c38012ce0 con 0x7f6c480ca280 2024-05-12T10:49:35.054 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.058+0000 7f6c4ca00640 1 -- 172.21.15.115:0/1703762804 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c48050750 con 0x7f6c480ca280 2024-05-12T10:49:35.055 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.062+0000 7f6c3ea00640 1 -- 172.21.15.115:0/1703762804 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6c38003600 con 0x7f6c480ca280 2024-05-12T10:49:35.112 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.118+0000 7f6c4ca00640 1 -- 172.21.15.115:0/1703762804 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c480caba0 con 0x7f6c480ca280 2024-05-12T10:49:35.113 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.118+0000 7f6c3ea00640 1 -- 172.21.15.115:0/1703762804 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6c380037e0 con 0x7f6c480ca280 2024-05-12T10:49:35.113 INFO:teuthology.misc.health.smithi115.stdout: 2024-05-12T10:49:35.113 INFO:teuthology.misc.health.smithi115.stdout:{"epoch":10,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:49:33.776335+0000","last_up_change":"0.000000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:49:35.114 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.118+0000 7f6c4ca00640 1 -- 172.21.15.115:0/1703762804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c480ca280 msgr2=0x7f6c481454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:35.114 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.118+0000 7f6c4ca00640 1 --2- 172.21.15.115:0/1703762804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c480ca280 0x7f6c481454a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c4e0 tx=0x7f6c3800c9a0 comp rx=0 tx=0).stop 2024-05-12T10:49:35.114 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.118+0000 7f6c4ca00640 1 -- 172.21.15.115:0/1703762804 shutdown_connections 2024-05-12T10:49:35.115 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.118+0000 7f6c4ca00640 1 --2- 172.21.15.115:0/1703762804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c48152f10 0x7f6c4815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:35.115 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.118+0000 7f6c4ca00640 1 --2- 172.21.15.115:0/1703762804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48152b30 0x7f6c4815ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:35.115 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.118+0000 7f6c4ca00640 1 --2- 172.21.15.115:0/1703762804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c480ca280 0x7f6c481454a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:35.115 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.118+0000 7f6c4ca00640 1 -- 172.21.15.115:0/1703762804 >> 172.21.15.115:0/1703762804 conn(0x7f6c4806f450 msgr2=0x7f6c48150bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:35.115 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.118+0000 7f6c4ca00640 1 -- 172.21.15.115:0/1703762804 shutdown_connections 2024-05-12T10:49:35.115 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:35.118+0000 7f6c4ca00640 1 -- 172.21.15.115:0/1703762804 wait complete. 2024-05-12T10:49:35.131 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-12T10:49:35.244 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:35.250+0000 7f1ba4f2a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T10:49:35.329 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:35.334+0000 7f1ba4f2a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T10:49:35.475 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:35.482+0000 7f13f6e4a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T10:49:35.549 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:35.554+0000 7f13f6e4a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T10:49:35.655 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:35.662+0000 7f1ba4f2a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T10:49:35.726 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:35.730+0000 7f1ba4f2a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T10:49:35.731 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:35.738+0000 7f13f6e4a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T10:49:35.809 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:35.814+0000 7f13f6e4a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T10:49:36.097 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:36.102+0000 7f13f6e4a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T10:49:36.158 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-05-12T10:49:36.166+0000 7f13f6e4a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T10:49:36.750 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:36.754+0000 7f1b4a600640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-12T10:49:36.750 INFO:tasks.ceph.mgr.y.smithi115.stderr:2024-05-12T10:49:36.754+0000 7f1b4a600640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-12T10:49:38.212 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-05-12T10:49:38.218+0000 7f9f2a9047c0 -1 osd.4 0 log_to_monitors true 2024-05-12T10:49:38.326 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-05-12T10:49:38.334+0000 7f8d346e07c0 -1 osd.7 0 log_to_monitors true 2024-05-12T10:49:38.353 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-05-12T10:49:38.362+0000 7ff7829487c0 -1 osd.6 0 log_to_monitors true 2024-05-12T10:49:38.375 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-05-12T10:49:38.382+0000 7f45428197c0 -1 osd.5 0 log_to_monitors true 2024-05-12T10:49:38.499 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-05-12T10:49:38.502+0000 7f65131b67c0 -1 osd.0 0 log_to_monitors true 2024-05-12T10:49:38.558 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-05-12T10:49:38.562+0000 7f634a6727c0 -1 osd.1 0 log_to_monitors true 2024-05-12T10:49:38.673 INFO:tasks.ceph.osd.3.smithi115.stderr:2024-05-12T10:49:38.678+0000 7fe455efd7c0 -1 osd.3 0 log_to_monitors true 2024-05-12T10:49:38.785 INFO:tasks.ceph.osd.2.smithi115.stderr:2024-05-12T10:49:38.790+0000 7f81805d87c0 -1 osd.2 0 log_to_monitors true 2024-05-12T10:49:41.747 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-05-12T10:49:41.750+0000 7f650e000640 -1 osd.0 0 waiting for initial osdmap 2024-05-12T10:49:41.777 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-05-12T10:49:41.782+0000 7f6504000640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T10:49:41.797 INFO:tasks.ceph.osd.3.smithi115.stderr:2024-05-12T10:49:41.802+0000 7fe450e00640 -1 osd.3 0 waiting for initial osdmap 2024-05-12T10:49:41.826 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-05-12T10:49:41.830+0000 7f6345600640 -1 osd.1 0 waiting for initial osdmap 2024-05-12T10:49:41.844 INFO:tasks.ceph.osd.3.smithi115.stderr:2024-05-12T10:49:41.850+0000 7fe446e00640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T10:49:41.856 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-05-12T10:49:41.862+0000 7f633b600640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T10:49:41.938 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-12T10:49:41.941 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-05-12T10:49:41.946+0000 7f8d30689640 -1 osd.7 0 waiting for initial osdmap 2024-05-12T10:49:41.966 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-05-12T10:49:41.970+0000 7ff77e8f1640 -1 osd.6 0 waiting for initial osdmap 2024-05-12T10:49:41.972 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-05-12T10:49:41.978+0000 7f8d284bd640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T10:49:41.989 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-05-12T10:49:41.994+0000 7f453efd4640 -1 osd.5 0 waiting for initial osdmap 2024-05-12T10:49:41.994 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-05-12T10:49:42.002+0000 7ff776725640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T10:49:42.002 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-05-12T10:49:42.010+0000 7f9f270bf640 -1 osd.4 0 waiting for initial osdmap 2024-05-12T10:49:42.026 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-05-12T10:49:42.034+0000 7f45365f6640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T10:49:42.034 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-05-12T10:49:42.042+0000 7f9f1e6e1640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T10:49:42.090 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.094+0000 7f09a5e00640 1 Processor -- start 2024-05-12T10:49:42.091 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.094+0000 7f09a5e00640 1 -- start start 2024-05-12T10:49:42.092 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f09a5e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f09a00c4600 0x7f09a0071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:42.092 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f09a5e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09a00c9fe0 0x7f09a00c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:42.092 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f09a5e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a00725d0 con 0x7f09a0159b00 2024-05-12T10:49:42.092 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f09a5e00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f09a00728b0 con 0x7f09a00c9fe0 2024-05-12T10:49:42.092 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f09a5e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f09a00cb410 con 0x7f09a00c4600 2024-05-12T10:49:42.092 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f099e000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09a00c9fe0 0x7f09a00c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:42.092 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f099e000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09a00c9fe0 0x7f09a00c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56908/0 (socket says 172.21.15.115:56908) 2024-05-12T10:49:42.093 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f099e000640 1 -- 172.21.15.115:0/2951929641 learned_addr learned my addr 172.21.15.115:0/2951929641 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:42.093 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f099ea00640 1 --2- 172.21.15.115:0/2951929641 >> v2:172.21.15.134:3300/0 conn(0x7f09a00c4600 0x7f09a0071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:42.093 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f099e000640 1 -- 172.21.15.115:0/2951929641 >> v2:172.21.15.134:3300/0 conn(0x7f09a00c4600 msgr2=0x7f09a0071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:42.093 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f099e000640 1 --2- 172.21.15.115:0/2951929641 >> v2:172.21.15.134:3300/0 conn(0x7f09a00c4600 0x7f09a0071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:42.093 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f099e000640 1 -- 172.21.15.115:0/2951929641 >> v1:172.21.15.134:6789/0 conn(0x7f09a0159b00 legacy=0x7f09a0159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:42.094 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.098+0000 7f099e000640 1 -- 172.21.15.115:0/2951929641 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a00cb6f0 con 0x7f09a00c9fe0 2024-05-12T10:49:42.095 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f099e000640 1 --2- 172.21.15.115:0/2951929641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a00c9fe0 0x7f09a00c49e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f09a00d0680 tx=0x7f098c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bb576a11e3df20 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:42.096 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f099d600640 1 -- 172.21.15.115:0/2951929641 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c0b5070 con 0x7f09a00c9fe0 2024-05-12T10:49:42.096 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f099d600640 1 -- 172.21.15.115:0/2951929641 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f098c0a89d0 con 0x7f09a00c9fe0 2024-05-12T10:49:42.096 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f099d600640 1 -- 172.21.15.115:0/2951929641 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c0a8da0 con 0x7f09a00c9fe0 2024-05-12T10:49:42.097 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f09a5e00640 1 -- 172.21.15.115:0/2951929641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a00c9fe0 msgr2=0x7f09a00c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:42.097 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f09a5e00640 1 --2- 172.21.15.115:0/2951929641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a00c9fe0 0x7f09a00c49e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f09a00d0680 tx=0x7f098c01ed10 comp rx=0 tx=0).stop 2024-05-12T10:49:42.097 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f09a5e00640 1 -- 172.21.15.115:0/2951929641 shutdown_connections 2024-05-12T10:49:42.098 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f09a5e00640 1 --2- 172.21.15.115:0/2951929641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a00c9fe0 0x7f09a00c49e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:42.098 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f09a5e00640 1 --2- 172.21.15.115:0/2951929641 >> v2:172.21.15.134:3300/0 conn(0x7f09a00c4600 0x7f09a0071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:42.098 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f09a5e00640 1 -- 172.21.15.115:0/2951929641 >> 172.21.15.115:0/2951929641 conn(0x7f09a0075e10 msgr2=0x7f09a0070640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:42.098 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f09a5e00640 1 -- 172.21.15.115:0/2951929641 shutdown_connections 2024-05-12T10:49:42.098 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.102+0000 7f09a5e00640 1 -- 172.21.15.115:0/2951929641 wait complete. 2024-05-12T10:49:42.099 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f09a5e00640 1 Processor -- start 2024-05-12T10:49:42.099 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f09a5e00640 1 -- start start 2024-05-12T10:49:42.101 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f09a5e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a00c4600 0x7f09a01566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:42.101 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f09a5e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a00c9fe0 0x7f09a006ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:42.102 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f09a5e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a0159b00 0x7f09a014d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:42.102 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f09a5e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f09a00ca450 con 0x7f09a00c4600 2024-05-12T10:49:42.102 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f09a5e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09a00c4f20 con 0x7f09a0159b00 2024-05-12T10:49:42.102 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f09a5e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f09a00c66c0 con 0x7f09a00c9fe0 2024-05-12T10:49:42.102 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f099ea00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a00c4600 0x7f09a01566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:42.102 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f099ea00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a00c4600 0x7f09a01566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56922/0 (socket says 172.21.15.115:56922) 2024-05-12T10:49:42.102 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f099ea00640 1 -- 172.21.15.115:0/2567609866 learned_addr learned my addr 172.21.15.115:0/2567609866 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:42.102 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f099e000640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a00c9fe0 0x7f09a006ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:42.102 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f099f400640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a0159b00 0x7f09a014d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:42.103 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f099ea00640 1 -- 172.21.15.115:0/2567609866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a00c9fe0 msgr2=0x7f09a006ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:42.103 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f099ea00640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a00c9fe0 0x7f09a006ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:42.103 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f099ea00640 1 -- 172.21.15.115:0/2567609866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a0159b00 msgr2=0x7f09a014d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:42.103 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f099ea00640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a0159b00 0x7f09a014d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:42.103 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f099ea00640 1 -- 172.21.15.115:0/2567609866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a0156110 con 0x7f09a00c4600 2024-05-12T10:49:42.103 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f099ea00640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a00c4600 0x7f09a01566f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f099000e960 tx=0x7f099000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:42.103 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f0997400640 1 -- 172.21.15.115:0/2567609866 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990017070 con 0x7f09a00c4600 2024-05-12T10:49:42.103 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f0997400640 1 -- 172.21.15.115:0/2567609866 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f099000ca00 con 0x7f09a00c4600 2024-05-12T10:49:42.103 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f09a5e00640 1 -- 172.21.15.115:0/2567609866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a01555e0 con 0x7f09a00c4600 2024-05-12T10:49:42.103 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f0997400640 1 -- 172.21.15.115:0/2567609866 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099000cdb0 con 0x7f09a00c4600 2024-05-12T10:49:42.104 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f09a5e00640 1 -- 172.21.15.115:0/2567609866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a0157fc0 con 0x7f09a00c4600 2024-05-12T10:49:42.105 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.106+0000 7f09a5e00640 1 -- 172.21.15.115:0/2567609866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a0050750 con 0x7f09a00c4600 2024-05-12T10:49:42.105 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.110+0000 7f0997400640 1 -- 172.21.15.115:0/2567609866 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f099001a070 con 0x7f09a00c4600 2024-05-12T10:49:42.105 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.110+0000 7f0997400640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f098006f3a0 0x7f0980071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:42.105 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.110+0000 7f0997400640 1 -- 172.21.15.115:0/2567609866 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f099008e300 con 0x7f09a00c4600 2024-05-12T10:49:42.105 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.110+0000 7f099e000640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f098006f3a0 0x7f0980071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:42.105 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.110+0000 7f099e000640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f098006f3a0 0x7f0980071860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f098c0b2000 tx=0x7f098c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:42.110 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.114+0000 7f0997400640 1 -- 172.21.15.115:0/2567609866 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f099005baa0 con 0x7f09a00c4600 2024-05-12T10:49:42.156 INFO:tasks.ceph.osd.2.smithi115.stderr:2024-05-12T10:49:42.162+0000 7f817b400640 -1 osd.2 0 waiting for initial osdmap 2024-05-12T10:49:42.204 INFO:tasks.ceph.osd.2.smithi115.stderr:2024-05-12T10:49:42.210+0000 7f8171400640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T10:49:42.276 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.282+0000 7f09a5e00640 1 -- 172.21.15.115:0/2567609866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09a0156d20 con 0x7f09a00c4600 2024-05-12T10:49:42.277 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.282+0000 7f0997400640 1 -- 172.21.15.115:0/2567609866 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f099005fda0 con 0x7f09a00c4600 2024-05-12T10:49:42.277 INFO:teuthology.misc.health.smithi115.stdout: 2024-05-12T10:49:42.277 INFO:teuthology.misc.health.smithi115.stdout:{"epoch":13,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:49:40.768511+0000","last_up_change":"0.000000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:49:42.279 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 -- 172.21.15.115:0/2567609866 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f098006f3a0 msgr2=0x7f0980071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:42.279 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f098006f3a0 0x7f0980071860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f098c0b2000 tx=0x7f098c009040 comp rx=0 tx=0).stop 2024-05-12T10:49:42.280 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 -- 172.21.15.115:0/2567609866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a00c4600 msgr2=0x7f09a01566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:42.280 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a00c4600 0x7f09a01566f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f099000e960 tx=0x7f099000ee20 comp rx=0 tx=0).stop 2024-05-12T10:49:42.280 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 -- 172.21.15.115:0/2567609866 shutdown_connections 2024-05-12T10:49:42.280 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f098006f3a0 0x7f0980071860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:42.280 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a0159b00 0x7f09a014d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:42.280 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a00c9fe0 0x7f09a006ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:42.280 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 --2- 172.21.15.115:0/2567609866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a00c4600 0x7f09a01566f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:42.280 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 -- 172.21.15.115:0/2567609866 >> 172.21.15.115:0/2567609866 conn(0x7f09a0075e10 msgr2=0x7f09a0070640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:42.280 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 -- 172.21.15.115:0/2567609866 shutdown_connections 2024-05-12T10:49:42.280 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:42.286+0000 7f09a5e00640 1 -- 172.21.15.115:0/2567609866 wait complete. 2024-05-12T10:49:42.296 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-12T10:49:48.858 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:49:48.863 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:49:49.102 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-12T10:49:49.239 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.242+0000 7fd135400640 1 Processor -- start 2024-05-12T10:49:49.239 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.242+0000 7fd135400640 1 -- start start 2024-05-12T10:49:49.240 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd135400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd130070950 0x7fd130158a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.240 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd135400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1300c7c20 con 0x7fd130151fc0 2024-05-12T10:49:49.240 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd135400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1300c7ee0 con 0x7fd1300c9260 2024-05-12T10:49:49.240 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd135400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd1300724c0 con 0x7fd130070950 2024-05-12T10:49:49.241 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12e800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd130151fc0 0x7fd13006f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59508/0 (socket says 172.21.15.115:59508) 2024-05-12T10:49:49.241 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12e800640 1 -- 172.21.15.115:0/2888685985 learned_addr learned my addr 172.21.15.115:0/2888685985 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:49.241 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12f200640 1 --2- 172.21.15.115:0/2888685985 >> v2:172.21.15.134:3300/0 conn(0x7fd130070950 0x7fd130158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.241 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1806357572 0 0) 0x7fd1300c7c20 con 0x7fd130151fc0 2024-05-12T10:49:49.241 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd114003450 con 0x7fd130151fc0 2024-05-12T10:49:49.242 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 831196415 0 0) 0x7fd114003450 con 0x7fd130151fc0 2024-05-12T10:49:49.242 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 >> v2:172.21.15.134:3300/0 conn(0x7fd130070950 msgr2=0x7fd130158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 --2- 172.21.15.115:0/2888685985 >> v2:172.21.15.134:3300/0 conn(0x7fd130070950 0x7fd130158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 >> v1:172.21.15.134:6789/0 conn(0x7fd1300c9260 legacy=0x7fd130160950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1300c81c0 con 0x7fd130151fc0 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fd120001700 con 0x7fd130151fc0 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 >> v1:172.21.15.115:6789/0 conn(0x7fd130151fc0 legacy=0x7fd13006f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 --2- 172.21.15.115:0/2888685985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd114003b50 0x7fd114003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 --2- 172.21.15.115:0/2888685985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd114008900 0x7fd11400ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 --2- 172.21.15.115:0/2888685985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 0x7fd11400da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd11400e2d0 con 0x7fd11400b570 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd11400e480 con 0x7fd114003b50 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd11400e680 con 0x7fd114008900 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12f200640 1 --2- 172.21.15.115:0/2888685985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 0x7fd11400da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.243 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12e800640 1 --2- 172.21.15.115:0/2888685985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd114003b50 0x7fd114003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.244 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd125e00640 1 --2- 172.21.15.115:0/2888685985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd114008900 0x7fd11400ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.244 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12f200640 1 -- 172.21.15.115:0/2888685985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd114008900 msgr2=0x7fd11400ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:49.244 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12f200640 1 --2- 172.21.15.115:0/2888685985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd114008900 0x7fd11400ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.244 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12f200640 1 -- 172.21.15.115:0/2888685985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd114003b50 msgr2=0x7fd114003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:49.244 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12f200640 1 --2- 172.21.15.115:0/2888685985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd114003b50 0x7fd114003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.244 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.246+0000 7fd12f200640 1 -- 172.21.15.115:0/2888685985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd114003450 con 0x7fd11400b570 2024-05-12T10:49:49.245 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd12f200640 1 -- 172.21.15.115:0/2888685985 reap_dead start 2024-05-12T10:49:49.245 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd12f200640 1 --2- 172.21.15.115:0/2888685985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 0x7fd11400da30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd128009fc0 tx=0x7fd12801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bf0929f6ec8dd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:49.245 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128009c10 con 0x7fd11400b570 2024-05-12T10:49:49.245 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1280a5d10 con 0x7fd11400b570 2024-05-12T10:49:49.245 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd12de00640 1 -- 172.21.15.115:0/2888685985 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128003be0 con 0x7fd11400b570 2024-05-12T10:49:49.246 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd135400640 1 -- 172.21.15.115:0/2888685985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 msgr2=0x7fd11400da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.246 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd135400640 1 --2- 172.21.15.115:0/2888685985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 0x7fd11400da30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd128009fc0 tx=0x7fd12801ccc0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.246 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd135400640 1 -- 172.21.15.115:0/2888685985 shutdown_connections 2024-05-12T10:49:49.246 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd135400640 1 --2- 172.21.15.115:0/2888685985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 0x7fd11400da30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.246 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd135400640 1 -- 172.21.15.115:0/2888685985 >> 172.21.15.115:0/2888685985 conn(0x7fd13006c450 msgr2=0x7fd13006c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:49.246 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd135400640 1 -- 172.21.15.115:0/2888685985 shutdown_connections 2024-05-12T10:49:49.246 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.250+0000 7fd135400640 1 -- 172.21.15.115:0/2888685985 wait complete. 2024-05-12T10:49:49.247 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd135400640 1 Processor -- start 2024-05-12T10:49:49.247 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd135400640 1 -- start start 2024-05-12T10:49:49.249 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd135400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 0x7fd130146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.249 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd135400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd13015a530 0x7fd13015a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.249 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd135400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13014c700 0x7fd13014cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.249 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd135400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd1300c8a60 con 0x7fd11400b570 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd135400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd1300c8780 con 0x7fd13014c700 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd135400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd1300c8d40 con 0x7fd13015a530 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd12e800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 0x7fd130146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd12e800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 0x7fd130146e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41122/0 (socket says 172.21.15.115:41122) 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd12e800640 1 -- 172.21.15.115:0/2468287553 learned_addr learned my addr 172.21.15.115:0/2468287553 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd12f200640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13014c700 0x7fd13014cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd125e00640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd13015a530 0x7fd13015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd12e800640 1 -- 172.21.15.115:0/2468287553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd13015a530 msgr2=0x7fd13015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd12e800640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd13015a530 0x7fd13015a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd12e800640 1 -- 172.21.15.115:0/2468287553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13014c700 msgr2=0x7fd13014cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd12e800640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13014c700 0x7fd13014cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd12e800640 1 -- 172.21.15.115:0/2468287553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13015af90 con 0x7fd11400b570 2024-05-12T10:49:49.250 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd12e800640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 0x7fd130146e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd12000e7e0 tx=0x7fd12000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:49.251 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd127400640 1 -- 172.21.15.115:0/2468287553 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120019070 con 0x7fd11400b570 2024-05-12T10:49:49.251 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd127400640 1 -- 172.21.15.115:0/2468287553 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd12000ee90 con 0x7fd11400b570 2024-05-12T10:49:49.251 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd135400640 1 -- 172.21.15.115:0/2468287553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13014dd70 con 0x7fd11400b570 2024-05-12T10:49:49.251 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd127400640 1 -- 172.21.15.115:0/2468287553 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12000caf0 con 0x7fd11400b570 2024-05-12T10:49:49.251 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd135400640 1 -- 172.21.15.115:0/2468287553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd13014e330 con 0x7fd11400b570 2024-05-12T10:49:49.251 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.254+0000 7fd135400640 1 -- 172.21.15.115:0/2468287553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd130050750 con 0x7fd11400b570 2024-05-12T10:49:49.251 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.258+0000 7fd127400640 1 -- 172.21.15.115:0/2468287553 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd12001c070 con 0x7fd11400b570 2024-05-12T10:49:49.252 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.258+0000 7fd127400640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd10c06f430 0x7fd10c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.252 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.258+0000 7fd127400640 1 -- 172.21.15.115:0/2468287553 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd12008e630 con 0x7fd11400b570 2024-05-12T10:49:49.252 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.258+0000 7fd125e00640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd10c06f430 0x7fd10c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.253 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.258+0000 7fd125e00640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd10c06f430 0x7fd10c0718f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1301e7120 tx=0x7fd118009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:49.257 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.262+0000 7fd127400640 1 -- 172.21.15.115:0/2468287553 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd12005b860 con 0x7fd11400b570 2024-05-12T10:49:49.415 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.418+0000 7fd135400640 1 -- 172.21.15.115:0/2468287553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd130073af0 con 0x7fd11400b570 2024-05-12T10:49:49.416 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd127400640 1 -- 172.21.15.115:0/2468287553 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12920 (secure 0 0 0) 0x7fd12005b160 con 0x7fd11400b570 2024-05-12T10:49:49.416 INFO:teuthology.misc.health.smithi115.stdout: 2024-05-12T10:49:49.416 INFO:teuthology.misc.health.smithi115.stdout:{"epoch":17,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:49:45.972555+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:49:49.418 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 -- 172.21.15.115:0/2468287553 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd10c06f430 msgr2=0x7fd10c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.419 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd10c06f430 0x7fd10c0718f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1301e7120 tx=0x7fd118009040 comp rx=0 tx=0).stop 2024-05-12T10:49:49.419 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 -- 172.21.15.115:0/2468287553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 msgr2=0x7fd130146e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.419 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 0x7fd130146e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd12000e7e0 tx=0x7fd12000eca0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.419 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 -- 172.21.15.115:0/2468287553 shutdown_connections 2024-05-12T10:49:49.419 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd10c06f430 0x7fd10c0718f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.419 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13014c700 0x7fd13014cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.419 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd13015a530 0x7fd13015a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.419 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 --2- 172.21.15.115:0/2468287553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11400b570 0x7fd130146e80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.419 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 -- 172.21.15.115:0/2468287553 >> 172.21.15.115:0/2468287553 conn(0x7fd13006c450 msgr2=0x7fd1300c6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:49.419 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 -- 172.21.15.115:0/2468287553 shutdown_connections 2024-05-12T10:49:49.419 INFO:teuthology.misc.health.smithi115.stderr:2024-05-12T10:49:49.422+0000 7fd135400640 1 -- 172.21.15.115:0/2468287553 wait complete. 2024-05-12T10:49:49.435 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-12T10:49:49.436 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-12T10:49:49.436 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-12T10:49:49.436 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-12T10:49:49.439 INFO:tasks.ceph.mds.a:Started 2024-05-12T10:49:49.439 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-12T10:49:49.440 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-12T10:49:49.442 INFO:tasks.ceph.mds.c:Started 2024-05-12T10:49:49.442 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-12T10:49:49.443 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-05-12T10:49:49.445 INFO:tasks.ceph.mds.e:Started 2024-05-12T10:49:49.446 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-12T10:49:49.446 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-12T10:49:49.448 INFO:tasks.ceph.mds.b:Started 2024-05-12T10:49:49.448 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-12T10:49:49.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-12T10:49:49.450 INFO:tasks.ceph.mds.d:Started 2024-05-12T10:49:49.451 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-12T10:49:49.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-05-12T10:49:49.453 INFO:tasks.ceph.mds.f:Started 2024-05-12T10:49:49.453 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-12T10:49:49.454 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:49:49.541 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2024-05-12T10:49:49.541 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2024-05-12T10:49:49.541 INFO:tasks.ceph.mds.e.smithi115.stdout:starting mds.e at 2024-05-12T10:49:49.546 INFO:tasks.ceph.mds.f.smithi134.stdout:starting mds.f at 2024-05-12T10:49:49.548 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-05-12T10:49:49.549 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-05-12T10:49:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ea00640 1 Processor -- start 2024-05-12T10:49:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ea00640 1 -- start start 2024-05-12T10:49:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ea00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7028153c50 0x7f70280c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ea00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f702806cbd0 0x7f702815d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ea00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70280c94c0 con 0x7f7028154030 2024-05-12T10:49:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ea00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f7028070e40 con 0x7f702806cbd0 2024-05-12T10:49:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ea00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7028071120 con 0x7f7028153c50 2024-05-12T10:49:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ca00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f702806cbd0 0x7f702815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f701f400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7028154030 0x7f70280c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59528/0 (socket says 172.21.15.115:59528) 2024-05-12T10:49:49.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f701f400640 1 -- 172.21.15.115:0/1243816105 learned_addr learned my addr 172.21.15.115:0/1243816105 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:49.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f7027e00640 1 --2- 172.21.15.115:0/1243816105 >> v2:172.21.15.134:3300/0 conn(0x7f7028153c50 0x7f70280c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ca00640 1 -- 172.21.15.115:0/1243816105 >> v2:172.21.15.134:3300/0 conn(0x7f7028153c50 msgr2=0x7f70280c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:49.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f7027400640 1 -- 172.21.15.115:0/1243816105 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716193218 0 0) 0x7f70280c94c0 con 0x7f7028154030 2024-05-12T10:49:49.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ca00640 1 --2- 172.21.15.115:0/1243816105 >> v2:172.21.15.134:3300/0 conn(0x7f7028153c50 0x7f70280c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ca00640 1 -- 172.21.15.115:0/1243816105 >> v1:172.21.15.115:6789/0 conn(0x7f7028154030 legacy=0x7f70280c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.606+0000 7f702ca00640 1 -- 172.21.15.115:0/1243816105 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7028071400 con 0x7f702806cbd0 2024-05-12T10:49:49.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f702ca00640 1 --2- 172.21.15.115:0/1243816105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702806cbd0 0x7f702815d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7028068ea0 tx=0x7f702001f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335b1628f4ac1ad4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:49.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f7027400640 1 -- 172.21.15.115:0/1243816105 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70200b4070 con 0x7f702806cbd0 2024-05-12T10:49:49.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f7027400640 1 -- 172.21.15.115:0/1243816105 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70200af600 con 0x7f702806cbd0 2024-05-12T10:49:49.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f7027400640 1 -- 172.21.15.115:0/1243816105 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70200af9d0 con 0x7f702806cbd0 2024-05-12T10:49:49.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f702ea00640 1 -- 172.21.15.115:0/1243816105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702806cbd0 msgr2=0x7f702815d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f702ea00640 1 --2- 172.21.15.115:0/1243816105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702806cbd0 0x7f702815d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7028068ea0 tx=0x7f702001f110 comp rx=0 tx=0).stop 2024-05-12T10:49:49.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f702ea00640 1 -- 172.21.15.115:0/1243816105 shutdown_connections 2024-05-12T10:49:49.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f702ea00640 1 --2- 172.21.15.115:0/1243816105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702806cbd0 0x7f702815d440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f702ea00640 1 --2- 172.21.15.115:0/1243816105 >> v2:172.21.15.134:3300/0 conn(0x7f7028153c50 0x7f70280c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f702ea00640 1 -- 172.21.15.115:0/1243816105 >> 172.21.15.115:0/1243816105 conn(0x7f7028076890 msgr2=0x7f70280681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:49.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f702ea00640 1 -- 172.21.15.115:0/1243816105 shutdown_connections 2024-05-12T10:49:49.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.610+0000 7f702ea00640 1 -- 172.21.15.115:0/1243816105 wait complete. 2024-05-12T10:49:49.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f702ea00640 1 Processor -- start 2024-05-12T10:49:49.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f702ea00640 1 -- start start 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f702ea00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702806cbd0 0x7f70281f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f702ea00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7028153c50 0x7f7028152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f702ea00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7028154030 0x7f70281f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f702ea00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f70280c82c0 con 0x7f702806cbd0 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f702ea00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7028074930 con 0x7f7028154030 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f702ea00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f70280c8440 con 0x7f7028153c50 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7027e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702806cbd0 0x7f70281f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7027e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702806cbd0 0x7f70281f55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41178/0 (socket says 172.21.15.115:41178) 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7027e00640 1 -- 172.21.15.115:0/507373829 learned_addr learned my addr 172.21.15.115:0/507373829 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f701f400640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7028153c50 0x7f7028152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f702ca00640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7028154030 0x7f70281f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7027e00640 1 -- 172.21.15.115:0/507373829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7028153c50 msgr2=0x7f7028152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7027e00640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7028153c50 0x7f7028152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7027e00640 1 -- 172.21.15.115:0/507373829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7028154030 msgr2=0x7f70281f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7027e00640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7028154030 0x7f70281f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7027e00640 1 -- 172.21.15.115:0/507373829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702814bc00 con 0x7f702806cbd0 2024-05-12T10:49:49.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7027e00640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702806cbd0 0x7f70281f55b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f701800e960 tx=0x7f701800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:49.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7024c00640 1 -- 172.21.15.115:0/507373829 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018017070 con 0x7f702806cbd0 2024-05-12T10:49:49.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7024c00640 1 -- 172.21.15.115:0/507373829 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701800ca00 con 0x7f702806cbd0 2024-05-12T10:49:49.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f7024c00640 1 -- 172.21.15.115:0/507373829 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701800cdb0 con 0x7f702806cbd0 2024-05-12T10:49:49.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f702ea00640 1 -- 172.21.15.115:0/507373829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702814bee0 con 0x7f702806cbd0 2024-05-12T10:49:49.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.614+0000 7f702ea00640 1 -- 172.21.15.115:0/507373829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702814c4a0 con 0x7f702806cbd0 2024-05-12T10:49:49.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.618+0000 7f702ea00640 1 -- 172.21.15.115:0/507373829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7028069730 con 0x7f702806cbd0 2024-05-12T10:49:49.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.618+0000 7f7024c00640 1 -- 172.21.15.115:0/507373829 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f701801a070 con 0x7f702806cbd0 2024-05-12T10:49:49.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.618+0000 7f7024c00640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700406f430 0x7f70040718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:49.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.618+0000 7f7024c00640 1 -- 172.21.15.115:0/507373829 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f701808f200 con 0x7f702806cbd0 2024-05-12T10:49:49.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.618+0000 7f701f400640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700406f430 0x7f70040718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:49.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.618+0000 7f701f400640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700406f430 0x7f70040718f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7028152300 tx=0x7f7010007df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:49.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.622+0000 7f7024c00640 1 -- 172.21.15.115:0/507373829 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f701805be70 con 0x7f702806cbd0 2024-05-12T10:49:49.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.814+0000 7f702ea00640 1 -- 172.21.15.115:0/507373829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7028151d00 con 0x7f702806cbd0 2024-05-12T10:49:49.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.814+0000 7f7024c00640 1 -- 172.21.15.115:0/507373829 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f7018060170 con 0x7f702806cbd0 2024-05-12T10:49:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:49:49.810 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-12T10:49:49.810 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 2 2024-05-12T10:49:49.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 -- 172.21.15.115:0/507373829 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700406f430 msgr2=0x7f70040718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700406f430 0x7f70040718f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7028152300 tx=0x7f7010007df0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 -- 172.21.15.115:0/507373829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702806cbd0 msgr2=0x7f70281f55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:49.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702806cbd0 0x7f70281f55b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f701800e960 tx=0x7f701800ee20 comp rx=0 tx=0).stop 2024-05-12T10:49:49.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 -- 172.21.15.115:0/507373829 shutdown_connections 2024-05-12T10:49:49.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700406f430 0x7f70040718f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7028154030 0x7f70281f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7028153c50 0x7f7028152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 --2- 172.21.15.115:0/507373829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702806cbd0 0x7f70281f55b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:49.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 -- 172.21.15.115:0/507373829 >> 172.21.15.115:0/507373829 conn(0x7f7028076890 msgr2=0x7f70280ce430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:49.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 -- 172.21.15.115:0/507373829 shutdown_connections 2024-05-12T10:49:49.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:49.818+0000 7f702ea00640 1 -- 172.21.15.115:0/507373829 wait complete. 2024-05-12T10:49:51.831 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:49:51.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca7200640 1 Processor -- start 2024-05-12T10:49:51.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca7200640 1 -- start start 2024-05-12T10:49:51.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca7200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8153f60 0x7faca80c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:51.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca7200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca815da10 con 0x7faca8153b80 2024-05-12T10:49:51.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca7200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca815dcf0 con 0x7faca80ca660 2024-05-12T10:49:51.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca7200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7faca80b2160 con 0x7faca8153f60 2024-05-12T10:49:51.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca5e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7faca8153b80 0x7faca8071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59542/0 (socket says 172.21.15.115:59542) 2024-05-12T10:49:51.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca5e00640 1 -- 172.21.15.115:0/590627436 learned_addr learned my addr 172.21.15.115:0/590627436 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:51.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca5400640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8153f60 0x7faca80c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:51.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 227558415 0 0) 0x7faca815da10 con 0x7faca8153b80 2024-05-12T10:49:51.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac8c003530 con 0x7faca8153b80 2024-05-12T10:49:51.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1850460621 0 0) 0x7fac8c003530 con 0x7faca8153b80 2024-05-12T10:49:51.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8153f60 msgr2=0x7faca80c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:51.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8153f60 0x7faca80c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:51.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 >> v1:172.21.15.134:6789/0 conn(0x7faca80ca660 legacy=0x7faca8159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:51.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca80c4760 con 0x7faca8153b80 2024-05-12T10:49:51.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fac98001700 con 0x7faca8153b80 2024-05-12T10:49:51.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 >> v1:172.21.15.115:6789/0 conn(0x7faca8153b80 legacy=0x7faca8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:51.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8153f60 0x7fac8c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:51.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 0x7fac8c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:51.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac8c004d50 0x7fac8c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:51.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faca80b2160 con 0x7fac8c003f80 2024-05-12T10:49:51.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c00bae0 con 0x7fac8c004d50 2024-05-12T10:49:51.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fac8c00bce0 con 0x7faca8153f60 2024-05-12T10:49:51.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca5400640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 0x7fac8c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:51.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca5e00640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8153f60 0x7fac8c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:51.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca6800640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac8c004d50 0x7fac8c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:51.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca5400640 1 -- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8153f60 msgr2=0x7fac8c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:51.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca5400640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8153f60 0x7fac8c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:51.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca5400640 1 -- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac8c004d50 msgr2=0x7fac8c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:51.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca5400640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac8c004d50 0x7fac8c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:51.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca5400640 1 -- 172.21.15.115:0/590627436 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c003530 con 0x7fac8c003f80 2024-05-12T10:49:51.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.986+0000 7faca6800640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac8c004d50 0x7fac8c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:49:51.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.990+0000 7faca5400640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 0x7fac8c004810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac94009ab0 tx=0x7fac9401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da348e5af80d279e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:51.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.990+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac940b2070 con 0x7fac8c003f80 2024-05-12T10:49:51.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.990+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac940a5640 con 0x7fac8c003f80 2024-05-12T10:49:51.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.990+0000 7faca4a00640 1 -- 172.21.15.115:0/590627436 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac940096b0 con 0x7fac8c003f80 2024-05-12T10:49:51.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.990+0000 7faca7200640 1 -- 172.21.15.115:0/590627436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 msgr2=0x7fac8c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:51.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.990+0000 7faca7200640 1 --2- 172.21.15.115:0/590627436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 0x7fac8c004810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac94009ab0 tx=0x7fac9401ca50 comp rx=0 tx=0).stop 2024-05-12T10:49:51.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.990+0000 7faca6800640 1 -- 172.21.15.115:0/590627436 reap_dead start 2024-05-12T10:49:51.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.990+0000 7faca7200640 1 -- 172.21.15.115:0/590627436 shutdown_connections 2024-05-12T10:49:51.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.990+0000 7faca7200640 1 -- 172.21.15.115:0/590627436 >> 172.21.15.115:0/590627436 conn(0x7faca8071780 msgr2=0x7faca8076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:51.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.990+0000 7faca7200640 1 -- 172.21.15.115:0/590627436 shutdown_connections 2024-05-12T10:49:51.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.990+0000 7faca7200640 1 -- 172.21.15.115:0/590627436 wait complete. 2024-05-12T10:49:51.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca7200640 1 Processor -- start 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca7200640 1 -- start start 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca7200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 0x7faca81f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca7200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca815ab50 0x7faca80b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca7200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8158e30 0x7faca81592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca7200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faca8072530 con 0x7fac8c003f80 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca7200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faca80c4510 con 0x7faca815ab50 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca7200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7faca80726b0 con 0x7faca8158e30 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca5e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 0x7faca81f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca5e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 0x7faca81f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41186/0 (socket says 172.21.15.115:41186) 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca5e00640 1 -- 172.21.15.115:0/3740758758 learned_addr learned my addr 172.21.15.115:0/3740758758 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca5e00640 1 -- 172.21.15.115:0/3740758758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8158e30 msgr2=0x7faca81592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca5e00640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8158e30 0x7faca81592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca5e00640 1 -- 172.21.15.115:0/3740758758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca815ab50 msgr2=0x7faca80b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca5400640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca815ab50 0x7faca80b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca5e00640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca815ab50 0x7faca80b36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca5e00640 1 -- 172.21.15.115:0/3740758758 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca81597f0 con 0x7fac8c003f80 2024-05-12T10:49:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca5e00640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 0x7faca81f1520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac98012490 tx=0x7fac98012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7fac9e000640 1 -- 172.21.15.115:0/3740758758 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9801c070 con 0x7fac8c003f80 2024-05-12T10:49:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7fac9e000640 1 -- 172.21.15.115:0/3740758758 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac98014770 con 0x7fac8c003f80 2024-05-12T10:49:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7fac9e000640 1 -- 172.21.15.115:0/3740758758 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98014b60 con 0x7fac8c003f80 2024-05-12T10:49:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca7200640 1 -- 172.21.15.115:0/3740758758 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca8157a90 con 0x7fac8c003f80 2024-05-12T10:49:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca7200640 1 -- 172.21.15.115:0/3740758758 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca8158030 con 0x7fac8c003f80 2024-05-12T10:49:51.993 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.994+0000 7faca7200640 1 -- 172.21.15.115:0/3740758758 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca8158a70 con 0x7fac8c003f80 2024-05-12T10:49:51.993 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.998+0000 7fac9e000640 1 -- 172.21.15.115:0/3740758758 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fac98014d00 con 0x7fac8c003f80 2024-05-12T10:49:51.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.998+0000 7fac9e000640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fac8806f430 0x7fac880718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:51.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.998+0000 7fac9e000640 1 -- 172.21.15.115:0/3740758758 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fac98091d30 con 0x7fac8c003f80 2024-05-12T10:49:51.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.998+0000 7faca5400640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fac8806f430 0x7fac880718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:51.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:51.998+0000 7faca5400640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fac8806f430 0x7fac880718f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac940af000 tx=0x7fac940046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:51.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.002+0000 7fac9e000640 1 -- 172.21.15.115:0/3740758758 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7faca81597f0 con 0x7fac8c003f80 2024-05-12T10:49:52.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.190+0000 7faca7200640 1 -- 172.21.15.115:0/3740758758 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faca8050750 con 0x7fac8c003f80 2024-05-12T10:49:52.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.190+0000 7fac9e000640 1 -- 172.21.15.115:0/3740758758 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5530 (secure 0 0 0) 0x7fac9805f010 con 0x7fac8c003f80 2024-05-12T10:49:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:49:52.186 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-12T10:49:52.187 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 3 2024-05-12T10:49:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 -- 172.21.15.115:0/3740758758 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fac8806f430 msgr2=0x7fac880718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fac8806f430 0x7fac880718f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac940af000 tx=0x7fac940046d0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 -- 172.21.15.115:0/3740758758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 msgr2=0x7faca81f1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 0x7faca81f1520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac98012490 tx=0x7fac98012950 comp rx=0 tx=0).stop 2024-05-12T10:49:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 -- 172.21.15.115:0/3740758758 shutdown_connections 2024-05-12T10:49:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fac8806f430 0x7fac880718f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faca8158e30 0x7faca81592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faca815ab50 0x7faca80b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 --2- 172.21.15.115:0/3740758758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac8c003f80 0x7faca81f1520 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 -- 172.21.15.115:0/3740758758 >> 172.21.15.115:0/3740758758 conn(0x7faca8071780 msgr2=0x7faca80cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:52.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 -- 172.21.15.115:0/3740758758 shutdown_connections 2024-05-12T10:49:52.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.194+0000 7faca7200640 1 -- 172.21.15.115:0/3740758758 wait complete. 2024-05-12T10:49:52.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-12T10:49:52.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f7252400640 1 Processor -- start 2024-05-12T10:49:52.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f7252400640 1 -- start start 2024-05-12T10:49:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f7252400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c0c7680 0x7f724c0c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f7252400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f724c0c5cd0 0x7f724c0cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f7252400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f724c0c9400 con 0x7f724c153940 2024-05-12T10:49:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f7252400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f724c0c6140 con 0x7f724c0c5cd0 2024-05-12T10:49:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f7252400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f724c0c8440 con 0x7f724c0c7680 2024-05-12T10:49:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724b400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f724c153940 0x7f724c15a1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42506/0 (socket says 172.21.15.115:42506) 2024-05-12T10:49:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724b400640 1 -- 172.21.15.115:0/963506298 learned_addr learned my addr 172.21.15.115:0/963506298 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:52.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724be00640 1 --2- 172.21.15.115:0/963506298 >> v2:172.21.15.134:3300/0 conn(0x7f724c0c5cd0 0x7f724c0cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f7242a00640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c0c7680 0x7f724c0c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1012240054 0 0) 0x7f723c001120 con 0x7f724c153940 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7230003530 con 0x7f724c153940 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1153639977 0 0) 0x7f7230003530 con 0x7f724c153940 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c0c7680 msgr2=0x7f724c0c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724aa00640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c0c7680 0x7f724c0c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 >> v2:172.21.15.134:3300/0 conn(0x7f724c0c5cd0 msgr2=0x7f724c0cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724aa00640 1 --2- 172.21.15.115:0/963506298 >> v2:172.21.15.134:3300/0 conn(0x7f724c0c5cd0 0x7f724c0cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c0c49c0 con 0x7f724c153940 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f723c0018d0 con 0x7f724c153940 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.350+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 >> v1:172.21.15.115:6789/0 conn(0x7f724c153940 legacy=0x7f724c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f724aa00640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7230003a10 0x7f7230003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f724aa00640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7230004810 0x7f7230004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f724aa00640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c0c7680 0x7f72300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f724c0c6140 con 0x7f7230004810 2024-05-12T10:49:52.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f724c0c8440 con 0x7f7230003a10 2024-05-12T10:49:52.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f723000bab0 con 0x7f724c0c7680 2024-05-12T10:49:52.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f7242a00640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7230004810 0x7f7230004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f724b400640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7230003a10 0x7f7230003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f724be00640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c0c7680 0x7f72300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f7242a00640 1 -- 172.21.15.115:0/963506298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c0c7680 msgr2=0x7f72300051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:52.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f7242a00640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c0c7680 0x7f72300051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f7242a00640 1 -- 172.21.15.115:0/963506298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7230003a10 msgr2=0x7f7230003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:52.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f7242a00640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7230003a10 0x7f7230003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f7242a00640 1 -- 172.21.15.115:0/963506298 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7230003530 con 0x7f7230004810 2024-05-12T10:49:52.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f7242a00640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7230004810 0x7f7230004c90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7234009ac0 tx=0x7f723401cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251ff23b1430df6f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:52.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72340b2070 con 0x7f7230004810 2024-05-12T10:49:52.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72340a55f0 con 0x7f7230004810 2024-05-12T10:49:52.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.354+0000 7f724aa00640 1 -- 172.21.15.115:0/963506298 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234009690 con 0x7f7230004810 2024-05-12T10:49:52.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 -- 172.21.15.115:0/963506298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7230004810 msgr2=0x7f7230004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 --2- 172.21.15.115:0/963506298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7230004810 0x7f7230004c90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7234009ac0 tx=0x7f723401cae0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f724be00640 1 -- 172.21.15.115:0/963506298 reap_dead start 2024-05-12T10:49:52.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 -- 172.21.15.115:0/963506298 shutdown_connections 2024-05-12T10:49:52.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 -- 172.21.15.115:0/963506298 >> 172.21.15.115:0/963506298 conn(0x7f724c0681c0 msgr2=0x7f724c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:52.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 -- 172.21.15.115:0/963506298 shutdown_connections 2024-05-12T10:49:52.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 -- 172.21.15.115:0/963506298 wait complete. 2024-05-12T10:49:52.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 Processor -- start 2024-05-12T10:49:52.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 -- start start 2024-05-12T10:49:52.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7230004810 0x7f724c148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f724c149250 0x7f724c146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c147460 0x7f724c1f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f724c0c4f00 con 0x7f724c149250 2024-05-12T10:49:52.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f724c0c4c60 con 0x7f7230004810 2024-05-12T10:49:52.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7252400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f724c159cb0 con 0x7f724c147460 2024-05-12T10:49:52.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7242a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f724c149250 0x7f724c146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7242a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f724c149250 0x7f724c146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60256/0 (socket says 172.21.15.115:60256) 2024-05-12T10:49:52.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7242a00640 1 -- 172.21.15.115:0/2632864467 learned_addr learned my addr 172.21.15.115:0/2632864467 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:52.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f724be00640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c147460 0x7f724c1f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f724b400640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7230004810 0x7f724c148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7242a00640 1 -- 172.21.15.115:0/2632864467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c147460 msgr2=0x7f724c1f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7242a00640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c147460 0x7f724c1f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7242a00640 1 -- 172.21.15.115:0/2632864467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7230004810 msgr2=0x7f724c148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7242a00640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7230004810 0x7f724c148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f7242a00640 1 -- 172.21.15.115:0/2632864467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c15be70 con 0x7f724c149250 2024-05-12T10:49:52.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.358+0000 7f724b400640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7230004810 0x7f724c148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:49:52.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.362+0000 7f7242a00640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f724c149250 0x7f724c146f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7234009ac0 tx=0x7f7230005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:52.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.362+0000 7f7243e00640 1 -- 172.21.15.115:0/2632864467 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72340b2040 con 0x7f724c149250 2024-05-12T10:49:52.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.362+0000 7f7243e00640 1 -- 172.21.15.115:0/2632864467 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72340b7660 con 0x7f724c149250 2024-05-12T10:49:52.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.362+0000 7f7243e00640 1 -- 172.21.15.115:0/2632864467 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72340b7a50 con 0x7f724c149250 2024-05-12T10:49:52.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.362+0000 7f7252400640 1 -- 172.21.15.115:0/2632864467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724c14dfc0 con 0x7f724c149250 2024-05-12T10:49:52.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.362+0000 7f7252400640 1 -- 172.21.15.115:0/2632864467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724c147f50 con 0x7f724c149250 2024-05-12T10:49:52.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.362+0000 7f7252400640 1 -- 172.21.15.115:0/2632864467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f724c069730 con 0x7f724c149250 2024-05-12T10:49:52.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.362+0000 7f7243e00640 1 -- 172.21.15.115:0/2632864467 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f72340c1060 con 0x7f724c149250 2024-05-12T10:49:52.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.362+0000 7f7243e00640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f722806f400 0x7f72280718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.362+0000 7f7243e00640 1 -- 172.21.15.115:0/2632864467 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f72341288e0 con 0x7f724c149250 2024-05-12T10:49:52.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.362+0000 7f724b400640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f722806f400 0x7f72280718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.366+0000 7f724b400640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f722806f400 0x7f72280718c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f723c007fd0 tx=0x7f723c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:52.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.366+0000 7f7243e00640 1 -- 172.21.15.115:0/2632864467 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7234016760 con 0x7f724c149250 2024-05-12T10:49:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7252400640 1 -- 172.21.15.115:0/2632864467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f724c0c88d0 con 0x7f724c149250 2024-05-12T10:49:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7243e00640 1 -- 172.21.15.115:0/2632864467 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f72340f5ba0 con 0x7f724c149250 2024-05-12T10:49:52.523 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:49:52.523 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2024-05-12T10:49:52.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-12T10:49:52.523 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2024-05-12T10:49:52.523 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": ".mgr" 2024-05-12T10:49:52.523 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:49:52.523 INFO:teuthology.orchestra.run.smithi115.stdout:] 2024-05-12T10:49:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7252400640 1 -- 172.21.15.115:0/2632864467 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f722806f400 msgr2=0x7f72280718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7252400640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f722806f400 0x7f72280718c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f723c007fd0 tx=0x7f723c009040 comp rx=0 tx=0).stop 2024-05-12T10:49:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7252400640 1 -- 172.21.15.115:0/2632864467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f724c149250 msgr2=0x7f724c146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7252400640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f724c149250 0x7f724c146f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7234009ac0 tx=0x7f7230005840 comp rx=0 tx=0).stop 2024-05-12T10:49:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7252400640 1 -- 172.21.15.115:0/2632864467 shutdown_connections 2024-05-12T10:49:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7252400640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f722806f400 0x7f72280718c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7252400640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f724c147460 0x7f724c1f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7252400640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f724c149250 0x7f724c146f20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7252400640 1 --2- 172.21.15.115:0/2632864467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7230004810 0x7f724c148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.526+0000 7f7252400640 1 -- 172.21.15.115:0/2632864467 >> 172.21.15.115:0/2632864467 conn(0x7f724c0681c0 msgr2=0x7f724c152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:52.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.530+0000 7f7252400640 1 -- 172.21.15.115:0/2632864467 shutdown_connections 2024-05-12T10:49:52.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.530+0000 7f7252400640 1 -- 172.21.15.115:0/2632864467 wait complete. 2024-05-12T10:49:52.542 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-12T10:49:52.542 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-12T10:49:52.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.686+0000 7f8283200640 1 Processor -- start 2024-05-12T10:49:52.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8283200640 1 -- start start 2024-05-12T10:49:52.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8283200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f82840cc0d0 0x7f82840cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8283200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f82840cba00 0x7f82840700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8283200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8284160040 con 0x7f82840cc4b0 2024-05-12T10:49:52.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8283200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f828415fd60 con 0x7f82840cc0d0 2024-05-12T10:49:52.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8283200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f828415bc60 con 0x7f82840cba00 2024-05-12T10:49:52.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8282800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f82840cc4b0 0x7f8284155830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42510/0 (socket says 172.21.15.115:42510) 2024-05-12T10:49:52.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8282800640 1 -- 172.21.15.115:0/864098330 learned_addr learned my addr 172.21.15.115:0/864098330 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:52.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8281e00640 1 --2- 172.21.15.115:0/864098330 >> v2:172.21.15.115:3300/0 conn(0x7f82840cc0d0 0x7f82840cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8279400640 1 --2- 172.21.15.115:0/864098330 >> v2:172.21.15.134:3300/0 conn(0x7f82840cba00 0x7f82840700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8281e00640 1 -- 172.21.15.115:0/864098330 >> v2:172.21.15.134:3300/0 conn(0x7f82840cba00 msgr2=0x7f82840700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:52.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8281e00640 1 --2- 172.21.15.115:0/864098330 >> v2:172.21.15.134:3300/0 conn(0x7f82840cba00 0x7f82840700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8281e00640 1 -- 172.21.15.115:0/864098330 >> v1:172.21.15.115:6789/0 conn(0x7f82840cc4b0 legacy=0x7f8284155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8281e00640 1 -- 172.21.15.115:0/864098330 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828415bf40 con 0x7f82840cc0d0 2024-05-12T10:49:52.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.690+0000 7f8281400640 1 -- 172.21.15.115:0/864098330 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134377627 0 0) 0x7f8284160040 con 0x7f82840cc4b0 2024-05-12T10:49:52.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8281e00640 1 --2- 172.21.15.115:0/864098330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82840cc0d0 0x7f82840cb100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f828406f890 tx=0x7f827401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9618a2b6fe651367 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:52.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8281400640 1 -- 172.21.15.115:0/864098330 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82740b5070 con 0x7f82840cc0d0 2024-05-12T10:49:52.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8281400640 1 -- 172.21.15.115:0/864098330 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82740a8970 con 0x7f82840cc0d0 2024-05-12T10:49:52.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8281400640 1 -- 172.21.15.115:0/864098330 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82740a8d40 con 0x7f82840cc0d0 2024-05-12T10:49:52.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8283200640 1 -- 172.21.15.115:0/864098330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82840cc0d0 msgr2=0x7f82840cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8283200640 1 --2- 172.21.15.115:0/864098330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82840cc0d0 0x7f82840cb100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f828406f890 tx=0x7f827401ec70 comp rx=0 tx=0).stop 2024-05-12T10:49:52.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8283200640 1 -- 172.21.15.115:0/864098330 shutdown_connections 2024-05-12T10:49:52.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8283200640 1 --2- 172.21.15.115:0/864098330 >> v2:172.21.15.134:3300/0 conn(0x7f82840cba00 0x7f82840700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8283200640 1 --2- 172.21.15.115:0/864098330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82840cc0d0 0x7f82840cb100 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8283200640 1 -- 172.21.15.115:0/864098330 >> 172.21.15.115:0/864098330 conn(0x7f8284071f60 msgr2=0x7f8284072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:52.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8283200640 1 -- 172.21.15.115:0/864098330 shutdown_connections 2024-05-12T10:49:52.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8283200640 1 -- 172.21.15.115:0/864098330 wait complete. 2024-05-12T10:49:52.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8283200640 1 Processor -- start 2024-05-12T10:49:52.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.694+0000 7f8283200640 1 -- start start 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8283200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82840cc0d0 0x7f82841f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8283200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82840cc4b0 0x7f82840b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8283200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82840b43a0 0x7f82840b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8283200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f828415ca20 con 0x7f82840cc4b0 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8283200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f828415c500 con 0x7f82840cc0d0 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8283200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8284070630 con 0x7f82840b43a0 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8279400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82840cc4b0 0x7f82840b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8279400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82840cc4b0 0x7f82840b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60278/0 (socket says 172.21.15.115:60278) 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8279400640 1 -- 172.21.15.115:0/3155438679 learned_addr learned my addr 172.21.15.115:0/3155438679 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8281e00640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82840cc0d0 0x7f82841f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8282800640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82840b43a0 0x7f82840b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8279400640 1 -- 172.21.15.115:0/3155438679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82840b43a0 msgr2=0x7f82840b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8279400640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82840b43a0 0x7f82840b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8279400640 1 -- 172.21.15.115:0/3155438679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82840cc0d0 msgr2=0x7f82841f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:52.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8279400640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82840cc0d0 0x7f82841f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:52.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8279400640 1 -- 172.21.15.115:0/3155438679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82841f22d0 con 0x7f82840cc4b0 2024-05-12T10:49:52.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8282800640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82840b43a0 0x7f82840b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:49:52.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8279400640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82840cc4b0 0x7f82840b4d20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f826c00d800 tx=0x7f826c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:52.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f827aa00640 1 -- 172.21.15.115:0/3155438679 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c0059a0 con 0x7f82840cc4b0 2024-05-12T10:49:52.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f827aa00640 1 -- 172.21.15.115:0/3155438679 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826c005b40 con 0x7f82840cc4b0 2024-05-12T10:49:52.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f827aa00640 1 -- 172.21.15.115:0/3155438679 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c00b660 con 0x7f82840cc4b0 2024-05-12T10:49:52.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8283200640 1 -- 172.21.15.115:0/3155438679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82840c71e0 con 0x7f82840cc4b0 2024-05-12T10:49:52.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8283200640 1 -- 172.21.15.115:0/3155438679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82840c77a0 con 0x7f82840cc4b0 2024-05-12T10:49:52.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f8283200640 1 -- 172.21.15.115:0/3155438679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8284050750 con 0x7f82840cc4b0 2024-05-12T10:49:52.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.698+0000 7f827aa00640 1 -- 172.21.15.115:0/3155438679 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f826c00b800 con 0x7f82840cc4b0 2024-05-12T10:49:52.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.702+0000 7f827aa00640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f826006f430 0x7f82600718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:52.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.702+0000 7f827aa00640 1 -- 172.21.15.115:0/3155438679 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f826c08efb0 con 0x7f82840cc4b0 2024-05-12T10:49:52.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.702+0000 7f8281e00640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f826006f430 0x7f82600718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:52.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.702+0000 7f8281e00640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f826006f430 0x7f82600718f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f82740b2000 tx=0x7f82740aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:52.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.706+0000 7f827aa00640 1 -- 172.21.15.115:0/3155438679 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f826c022020 con 0x7f82840cc4b0 2024-05-12T10:49:52.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:52.862+0000 7f8283200640 1 -- 172.21.15.115:0/3155438679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f82840700f0 con 0x7f82840cc4b0 2024-05-12T10:49:53.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.582+0000 7f827aa00640 1 -- 172.21.15.115:0/3155438679 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f82841f22d0 con 0x7f82840cc4b0 2024-05-12T10:49:53.579 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2024-05-12T10:49:53.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 -- 172.21.15.115:0/3155438679 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f826006f430 msgr2=0x7f82600718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:53.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f826006f430 0x7f82600718f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f82740b2000 tx=0x7f82740aa070 comp rx=0 tx=0).stop 2024-05-12T10:49:53.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 -- 172.21.15.115:0/3155438679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82840cc4b0 msgr2=0x7f82840b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:53.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82840cc4b0 0x7f82840b4d20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f826c00d800 tx=0x7f826c00dcc0 comp rx=0 tx=0).stop 2024-05-12T10:49:53.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 -- 172.21.15.115:0/3155438679 shutdown_connections 2024-05-12T10:49:53.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f826006f430 0x7f82600718f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:53.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82840b43a0 0x7f82840b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:53.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82840cc4b0 0x7f82840b4d20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:53.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 --2- 172.21.15.115:0/3155438679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82840cc0d0 0x7f82841f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:53.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 -- 172.21.15.115:0/3155438679 >> 172.21.15.115:0/3155438679 conn(0x7f8284071f60 msgr2=0x7f8284072340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:53.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 -- 172.21.15.115:0/3155438679 shutdown_connections 2024-05-12T10:49:53.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.586+0000 7f8283200640 1 -- 172.21.15.115:0/3155438679 wait complete. 2024-05-12T10:49:53.608 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-12T10:49:53.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.758+0000 7f792f200640 1 Processor -- start 2024-05-12T10:49:53.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.758+0000 7f792f200640 1 -- start start 2024-05-12T10:49:53.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.758+0000 7f792f200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7930159470 0x7f79300ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:53.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.758+0000 7f792f200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 0x7f7930070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:53.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.758+0000 7f792f200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793006e370 con 0x7f79300ccb90 2024-05-12T10:49:53.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.758+0000 7f792f200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7930072830 con 0x7f7930159470 2024-05-12T10:49:53.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.758+0000 7f792f200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7930072af0 con 0x7f7930070210 2024-05-12T10:49:53.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.758+0000 7f792e800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 0x7f7930070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:53.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.758+0000 7f792de00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7930159470 0x7f79300ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:53.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.758+0000 7f792e800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 0x7f7930070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:57452/0 (socket says 172.21.15.115:57452) 2024-05-12T10:49:53.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.758+0000 7f792e800640 1 -- 172.21.15.115:0/4193915244 learned_addr learned my addr 172.21.15.115:0/4193915244 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:53.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.762+0000 7f792e800640 1 -- 172.21.15.115:0/4193915244 >> v2:172.21.15.134:3300/0 conn(0x7f7930159470 msgr2=0x7f79300ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:53.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.762+0000 7f792e800640 1 --2- 172.21.15.115:0/4193915244 >> v2:172.21.15.134:3300/0 conn(0x7f7930159470 0x7f79300ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:53.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.762+0000 7f792e800640 1 -- 172.21.15.115:0/4193915244 >> v1:172.21.15.134:6789/0 conn(0x7f79300ccb90 legacy=0x7f793015f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:53.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.762+0000 7f792e800640 1 -- 172.21.15.115:0/4193915244 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79300b1ec0 con 0x7f7930070210 2024-05-12T10:49:53.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.762+0000 7f792e800640 1 --2- 172.21.15.115:0/4193915244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 0x7f7930070640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7928009870 tx=0x7f792801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d00dd1373619399 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:53.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.762+0000 7f792d400640 1 -- 172.21.15.115:0/4193915244 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79280b5070 con 0x7f7930070210 2024-05-12T10:49:53.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.762+0000 7f792d400640 1 -- 172.21.15.115:0/4193915244 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79280a8a50 con 0x7f7930070210 2024-05-12T10:49:53.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.762+0000 7f792d400640 1 -- 172.21.15.115:0/4193915244 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79280a8e20 con 0x7f7930070210 2024-05-12T10:49:53.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 -- 172.21.15.115:0/4193915244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 msgr2=0x7f7930070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:53.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 --2- 172.21.15.115:0/4193915244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 0x7f7930070640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7928009870 tx=0x7f792801ed50 comp rx=0 tx=0).stop 2024-05-12T10:49:53.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 -- 172.21.15.115:0/4193915244 shutdown_connections 2024-05-12T10:49:53.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 --2- 172.21.15.115:0/4193915244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 0x7f7930070640 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:53.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 --2- 172.21.15.115:0/4193915244 >> v2:172.21.15.134:3300/0 conn(0x7f7930159470 0x7f79300ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:53.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 -- 172.21.15.115:0/4193915244 >> 172.21.15.115:0/4193915244 conn(0x7f7930071720 msgr2=0x7f7930076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:53.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 -- 172.21.15.115:0/4193915244 shutdown_connections 2024-05-12T10:49:53.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 -- 172.21.15.115:0/4193915244 wait complete. 2024-05-12T10:49:53.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 Processor -- start 2024-05-12T10:49:53.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 -- start start 2024-05-12T10:49:53.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 0x7f793015ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:53.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79300ccb90 0x7f79300b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7930159470 0x7f793015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f793015f720 con 0x7f79300ccb90 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f793006c440 con 0x7f7930159470 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792f200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f793006dfd0 con 0x7f7930070210 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f7925400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79300ccb90 0x7f79300b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f7925400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79300ccb90 0x7f79300b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60280/0 (socket says 172.21.15.115:60280) 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f7925400640 1 -- 172.21.15.115:0/4214195731 learned_addr learned my addr 172.21.15.115:0/4214195731 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792e800640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7930159470 0x7f793015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f792de00640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 0x7f793015ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f7925400640 1 -- 172.21.15.115:0/4214195731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 msgr2=0x7f793015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f7925400640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 0x7f793015ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f7925400640 1 -- 172.21.15.115:0/4214195731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7930159470 msgr2=0x7f793015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f7925400640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7930159470 0x7f793015a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.766+0000 7f7925400640 1 -- 172.21.15.115:0/4214195731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79300cfbc0 con 0x7f79300ccb90 2024-05-12T10:49:53.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.770+0000 7f7925400640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79300ccb90 0x7f79300b3870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f791800c530 tx=0x7f791800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:53.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.770+0000 7f7926a00640 1 -- 172.21.15.115:0/4214195731 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918017070 con 0x7f79300ccb90 2024-05-12T10:49:53.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.770+0000 7f7926a00640 1 -- 172.21.15.115:0/4214195731 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79180052d0 con 0x7f79300ccb90 2024-05-12T10:49:53.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.770+0000 7f792f200640 1 -- 172.21.15.115:0/4214195731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79301f2520 con 0x7f79300ccb90 2024-05-12T10:49:53.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.770+0000 7f7926a00640 1 -- 172.21.15.115:0/4214195731 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918012870 con 0x7f79300ccb90 2024-05-12T10:49:53.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.770+0000 7f792f200640 1 -- 172.21.15.115:0/4214195731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79301f2790 con 0x7f79300ccb90 2024-05-12T10:49:53.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.770+0000 7f792f200640 1 -- 172.21.15.115:0/4214195731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7930050750 con 0x7f79300ccb90 2024-05-12T10:49:53.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.770+0000 7f7926a00640 1 -- 172.21.15.115:0/4214195731 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f791801a070 con 0x7f79300ccb90 2024-05-12T10:49:53.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.770+0000 7f7926a00640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f790c06f430 0x7f790c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:53.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.770+0000 7f7926a00640 1 -- 172.21.15.115:0/4214195731 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f791808e1d0 con 0x7f79300ccb90 2024-05-12T10:49:53.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.770+0000 7f792de00640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f790c06f430 0x7f790c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:53.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.774+0000 7f792de00640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f790c06f430 0x7f790c0718f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7920011340 tx=0x7f792000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:53.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.778+0000 7f7926a00640 1 -- 172.21.15.115:0/4214195731 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7918005480 con 0x7f79300ccb90 2024-05-12T10:49:53.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:53.938+0000 7f792f200640 1 -- 172.21.15.115:0/4214195731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f79300cc970 con 0x7f79300ccb90 2024-05-12T10:49:54.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.590+0000 7f7926a00640 1 -- 172.21.15.115:0/4214195731 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f79180633b0 con 0x7f79300ccb90 2024-05-12T10:49:54.586 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2024-05-12T10:49:54.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 -- 172.21.15.115:0/4214195731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f790c06f430 msgr2=0x7f790c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:54.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f790c06f430 0x7f790c0718f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7920011340 tx=0x7f792000b040 comp rx=0 tx=0).stop 2024-05-12T10:49:54.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 -- 172.21.15.115:0/4214195731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79300ccb90 msgr2=0x7f79300b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:54.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79300ccb90 0x7f79300b3870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f791800c530 tx=0x7f791800c9f0 comp rx=0 tx=0).stop 2024-05-12T10:49:54.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 -- 172.21.15.115:0/4214195731 shutdown_connections 2024-05-12T10:49:54.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f790c06f430 0x7f790c0718f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:54.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7930159470 0x7f793015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:54.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79300ccb90 0x7f79300b3870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:54.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 --2- 172.21.15.115:0/4214195731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7930070210 0x7f793015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:54.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 -- 172.21.15.115:0/4214195731 >> 172.21.15.115:0/4214195731 conn(0x7f7930071720 msgr2=0x7f79300cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:54.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 -- 172.21.15.115:0/4214195731 shutdown_connections 2024-05-12T10:49:54.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.594+0000 7f792f200640 1 -- 172.21.15.115:0/4214195731 wait complete. 2024-05-12T10:49:54.626 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-12T10:49:54.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.774+0000 7fbcd8e00640 1 Processor -- start 2024-05-12T10:49:54.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.774+0000 7fbcd8e00640 1 -- start start 2024-05-12T10:49:54.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd8e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbcd4152a10 0x7fbcd4159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:54.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd8e00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd415be20 con 0x7fbcd4152df0 2024-05-12T10:49:54.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd8e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd4072cf0 con 0x7fbcd4073820 2024-05-12T10:49:54.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd8e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbcd4072fd0 con 0x7fbcd4152a10 2024-05-12T10:49:54.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd1400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbcd4152df0 0x7fbcd4073d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42518/0 (socket says 172.21.15.115:42518) 2024-05-12T10:49:54.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd1400640 1 -- 172.21.15.115:0/1095475430 learned_addr learned my addr 172.21.15.115:0/1095475430 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:54.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd1e00640 1 --2- 172.21.15.115:0/1095475430 >> v2:172.21.15.134:3300/0 conn(0x7fbcd4152a10 0x7fbcd4159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:54.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd0a00640 1 -- 172.21.15.115:0/1095475430 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3044834016 0 0) 0x7fbcd415be20 con 0x7fbcd4152df0 2024-05-12T10:49:54.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd0a00640 1 -- 172.21.15.115:0/1095475430 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb8003530 con 0x7fbcd4152df0 2024-05-12T10:49:54.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd1e00640 1 -- 172.21.15.115:0/1095475430 >> v1:172.21.15.134:6789/0 conn(0x7fbcd4073820 legacy=0x7fbcd415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:54.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd1e00640 1 -- 172.21.15.115:0/1095475430 >> v1:172.21.15.115:6789/0 conn(0x7fbcd4152df0 legacy=0x7fbcd4073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:54.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd0a00640 1 -- 172.21.15.115:0/1095475430 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2072689507 0 0) 0x7fbcb8003530 con 0x7fbcd4152df0 2024-05-12T10:49:54.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.778+0000 7fbcd1e00640 1 -- 172.21.15.115:0/1095475430 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd40c4990 con 0x7fbcd4152a10 2024-05-12T10:49:54.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd1e00640 1 --2- 172.21.15.115:0/1095475430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcd4152a10 0x7fbcd4159310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40097c0 tx=0x7fbcc401ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93fe2be557f18430 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:54.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd0a00640 1 -- 172.21.15.115:0/1095475430 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40b5070 con 0x7fbcd4152a10 2024-05-12T10:49:54.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd0a00640 1 -- 172.21.15.115:0/1095475430 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc40a8630 con 0x7fbcd4152a10 2024-05-12T10:49:54.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd0a00640 1 -- 172.21.15.115:0/1095475430 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0001700 con 0x7fbcd4152a10 2024-05-12T10:49:54.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd8e00640 1 -- 172.21.15.115:0/1095475430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcd4152a10 msgr2=0x7fbcd4159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:54.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd8e00640 1 --2- 172.21.15.115:0/1095475430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcd4152a10 0x7fbcd4159310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40097c0 tx=0x7fbcc401ebb0 comp rx=0 tx=0).stop 2024-05-12T10:49:54.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd8e00640 1 -- 172.21.15.115:0/1095475430 shutdown_connections 2024-05-12T10:49:54.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd8e00640 1 --2- 172.21.15.115:0/1095475430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcd4152a10 0x7fbcd4159310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:54.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd8e00640 1 -- 172.21.15.115:0/1095475430 >> 172.21.15.115:0/1095475430 conn(0x7fbcd4076830 msgr2=0x7fbcd40681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:54.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd8e00640 1 -- 172.21.15.115:0/1095475430 shutdown_connections 2024-05-12T10:49:54.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd8e00640 1 -- 172.21.15.115:0/1095475430 wait complete. 2024-05-12T10:49:54.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd8e00640 1 Processor -- start 2024-05-12T10:49:54.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.782+0000 7fbcd8e00640 1 -- start start 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd8e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcd4073820 0x7fbcd4156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd8e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcd4152a10 0x7fbcd415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd8e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcd4152df0 0x7fbcd40c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd8e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4073460 con 0x7fbcd4073820 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd8e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40c4f50 con 0x7fbcd4152df0 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd8e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd40735e0 con 0x7fbcd4152a10 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd1e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcd4073820 0x7fbcd4156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd1e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcd4073820 0x7fbcd4156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60294/0 (socket says 172.21.15.115:60294) 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd1e00640 1 -- 172.21.15.115:0/3716611137 learned_addr learned my addr 172.21.15.115:0/3716611137 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd2800640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcd4152df0 0x7fbcd40c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd1400640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcd4152a10 0x7fbcd415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd1e00640 1 -- 172.21.15.115:0/3716611137 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcd4152a10 msgr2=0x7fbcd415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd1e00640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcd4152a10 0x7fbcd415b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:54.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd1e00640 1 -- 172.21.15.115:0/3716611137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcd4152df0 msgr2=0x7fbcd40c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:54.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd1e00640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcd4152df0 0x7fbcd40c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:54.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd1e00640 1 -- 172.21.15.115:0/3716611137 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd40c7260 con 0x7fbcd4073820 2024-05-12T10:49:54.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd1400640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcd4152a10 0x7fbcd415b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:49:54.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd1e00640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcd4073820 0x7fbcd4156000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40b3040 tx=0x7fbcc401b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:54.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcca000640 1 -- 172.21.15.115:0/3716611137 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40b5040 con 0x7fbcd4073820 2024-05-12T10:49:54.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcca000640 1 -- 172.21.15.115:0/3716611137 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc40c0070 con 0x7fbcd4073820 2024-05-12T10:49:54.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcca000640 1 -- 172.21.15.115:0/3716611137 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40a9cf0 con 0x7fbcd4073820 2024-05-12T10:49:54.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd8e00640 1 -- 172.21.15.115:0/3716611137 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd4153430 con 0x7fbcd4073820 2024-05-12T10:49:54.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd8e00640 1 -- 172.21.15.115:0/3716611137 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd41550e0 con 0x7fbcd4073820 2024-05-12T10:49:54.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcd8e00640 1 -- 172.21.15.115:0/3716611137 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd4154ee0 con 0x7fbcd4073820 2024-05-12T10:49:54.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.786+0000 7fbcca000640 1 -- 172.21.15.115:0/3716611137 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbcc4003620 con 0x7fbcd4073820 2024-05-12T10:49:54.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.790+0000 7fbcca000640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbcb406f400 0x7fbcb40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:54.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.790+0000 7fbcca000640 1 -- 172.21.15.115:0/3716611137 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fbcc412d080 con 0x7fbcd4073820 2024-05-12T10:49:54.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.790+0000 7fbcd1400640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbcb406f400 0x7fbcb40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:54.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.790+0000 7fbcd1400640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbcb406f400 0x7fbcb40718c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcd41eb9b0 tx=0x7fbcc0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:54.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.794+0000 7fbcca000640 1 -- 172.21.15.115:0/3716611137 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbcc4018710 con 0x7fbcd4073820 2024-05-12T10:49:54.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:54.986+0000 7fbcd8e00640 1 -- 172.21.15.115:0/3716611137 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbcd4069730 con 0x7fbcd4073820 2024-05-12T10:49:55.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.606+0000 7fbcca000640 1 -- 172.21.15.115:0/3716611137 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fbcc40fa040 con 0x7fbcd4073820 2024-05-12T10:49:55.604 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 2 and data pool 3 2024-05-12T10:49:55.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.610+0000 7fbcd8e00640 1 -- 172.21.15.115:0/3716611137 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbcb406f400 msgr2=0x7fbcb40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:55.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.610+0000 7fbcd8e00640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbcb406f400 0x7fbcb40718c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcd41eb9b0 tx=0x7fbcc0009040 comp rx=0 tx=0).stop 2024-05-12T10:49:55.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.610+0000 7fbcd8e00640 1 -- 172.21.15.115:0/3716611137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcd4073820 msgr2=0x7fbcd4156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:55.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.614+0000 7fbcd8e00640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcd4073820 0x7fbcd4156000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40b3040 tx=0x7fbcc401b950 comp rx=0 tx=0).stop 2024-05-12T10:49:55.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.614+0000 7fbcd8e00640 1 -- 172.21.15.115:0/3716611137 shutdown_connections 2024-05-12T10:49:55.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.614+0000 7fbcd8e00640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbcb406f400 0x7fbcb40718c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:55.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.614+0000 7fbcd8e00640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcd4152df0 0x7fbcd40c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:55.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.614+0000 7fbcd8e00640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcd4152a10 0x7fbcd415b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:55.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.614+0000 7fbcd8e00640 1 --2- 172.21.15.115:0/3716611137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcd4073820 0x7fbcd4156000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:55.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.614+0000 7fbcd8e00640 1 -- 172.21.15.115:0/3716611137 >> 172.21.15.115:0/3716611137 conn(0x7fbcd4076830 msgr2=0x7fbcd40cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:55.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.614+0000 7fbcd8e00640 1 -- 172.21.15.115:0/3716611137 shutdown_connections 2024-05-12T10:49:55.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.614+0000 7fbcd8e00640 1 -- 172.21.15.115:0/3716611137 wait complete. 2024-05-12T10:49:55.638 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-12T10:49:55.638 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-12T10:49:55.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.782+0000 7f54dec00640 1 Processor -- start 2024-05-12T10:49:55.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54dec00640 1 -- start start 2024-05-12T10:49:55.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54dec00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f54d8153a70 0x7f54d80c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:55.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54dec00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f54d80c9900 0x7f54d80c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:55.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54dec00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d8070d00 con 0x7f54d80ccf10 2024-05-12T10:49:55.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54dec00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f54d80c8420 con 0x7f54d80c9900 2024-05-12T10:49:55.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54dec00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f54d8070ab0 con 0x7f54d8153a70 2024-05-12T10:49:55.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54cf400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f54d80c9900 0x7f54d80c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:55.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54dcc00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f54d80ccf10 0x7f54d806f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42528/0 (socket says 172.21.15.115:42528) 2024-05-12T10:49:55.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54dcc00640 1 -- 172.21.15.115:0/3455902992 learned_addr learned my addr 172.21.15.115:0/3455902992 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:55.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54d7e00640 1 --2- 172.21.15.115:0/3455902992 >> v2:172.21.15.134:3300/0 conn(0x7f54d8153a70 0x7f54d80c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:55.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54cf400640 1 -- 172.21.15.115:0/3455902992 >> v2:172.21.15.134:3300/0 conn(0x7f54d8153a70 msgr2=0x7f54d80c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:55.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54cf400640 1 --2- 172.21.15.115:0/3455902992 >> v2:172.21.15.134:3300/0 conn(0x7f54d8153a70 0x7f54d80c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:55.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54cf400640 1 -- 172.21.15.115:0/3455902992 >> v1:172.21.15.115:6789/0 conn(0x7f54d80ccf10 legacy=0x7f54d806f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:55.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54cf400640 1 -- 172.21.15.115:0/3455902992 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d80cb1c0 con 0x7f54d80c9900 2024-05-12T10:49:55.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.786+0000 7f54d7400640 1 -- 172.21.15.115:0/3455902992 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3869032408 0 0) 0x7f54d8070d00 con 0x7f54d80ccf10 2024-05-12T10:49:55.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54cf400640 1 --2- 172.21.15.115:0/3455902992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54d80c9900 0x7f54d80c6f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54c00097c0 tx=0x7f54c001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c412df16595eaa server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:55.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54d7400640 1 -- 172.21.15.115:0/3455902992 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c00b5070 con 0x7f54d80c9900 2024-05-12T10:49:55.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54d7400640 1 -- 172.21.15.115:0/3455902992 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c00a8950 con 0x7f54d80c9900 2024-05-12T10:49:55.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54d7400640 1 -- 172.21.15.115:0/3455902992 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c00a8d20 con 0x7f54d80c9900 2024-05-12T10:49:55.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54dec00640 1 -- 172.21.15.115:0/3455902992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54d80c9900 msgr2=0x7f54d80c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:55.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54dec00640 1 --2- 172.21.15.115:0/3455902992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54d80c9900 0x7f54d80c6f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54c00097c0 tx=0x7f54c001ec50 comp rx=0 tx=0).stop 2024-05-12T10:49:55.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54dec00640 1 -- 172.21.15.115:0/3455902992 shutdown_connections 2024-05-12T10:49:55.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54dec00640 1 --2- 172.21.15.115:0/3455902992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54d80c9900 0x7f54d80c6f70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:55.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54dec00640 1 --2- 172.21.15.115:0/3455902992 >> v2:172.21.15.134:3300/0 conn(0x7f54d8153a70 0x7f54d80c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:55.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54dec00640 1 -- 172.21.15.115:0/3455902992 >> 172.21.15.115:0/3455902992 conn(0x7f54d80cd320 msgr2=0x7f54d80cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:55.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54dec00640 1 -- 172.21.15.115:0/3455902992 shutdown_connections 2024-05-12T10:49:55.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54dec00640 1 -- 172.21.15.115:0/3455902992 wait complete. 2024-05-12T10:49:55.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54dec00640 1 Processor -- start 2024-05-12T10:49:55.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.790+0000 7f54dec00640 1 -- start start 2024-05-12T10:49:55.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dec00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d80c9900 0x7f54d80739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:55.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dec00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54d80ccf10 0x7f54d81efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:55.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dec00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54d8153a70 0x7f54d81486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:55.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dec00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f54d80cde40 con 0x7f54d8153a70 2024-05-12T10:49:55.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dec00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f54d80c7f00 con 0x7f54d80c9900 2024-05-12T10:49:55.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dec00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f54d80cdfc0 con 0x7f54d80ccf10 2024-05-12T10:49:55.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dcc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54d8153a70 0x7f54d81486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:55.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dcc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54d8153a70 0x7f54d81486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60324/0 (socket says 172.21.15.115:60324) 2024-05-12T10:49:55.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dcc00640 1 -- 172.21.15.115:0/3554631291 learned_addr learned my addr 172.21.15.115:0/3554631291 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:55.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54cf400640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54d80ccf10 0x7f54d81efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:55.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54d7e00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d80c9900 0x7f54d80739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:55.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dcc00640 1 -- 172.21.15.115:0/3554631291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54d80ccf10 msgr2=0x7f54d81efd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:55.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dcc00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54d80ccf10 0x7f54d81efd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:55.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dcc00640 1 -- 172.21.15.115:0/3554631291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d80c9900 msgr2=0x7f54d80739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:55.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dcc00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d80c9900 0x7f54d80739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:55.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dcc00640 1 -- 172.21.15.115:0/3554631291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d8156e70 con 0x7f54d8153a70 2024-05-12T10:49:55.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dcc00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54d8153a70 0x7f54d81486c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54d000c760 tx=0x7f54d000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:55.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54d4c00640 1 -- 172.21.15.115:0/3554631291 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0018070 con 0x7f54d8153a70 2024-05-12T10:49:55.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54d4c00640 1 -- 172.21.15.115:0/3554631291 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d000a640 con 0x7f54d8153a70 2024-05-12T10:49:55.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54d4c00640 1 -- 172.21.15.115:0/3554631291 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d000aa30 con 0x7f54d8153a70 2024-05-12T10:49:55.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dec00640 1 -- 172.21.15.115:0/3554631291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d8156980 con 0x7f54d8153a70 2024-05-12T10:49:55.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dec00640 1 -- 172.21.15.115:0/3554631291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d81547d0 con 0x7f54d8153a70 2024-05-12T10:49:55.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.794+0000 7f54dec00640 1 -- 172.21.15.115:0/3554631291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d8154a10 con 0x7f54d8153a70 2024-05-12T10:49:55.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.798+0000 7f54d4c00640 1 -- 172.21.15.115:0/3554631291 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f54d001b070 con 0x7f54d8153a70 2024-05-12T10:49:55.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.798+0000 7f54d4c00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f54b406f400 0x7f54b40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:55.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.798+0000 7f54d4c00640 1 -- 172.21.15.115:0/3554631291 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f54d008e770 con 0x7f54d8153a70 2024-05-12T10:49:55.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.798+0000 7f54d7e00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f54b406f400 0x7f54b40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:55.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.798+0000 7f54d7e00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f54b406f400 0x7f54b40718c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54c800b930 tx=0x7f54c8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:55.796 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.802+0000 7f54d4c00640 1 -- 172.21.15.115:0/3554631291 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f54d8156e70 con 0x7f54d8153a70 2024-05-12T10:49:55.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:55.966+0000 7f54dec00640 1 -- 172.21.15.115:0/3554631291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f54d8069730 con 0x7f54d8153a70 2024-05-12T10:49:56.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.594+0000 7f54d4c00640 1 -- 172.21.15.115:0/3554631291 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f54d005b780 con 0x7f54d8153a70 2024-05-12T10:49:56.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 -- 172.21.15.115:0/3554631291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f54b406f400 msgr2=0x7f54b40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:56.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f54b406f400 0x7f54b40718c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54c800b930 tx=0x7f54c8008040 comp rx=0 tx=0).stop 2024-05-12T10:49:56.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 -- 172.21.15.115:0/3554631291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54d8153a70 msgr2=0x7f54d81486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:56.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54d8153a70 0x7f54d81486c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54d000c760 tx=0x7f54d000cc20 comp rx=0 tx=0).stop 2024-05-12T10:49:56.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 -- 172.21.15.115:0/3554631291 shutdown_connections 2024-05-12T10:49:56.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f54b406f400 0x7f54b40718c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:56.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54d8153a70 0x7f54d81486c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:56.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54d80ccf10 0x7f54d81efd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:56.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 --2- 172.21.15.115:0/3554631291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d80c9900 0x7f54d80739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:56.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 -- 172.21.15.115:0/3554631291 >> 172.21.15.115:0/3554631291 conn(0x7f54d80cd320 msgr2=0x7f54d814be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:56.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 -- 172.21.15.115:0/3554631291 shutdown_connections 2024-05-12T10:49:56.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.598+0000 7f54dec00640 1 -- 172.21.15.115:0/3554631291 wait complete. 2024-05-12T10:49:56.617 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-12T10:49:56.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.765+0000 7f7609600640 1 Processor -- start 2024-05-12T10:49:56.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.765+0000 7f7609600640 1 -- start start 2024-05-12T10:49:56.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.765+0000 7f7609600640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f76040c7690 0x7f76040c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:56.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.765+0000 7f7609600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f760415ca40 0x7f76040ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:56.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.765+0000 7f7609600640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7604153140 con 0x7f7604152d60 2024-05-12T10:49:56.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.765+0000 7f7609600640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f76040c4cd0 con 0x7f76040c7690 2024-05-12T10:49:56.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.765+0000 7f7609600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f76040c4fb0 con 0x7f760415ca40 2024-05-12T10:49:56.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7602a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7604152d60 0x7f760415c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42544/0 (socket says 172.21.15.115:42544) 2024-05-12T10:49:56.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7602000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f76040c7690 0x7f76040c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:56.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7602a00640 1 -- 172.21.15.115:0/38585000 learned_addr learned my addr 172.21.15.115:0/38585000 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:56.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7603400640 1 --2- 172.21.15.115:0/38585000 >> v2:172.21.15.134:3300/0 conn(0x7f760415ca40 0x7f76040ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:56.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7602000640 1 -- 172.21.15.115:0/38585000 >> v2:172.21.15.134:3300/0 conn(0x7f760415ca40 msgr2=0x7f76040ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:56.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7602000640 1 --2- 172.21.15.115:0/38585000 >> v2:172.21.15.134:3300/0 conn(0x7f760415ca40 0x7f76040ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:56.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7602000640 1 -- 172.21.15.115:0/38585000 >> v1:172.21.15.115:6789/0 conn(0x7f7604152d60 legacy=0x7f760415c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:56.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7602000640 1 -- 172.21.15.115:0/38585000 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76040c94e0 con 0x7f76040c7690 2024-05-12T10:49:56.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7601600640 1 -- 172.21.15.115:0/38585000 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769987136 0 0) 0x7f7604153140 con 0x7f7604152d60 2024-05-12T10:49:56.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7602000640 1 --2- 172.21.15.115:0/38585000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76040c7690 0x7f76040c9d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76040c65c0 tx=0x7f75f001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33b91078a722bd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:56.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7601600640 1 -- 172.21.15.115:0/38585000 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f00b5070 con 0x7f76040c7690 2024-05-12T10:49:56.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7601600640 1 -- 172.21.15.115:0/38585000 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f00a8970 con 0x7f76040c7690 2024-05-12T10:49:56.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.769+0000 7f7601600640 1 -- 172.21.15.115:0/38585000 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f00a8d40 con 0x7f76040c7690 2024-05-12T10:49:56.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 -- 172.21.15.115:0/38585000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76040c7690 msgr2=0x7f76040c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:56.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 --2- 172.21.15.115:0/38585000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76040c7690 0x7f76040c9d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76040c65c0 tx=0x7f75f001ec70 comp rx=0 tx=0).stop 2024-05-12T10:49:56.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 -- 172.21.15.115:0/38585000 shutdown_connections 2024-05-12T10:49:56.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 --2- 172.21.15.115:0/38585000 >> v2:172.21.15.134:3300/0 conn(0x7f760415ca40 0x7f76040ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:56.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 --2- 172.21.15.115:0/38585000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76040c7690 0x7f76040c9d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:56.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 -- 172.21.15.115:0/38585000 >> 172.21.15.115:0/38585000 conn(0x7f76040681c0 msgr2=0x7f76040685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:56.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 -- 172.21.15.115:0/38585000 shutdown_connections 2024-05-12T10:49:56.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 -- 172.21.15.115:0/38585000 wait complete. 2024-05-12T10:49:56.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 Processor -- start 2024-05-12T10:49:56.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 -- start start 2024-05-12T10:49:56.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76040c7690 0x7f760414d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7604152d60 0x7f7604150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f760415ca40 0x7f760415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f76040c4920 con 0x7f7604152d60 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76040c9aa0 con 0x7f76040c7690 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7609600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7604143590 con 0x7f760415ca40 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7602000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7604152d60 0x7f7604150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7602000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7604152d60 0x7f7604150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60338/0 (socket says 172.21.15.115:60338) 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7602000640 1 -- 172.21.15.115:0/3963577741 learned_addr learned my addr 172.21.15.115:0/3963577741 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7602a00640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76040c7690 0x7f760414d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7603400640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f760415ca40 0x7f760415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7602000640 1 -- 172.21.15.115:0/3963577741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f760415ca40 msgr2=0x7f760415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7602000640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f760415ca40 0x7f760415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7602000640 1 -- 172.21.15.115:0/3963577741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76040c7690 msgr2=0x7f760414d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:56.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7602000640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76040c7690 0x7f760414d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:56.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7602000640 1 -- 172.21.15.115:0/3963577741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760414eaa0 con 0x7f7604152d60 2024-05-12T10:49:56.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7603400640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f760415ca40 0x7f760415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:49:56.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.773+0000 7f7602a00640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76040c7690 0x7f760414d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:49:56.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f7602000640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7604152d60 0x7f7604150360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f75f001c8a0 tx=0x7f75f001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:56.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f75faa00640 1 -- 172.21.15.115:0/3963577741 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f00bf070 con 0x7f7604152d60 2024-05-12T10:49:56.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f75faa00640 1 -- 172.21.15.115:0/3963577741 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f00b0740 con 0x7f7604152d60 2024-05-12T10:49:56.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f75faa00640 1 -- 172.21.15.115:0/3963577741 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f00b5040 con 0x7f7604152d60 2024-05-12T10:49:56.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f7609600640 1 -- 172.21.15.115:0/3963577741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760414ed80 con 0x7f7604152d60 2024-05-12T10:49:56.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f7609600640 1 -- 172.21.15.115:0/3963577741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f760415b6e0 con 0x7f7604152d60 2024-05-12T10:49:56.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f7609600640 1 -- 172.21.15.115:0/3963577741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7604069730 con 0x7f7604152d60 2024-05-12T10:49:56.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f75faa00640 1 -- 172.21.15.115:0/3963577741 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f75f00c2070 con 0x7f7604152d60 2024-05-12T10:49:56.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f75faa00640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f75e406f430 0x7f75e40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:56.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f75faa00640 1 -- 172.21.15.115:0/3963577741 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f75f012bc00 con 0x7f7604152d60 2024-05-12T10:49:56.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f7602a00640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f75e406f430 0x7f75e40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:56.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.777+0000 7f7602a00640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f75e406f430 0x7f75e40718f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f75f4007fd0 tx=0x7f75f4007f40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:56.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.781+0000 7f75faa00640 1 -- 172.21.15.115:0/3963577741 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f75f00187d0 con 0x7f7604152d60 2024-05-12T10:49:56.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:56.941+0000 7f7609600640 1 -- 172.21.15.115:0/3963577741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7604073b30 con 0x7f7604152d60 2024-05-12T10:49:58.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.621+0000 7f75faa00640 1 -- 172.21.15.115:0/3963577741 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f75f00f89c0 con 0x7f7604152d60 2024-05-12T10:49:58.620 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data_ec' created 2024-05-12T10:49:58.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 -- 172.21.15.115:0/3963577741 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f75e406f430 msgr2=0x7f75e40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:58.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f75e406f430 0x7f75e40718f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f75f4007fd0 tx=0x7f75f4007f40 comp rx=0 tx=0).stop 2024-05-12T10:49:58.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 -- 172.21.15.115:0/3963577741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7604152d60 msgr2=0x7f7604150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:58.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7604152d60 0x7f7604150360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f75f001c8a0 tx=0x7f75f001ba10 comp rx=0 tx=0).stop 2024-05-12T10:49:58.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 -- 172.21.15.115:0/3963577741 shutdown_connections 2024-05-12T10:49:58.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f75e406f430 0x7f75e40718f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:58.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f760415ca40 0x7f760415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:58.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7604152d60 0x7f7604150360 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:58.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 --2- 172.21.15.115:0/3963577741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76040c7690 0x7f760414d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:58.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 -- 172.21.15.115:0/3963577741 >> 172.21.15.115:0/3963577741 conn(0x7f76040681c0 msgr2=0x7f76040c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:58.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 -- 172.21.15.115:0/3963577741 shutdown_connections 2024-05-12T10:49:58.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.625+0000 7f7609600640 1 -- 172.21.15.115:0/3963577741 wait complete. 2024-05-12T10:49:58.652 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-12T10:49:58.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a8a00640 1 Processor -- start 2024-05-12T10:49:58.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a8a00640 1 -- start start 2024-05-12T10:49:58.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a8a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f12a4155fd0 0x7f12a415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:58.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a8a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12a415fc50 0x7f12a406df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:58.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a8a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a40ca100 con 0x7f12a4071180 2024-05-12T10:49:58.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a8a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f12a4160070 con 0x7f12a4155fd0 2024-05-12T10:49:58.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a8a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f12a40b5040 con 0x7f12a415fc50 2024-05-12T10:49:58.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a1e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f12a4155fd0 0x7f12a415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:58.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a2800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f12a4071180 0x7f12a40cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42552/0 (socket says 172.21.15.115:42552) 2024-05-12T10:49:58.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a2800640 1 -- 172.21.15.115:0/3060403152 learned_addr learned my addr 172.21.15.115:0/3060403152 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:58.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a1400640 1 --2- 172.21.15.115:0/3060403152 >> v2:172.21.15.134:3300/0 conn(0x7f12a415fc50 0x7f12a406df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:58.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a1e00640 1 -- 172.21.15.115:0/3060403152 >> v2:172.21.15.134:3300/0 conn(0x7f12a415fc50 msgr2=0x7f12a406df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:58.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a1e00640 1 --2- 172.21.15.115:0/3060403152 >> v2:172.21.15.134:3300/0 conn(0x7f12a415fc50 0x7f12a406df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:58.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a1e00640 1 -- 172.21.15.115:0/3060403152 >> v1:172.21.15.115:6789/0 conn(0x7f12a4071180 legacy=0x7f12a40cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:58.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a1e00640 1 -- 172.21.15.115:0/3060403152 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a40ca3e0 con 0x7f12a4155fd0 2024-05-12T10:49:58.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a1400640 1 --2- 172.21.15.115:0/3060403152 >> v2:172.21.15.134:3300/0 conn(0x7f12a415fc50 0x7f12a406df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:49:58.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.797+0000 7f12a0a00640 1 -- 172.21.15.115:0/3060403152 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134698743 0 0) 0x7f12a40ca100 con 0x7f12a4071180 2024-05-12T10:49:58.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a1e00640 1 --2- 172.21.15.115:0/3060403152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a4155fd0 0x7f12a415cfd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f12a40cd170 tx=0x7f129401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82b843741400cc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:58.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a0a00640 1 -- 172.21.15.115:0/3060403152 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12940ab5f0 con 0x7f12a4155fd0 2024-05-12T10:49:58.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a0a00640 1 -- 172.21.15.115:0/3060403152 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12940b0070 con 0x7f12a4155fd0 2024-05-12T10:49:58.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a0a00640 1 -- 172.21.15.115:0/3060403152 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12940ab9b0 con 0x7f12a4155fd0 2024-05-12T10:49:58.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a8a00640 1 -- 172.21.15.115:0/3060403152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a4155fd0 msgr2=0x7f12a415cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:58.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a8a00640 1 --2- 172.21.15.115:0/3060403152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a4155fd0 0x7f12a415cfd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f12a40cd170 tx=0x7f129401c3f0 comp rx=0 tx=0).stop 2024-05-12T10:49:58.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a8a00640 1 -- 172.21.15.115:0/3060403152 shutdown_connections 2024-05-12T10:49:58.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a8a00640 1 --2- 172.21.15.115:0/3060403152 >> v2:172.21.15.134:3300/0 conn(0x7f12a415fc50 0x7f12a406df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:58.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a8a00640 1 --2- 172.21.15.115:0/3060403152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a4155fd0 0x7f12a415cfd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:58.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a8a00640 1 -- 172.21.15.115:0/3060403152 >> 172.21.15.115:0/3060403152 conn(0x7f12a406c840 msgr2=0x7f12a406cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:58.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a8a00640 1 -- 172.21.15.115:0/3060403152 shutdown_connections 2024-05-12T10:49:58.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.801+0000 7f12a8a00640 1 -- 172.21.15.115:0/3060403152 wait complete. 2024-05-12T10:49:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a8a00640 1 Processor -- start 2024-05-12T10:49:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a8a00640 1 -- start start 2024-05-12T10:49:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a8a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a4071180 0x7f12a40b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a8a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12a4155fd0 0x7f12a40c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a8a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a415fc50 0x7f12a40c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a8a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f12a40d0180 con 0x7f12a415fc50 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a8a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12a40ca6c0 con 0x7f12a4071180 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a8a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f12a40d0300 con 0x7f12a4155fd0 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a2800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a415fc50 0x7f12a40c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a2800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a415fc50 0x7f12a40c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60362/0 (socket says 172.21.15.115:60362) 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a2800640 1 -- 172.21.15.115:0/290298434 learned_addr learned my addr 172.21.15.115:0/290298434 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a1e00640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a4071180 0x7f12a40b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a1400640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12a4155fd0 0x7f12a40c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a2800640 1 -- 172.21.15.115:0/290298434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12a4155fd0 msgr2=0x7f12a40c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a2800640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12a4155fd0 0x7f12a40c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a2800640 1 -- 172.21.15.115:0/290298434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a4071180 msgr2=0x7f12a40b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a2800640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a4071180 0x7f12a40b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a2800640 1 -- 172.21.15.115:0/290298434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a40b33d0 con 0x7f12a415fc50 2024-05-12T10:49:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a1400640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12a4155fd0 0x7f12a40c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:49:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a2800640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a415fc50 0x7f12a40c5fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f129c00c6b0 tx=0x7f129c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f129a000640 1 -- 172.21.15.115:0/290298434 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c018070 con 0x7f12a415fc50 2024-05-12T10:49:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f129a000640 1 -- 172.21.15.115:0/290298434 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c004db0 con 0x7f12a415fc50 2024-05-12T10:49:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a8a00640 1 -- 172.21.15.115:0/290298434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a414d920 con 0x7f12a415fc50 2024-05-12T10:49:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f129a000640 1 -- 172.21.15.115:0/290298434 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c00a880 con 0x7f12a415fc50 2024-05-12T10:49:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a8a00640 1 -- 172.21.15.115:0/290298434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a414dee0 con 0x7f12a415fc50 2024-05-12T10:49:58.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.805+0000 7f12a8a00640 1 -- 172.21.15.115:0/290298434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a4069730 con 0x7f12a415fc50 2024-05-12T10:49:58.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.809+0000 7f129a000640 1 -- 172.21.15.115:0/290298434 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f129c01b070 con 0x7f12a415fc50 2024-05-12T10:49:58.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.809+0000 7f129a000640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f128406f400 0x7f12840718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:58.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.809+0000 7f129a000640 1 -- 172.21.15.115:0/290298434 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f129c08ef10 con 0x7f12a415fc50 2024-05-12T10:49:58.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.809+0000 7f12a1e00640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f128406f400 0x7f12840718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:58.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.809+0000 7f12a1e00640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f128406f400 0x7f12840718c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12940af000 tx=0x7f12940a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:58.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.813+0000 7f129a000640 1 -- 172.21.15.115:0/290298434 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f129c022020 con 0x7f12a415fc50 2024-05-12T10:49:58.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:58.969+0000 7f12a8a00640 1 -- 172.21.15.115:0/290298434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f12a40b2f90 con 0x7f12a415fc50 2024-05-12T10:49:59.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.625+0000 7f129a000640 1 -- 172.21.15.115:0/290298434 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f12a40b33d0 con 0x7f12a415fc50 2024-05-12T10:49:59.622 INFO:teuthology.orchestra.run.smithi115.stderr:set pool 4 allow_ec_overwrites to true 2024-05-12T10:49:59.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 -- 172.21.15.115:0/290298434 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f128406f400 msgr2=0x7f12840718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:59.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f128406f400 0x7f12840718c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12940af000 tx=0x7f12940a7000 comp rx=0 tx=0).stop 2024-05-12T10:49:59.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 -- 172.21.15.115:0/290298434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a415fc50 msgr2=0x7f12a40c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:59.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a415fc50 0x7f12a40c5fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f129c00c6b0 tx=0x7f129c00cb70 comp rx=0 tx=0).stop 2024-05-12T10:49:59.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 -- 172.21.15.115:0/290298434 shutdown_connections 2024-05-12T10:49:59.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f128406f400 0x7f12840718c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:59.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12a415fc50 0x7f12a40c5fa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:59.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12a4155fd0 0x7f12a40c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:59.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 --2- 172.21.15.115:0/290298434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a4071180 0x7f12a40b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:59.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 -- 172.21.15.115:0/290298434 >> 172.21.15.115:0/290298434 conn(0x7f12a406c840 msgr2=0x7f12a4072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:59.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 -- 172.21.15.115:0/290298434 shutdown_connections 2024-05-12T10:49:59.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.629+0000 7f12a8a00640 1 -- 172.21.15.115:0/290298434 wait complete. 2024-05-12T10:49:59.672 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-12T10:49:59.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f345ca00640 1 Processor -- start 2024-05-12T10:49:59.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f345ca00640 1 -- start start 2024-05-12T10:49:59.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f345ca00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f34580b20a0 0x7f345815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:59.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f345ca00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34580cae10 0x7f34581666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:59.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f345ca00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34580ca040 con 0x7f3458071a30 2024-05-12T10:49:59.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f345ca00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f34580ca980 con 0x7f34580b20a0 2024-05-12T10:49:59.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f345ca00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f34580cbde0 con 0x7f34580cae10 2024-05-12T10:49:59.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f3455400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3458071a30 0x7f34580cc060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42560/0 (socket says 172.21.15.115:42560) 2024-05-12T10:49:59.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f3455400640 1 -- 172.21.15.115:0/2507951523 learned_addr learned my addr 172.21.15.115:0/2507951523 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:49:59.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f3455e00640 1 --2- 172.21.15.115:0/2507951523 >> v2:172.21.15.134:3300/0 conn(0x7f34580b20a0 0x7f345815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:59.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f3456800640 1 --2- 172.21.15.115:0/2507951523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34580cae10 0x7f34581666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:59.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f3454a00640 1 -- 172.21.15.115:0/2507951523 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 140382362 0 0) 0x7f34580ca040 con 0x7f3458071a30 2024-05-12T10:49:59.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f3454a00640 1 -- 172.21.15.115:0/2507951523 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f343c003530 con 0x7f3458071a30 2024-05-12T10:49:59.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f3454a00640 1 -- 172.21.15.115:0/2507951523 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2136737766 0 0) 0x7f343c003530 con 0x7f3458071a30 2024-05-12T10:49:59.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f3455e00640 1 -- 172.21.15.115:0/2507951523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34580cae10 msgr2=0x7f34581666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:49:59.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f3455e00640 1 --2- 172.21.15.115:0/2507951523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34580cae10 0x7f34581666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:59.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f3455e00640 1 -- 172.21.15.115:0/2507951523 >> v1:172.21.15.115:6789/0 conn(0x7f3458071a30 legacy=0x7f34580cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:59.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.817+0000 7f3455e00640 1 -- 172.21.15.115:0/2507951523 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3458071260 con 0x7f34580b20a0 2024-05-12T10:49:59.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f3455e00640 1 --2- 172.21.15.115:0/2507951523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34580b20a0 0x7f345815be00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f34480097c0 tx=0x7f344801ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a76e1657bb57b3b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:59.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f3454a00640 1 -- 172.21.15.115:0/2507951523 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34480b5070 con 0x7f34580b20a0 2024-05-12T10:49:59.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f3454a00640 1 -- 172.21.15.115:0/2507951523 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34480a85f0 con 0x7f34580b20a0 2024-05-12T10:49:59.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f3454a00640 1 -- 172.21.15.115:0/2507951523 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3444001700 con 0x7f34580b20a0 2024-05-12T10:49:59.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f345ca00640 1 -- 172.21.15.115:0/2507951523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34580b20a0 msgr2=0x7f345815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:59.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f345ca00640 1 --2- 172.21.15.115:0/2507951523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34580b20a0 0x7f345815be00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f34480097c0 tx=0x7f344801ebb0 comp rx=0 tx=0).stop 2024-05-12T10:49:59.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f345ca00640 1 -- 172.21.15.115:0/2507951523 shutdown_connections 2024-05-12T10:49:59.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f345ca00640 1 --2- 172.21.15.115:0/2507951523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34580cae10 0x7f34581666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:59.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f345ca00640 1 --2- 172.21.15.115:0/2507951523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34580b20a0 0x7f345815be00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:59.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f345ca00640 1 -- 172.21.15.115:0/2507951523 >> 172.21.15.115:0/2507951523 conn(0x7f3458072050 msgr2=0x7f3458072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:49:59.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f345ca00640 1 -- 172.21.15.115:0/2507951523 shutdown_connections 2024-05-12T10:49:59.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.821+0000 7f345ca00640 1 -- 172.21.15.115:0/2507951523 wait complete. 2024-05-12T10:49:59.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f345ca00640 1 Processor -- start 2024-05-12T10:49:59.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f345ca00640 1 -- start start 2024-05-12T10:49:59.822 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f345ca00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3458071a30 0x7f34580c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:59.822 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f345ca00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34580b20a0 0x7f3458154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f345ca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34580cae10 0x7f34580b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f345ca00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3458071540 con 0x7f34580cae10 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f345ca00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34580cbb00 con 0x7f34580b20a0 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f345ca00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f345815c340 con 0x7f3458071a30 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f3456800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34580cae10 0x7f34580b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f3456800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34580cae10 0x7f34580b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60374/0 (socket says 172.21.15.115:60374) 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f3456800640 1 -- 172.21.15.115:0/685312118 learned_addr learned my addr 172.21.15.115:0/685312118 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f3455400640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34580b20a0 0x7f3458154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f3455e00640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3458071a30 0x7f34580c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f3456800640 1 -- 172.21.15.115:0/685312118 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3458071a30 msgr2=0x7f34580c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f3456800640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3458071a30 0x7f34580c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:59.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f3456800640 1 -- 172.21.15.115:0/685312118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34580b20a0 msgr2=0x7f3458154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:49:59.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f3456800640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34580b20a0 0x7f3458154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:49:59.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f3456800640 1 -- 172.21.15.115:0/685312118 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34580c6520 con 0x7f34580cae10 2024-05-12T10:49:59.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f3456800640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34580cae10 0x7f34580b2480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f345000efc0 tx=0x7f345000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:59.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f344e000640 1 -- 172.21.15.115:0/685312118 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450018020 con 0x7f34580cae10 2024-05-12T10:49:59.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f344e000640 1 -- 172.21.15.115:0/685312118 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3450014480 con 0x7f34580cae10 2024-05-12T10:49:59.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f344e000640 1 -- 172.21.15.115:0/685312118 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450009e60 con 0x7f34580cae10 2024-05-12T10:49:59.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f345ca00640 1 -- 172.21.15.115:0/685312118 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34580c7f60 con 0x7f34580cae10 2024-05-12T10:49:59.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.825+0000 7f345ca00640 1 -- 172.21.15.115:0/685312118 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34580c8520 con 0x7f34580cae10 2024-05-12T10:49:59.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.829+0000 7f345ca00640 1 -- 172.21.15.115:0/685312118 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3458069730 con 0x7f34580cae10 2024-05-12T10:49:59.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.829+0000 7f344e000640 1 -- 172.21.15.115:0/685312118 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f345001b020 con 0x7f34580cae10 2024-05-12T10:49:59.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.829+0000 7f344e000640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f343806f400 0x7f34380718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:49:59.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.829+0000 7f344e000640 1 -- 172.21.15.115:0/685312118 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f3450090350 con 0x7f34580cae10 2024-05-12T10:49:59.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.829+0000 7f3455e00640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f343806f400 0x7f34380718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:49:59.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.829+0000 7f3455e00640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f343806f400 0x7f34380718c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f34480b2000 tx=0x7f34480aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:49:59.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:49:59.833+0000 7f344e000640 1 -- 172.21.15.115:0/685312118 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3450022020 con 0x7f34580cae10 2024-05-12T10:50:00.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.029+0000 7f345ca00640 1 -- 172.21.15.115:0/685312118 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f3458071810 con 0x7f34580cae10 2024-05-12T10:50:00.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f344e000640 1 -- 172.21.15.115:0/685312118 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f3450010040 con 0x7f34580cae10 2024-05-12T10:50:00.647 INFO:teuthology.orchestra.run.smithi115.stderr:added data pool 4 to fsmap 2024-05-12T10:50:00.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 -- 172.21.15.115:0/685312118 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f343806f400 msgr2=0x7f34380718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:00.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f343806f400 0x7f34380718c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f34480b2000 tx=0x7f34480aa070 comp rx=0 tx=0).stop 2024-05-12T10:50:00.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 -- 172.21.15.115:0/685312118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34580cae10 msgr2=0x7f34580b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:00.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34580cae10 0x7f34580b2480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f345000efc0 tx=0x7f345000c490 comp rx=0 tx=0).stop 2024-05-12T10:50:00.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 -- 172.21.15.115:0/685312118 shutdown_connections 2024-05-12T10:50:00.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f343806f400 0x7f34380718c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:00.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34580cae10 0x7f34580b2480 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:00.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34580b20a0 0x7f3458154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:00.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 --2- 172.21.15.115:0/685312118 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3458071a30 0x7f34580c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:00.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 -- 172.21.15.115:0/685312118 >> 172.21.15.115:0/685312118 conn(0x7f3458072050 msgr2=0x7f34580cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:00.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 -- 172.21.15.115:0/685312118 shutdown_connections 2024-05-12T10:50:00.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.653+0000 7f345ca00640 1 -- 172.21.15.115:0/685312118 wait complete. 2024-05-12T10:50:00.670 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:50:00.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b8c00640 1 Processor -- start 2024-05-12T10:50:00.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b8c00640 1 -- start start 2024-05-12T10:50:00.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b8c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40c83b0 0x7f71b4163710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:00.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b8c00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71b40c8cc0 0x7f71b416aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:00.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b8c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71b40c9c10 con 0x7f71b415a380 2024-05-12T10:50:00.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b8c00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f71b40c9ef0 con 0x7f71b40c8cc0 2024-05-12T10:50:00.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b8c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f71b40734d0 con 0x7f71b40c83b0 2024-05-12T10:50:00.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b2800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71b40c8cc0 0x7f71b416aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:00.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b2800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71b40c8cc0 0x7f71b416aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60382/0 (socket says 172.21.15.115:60382) 2024-05-12T10:50:00.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b2800640 1 -- 172.21.15.115:0/2044569313 learned_addr learned my addr 172.21.15.115:0/2044569313 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:00.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b1400640 1 --2- 172.21.15.115:0/2044569313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40c83b0 0x7f71b4163710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:00.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b2800640 1 -- 172.21.15.115:0/2044569313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40c83b0 msgr2=0x7f71b4163710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:00.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b2800640 1 --2- 172.21.15.115:0/2044569313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40c83b0 0x7f71b4163710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:00.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b2800640 1 -- 172.21.15.115:0/2044569313 >> v1:172.21.15.134:6789/0 conn(0x7f71b415a380 legacy=0x7f71b4070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:00.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b2800640 1 -- 172.21.15.115:0/2044569313 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b40737b0 con 0x7f71b40c8cc0 2024-05-12T10:50:00.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.813+0000 7f71b1400640 1 --2- 172.21.15.115:0/2044569313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40c83b0 0x7f71b4163710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:00.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b2800640 1 --2- 172.21.15.115:0/2044569313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b40c8cc0 0x7f71b416aa40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009e50 tx=0x7f71ac01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9eaa4356ff1734 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b0a00640 1 -- 172.21.15.115:0/2044569313 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0b4070 con 0x7f71b40c8cc0 2024-05-12T10:50:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b0a00640 1 -- 172.21.15.115:0/2044569313 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71ac0af400 con 0x7f71b40c8cc0 2024-05-12T10:50:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b0a00640 1 -- 172.21.15.115:0/2044569313 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0af7d0 con 0x7f71b40c8cc0 2024-05-12T10:50:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b8c00640 1 -- 172.21.15.115:0/2044569313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b40c8cc0 msgr2=0x7f71b416aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b8c00640 1 --2- 172.21.15.115:0/2044569313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b40c8cc0 0x7f71b416aa40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009e50 tx=0x7f71ac01f210 comp rx=0 tx=0).stop 2024-05-12T10:50:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b8c00640 1 -- 172.21.15.115:0/2044569313 shutdown_connections 2024-05-12T10:50:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b8c00640 1 --2- 172.21.15.115:0/2044569313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b40c8cc0 0x7f71b416aa40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b8c00640 1 --2- 172.21.15.115:0/2044569313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40c83b0 0x7f71b4163710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:00.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b8c00640 1 -- 172.21.15.115:0/2044569313 >> 172.21.15.115:0/2044569313 conn(0x7f71b40ce2c0 msgr2=0x7f71b40ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:00.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b8c00640 1 -- 172.21.15.115:0/2044569313 shutdown_connections 2024-05-12T10:50:00.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b8c00640 1 -- 172.21.15.115:0/2044569313 wait complete. 2024-05-12T10:50:00.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b8c00640 1 Processor -- start 2024-05-12T10:50:00.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.817+0000 7f71b8c00640 1 -- start start 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b8c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b40c83b0 0x7f71b41f3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b8c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b40c8cc0 0x7f71b41549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b8c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b415a380 0x7f71b4152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b8c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f71b40710d0 con 0x7f71b40c8cc0 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b8c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f71b4070f50 con 0x7f71b40c83b0 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b8c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f71b415a760 con 0x7f71b415a380 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b1400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b40c8cc0 0x7f71b41549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b1400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b40c8cc0 0x7f71b41549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60394/0 (socket says 172.21.15.115:60394) 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b1400640 1 -- 172.21.15.115:0/2647045840 learned_addr learned my addr 172.21.15.115:0/2647045840 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b1e00640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b40c83b0 0x7f71b41f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b2800640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b415a380 0x7f71b4152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b1400640 1 -- 172.21.15.115:0/2647045840 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b415a380 msgr2=0x7f71b4152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:00.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b1400640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b415a380 0x7f71b4152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:00.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b1400640 1 -- 172.21.15.115:0/2647045840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b40c83b0 msgr2=0x7f71b41f3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:00.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b1400640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b40c83b0 0x7f71b41f3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:00.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b1400640 1 -- 172.21.15.115:0/2647045840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b41f5b00 con 0x7f71b40c8cc0 2024-05-12T10:50:00.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b1400640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b40c8cc0 0x7f71b41549e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71a000c7f0 tx=0x7f71a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:00.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71aa000640 1 -- 172.21.15.115:0/2647045840 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0007a30 con 0x7f71b40c8cc0 2024-05-12T10:50:00.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71aa000640 1 -- 172.21.15.115:0/2647045840 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a0007bd0 con 0x7f71b40c8cc0 2024-05-12T10:50:00.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b8c00640 1 -- 172.21.15.115:0/2647045840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b4162600 con 0x7f71b40c8cc0 2024-05-12T10:50:00.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71aa000640 1 -- 172.21.15.115:0/2647045840 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a00113f0 con 0x7f71b40c8cc0 2024-05-12T10:50:00.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b8c00640 1 -- 172.21.15.115:0/2647045840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b4162bc0 con 0x7f71b40c8cc0 2024-05-12T10:50:00.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71b8c00640 1 -- 172.21.15.115:0/2647045840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b4069730 con 0x7f71b40c8cc0 2024-05-12T10:50:00.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.821+0000 7f71aa000640 1 -- 172.21.15.115:0/2647045840 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f71a0011590 con 0x7f71b40c8cc0 2024-05-12T10:50:00.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.825+0000 7f71aa000640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f719406f400 0x7f71940718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:00.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.825+0000 7f71aa000640 1 -- 172.21.15.115:0/2647045840 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f71a008f8b0 con 0x7f71b40c8cc0 2024-05-12T10:50:00.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.825+0000 7f71b1e00640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f719406f400 0x7f71940718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:00.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.825+0000 7f71b1e00640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f719406f400 0x7f71940718c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f71a400b810 tx=0x7f71a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:00.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:00.829+0000 7f71aa000640 1 -- 172.21.15.115:0/2647045840 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f71a0015020 con 0x7f71b40c8cc0 2024-05-12T10:50:01.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.021+0000 7f71b8c00640 1 -- 172.21.15.115:0/2647045840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71b4159ad0 con 0x7f71b40c8cc0 2024-05-12T10:50:01.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.021+0000 7f71aa000640 1 -- 172.21.15.115:0/2647045840 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6843 (secure 0 0 0) 0x7f71a008de20 con 0x7f71b40c8cc0 2024-05-12T10:50:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:01.018 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:00.646899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4321,"qdb_cluster":[4321]},"id":1}]} 2024-05-12T10:50:01.018 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 6 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 -- 172.21.15.115:0/2647045840 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f719406f400 msgr2=0x7f71940718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f719406f400 0x7f71940718c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f71a400b810 tx=0x7f71a4008040 comp rx=0 tx=0).stop 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 -- 172.21.15.115:0/2647045840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b40c8cc0 msgr2=0x7f71b41549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b40c8cc0 0x7f71b41549e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71a000c7f0 tx=0x7f71a000ccb0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 -- 172.21.15.115:0/2647045840 shutdown_connections 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f719406f400 0x7f71940718c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b415a380 0x7f71b4152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b40c8cc0 0x7f71b41549e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 --2- 172.21.15.115:0/2647045840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b40c83b0 0x7f71b41f3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 -- 172.21.15.115:0/2647045840 >> 172.21.15.115:0/2647045840 conn(0x7f71b40ce2c0 msgr2=0x7f71b40cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 -- 172.21.15.115:0/2647045840 shutdown_connections 2024-05-12T10:50:01.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.025+0000 7f71b8c00640 1 -- 172.21.15.115:0/2647045840 wait complete. 2024-05-12T10:50:01.038 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:50:01.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.177+0000 7f3b69400640 1 Processor -- start 2024-05-12T10:50:01.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.177+0000 7f3b69400640 1 -- start start 2024-05-12T10:50:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b69400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3b64159300 0x7f3b640c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b69400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3b6415c7e0 0x7f3b640c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b69400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b640ca5e0 con 0x7f3b6406d650 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b69400640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f3b640cf530 con 0x7f3b64159300 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b69400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3b640cf810 con 0x7f3b6415c7e0 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b62800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3b64159300 0x7f3b640c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b61e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3b6406d650 0x7f3b6406dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42576/0 (socket says 172.21.15.115:42576) 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b61e00640 1 -- 172.21.15.115:0/1614908404 learned_addr learned my addr 172.21.15.115:0/1614908404 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b63200640 1 --2- 172.21.15.115:0/1614908404 >> v2:172.21.15.134:3300/0 conn(0x7f3b6415c7e0 0x7f3b640c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b62800640 1 -- 172.21.15.115:0/1614908404 >> v2:172.21.15.134:3300/0 conn(0x7f3b6415c7e0 msgr2=0x7f3b640c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b62800640 1 --2- 172.21.15.115:0/1614908404 >> v2:172.21.15.134:3300/0 conn(0x7f3b6415c7e0 0x7f3b640c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b62800640 1 -- 172.21.15.115:0/1614908404 >> v1:172.21.15.115:6789/0 conn(0x7f3b6406d650 legacy=0x7f3b6406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b62800640 1 -- 172.21.15.115:0/1614908404 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b640cfaf0 con 0x7f3b64159300 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b63200640 1 --2- 172.21.15.115:0/1614908404 >> v2:172.21.15.134:3300/0 conn(0x7f3b6415c7e0 0x7f3b640c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.181+0000 7f3b61400640 1 -- 172.21.15.115:0/1614908404 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2955988965 0 0) 0x7f3b640ca5e0 con 0x7f3b6406d650 2024-05-12T10:50:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b62800640 1 --2- 172.21.15.115:0/1614908404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b64159300 0x7f3b640c9fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3b64070370 tx=0x7f3b5401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa61bf0865076b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b61400640 1 -- 172.21.15.115:0/1614908404 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b540b2070 con 0x7f3b64159300 2024-05-12T10:50:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b61400640 1 -- 172.21.15.115:0/1614908404 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b540a57f0 con 0x7f3b64159300 2024-05-12T10:50:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b61400640 1 -- 172.21.15.115:0/1614908404 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b540a5bc0 con 0x7f3b64159300 2024-05-12T10:50:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 -- 172.21.15.115:0/1614908404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b64159300 msgr2=0x7f3b640c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 --2- 172.21.15.115:0/1614908404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b64159300 0x7f3b640c9fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3b64070370 tx=0x7f3b5401c930 comp rx=0 tx=0).stop 2024-05-12T10:50:01.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 -- 172.21.15.115:0/1614908404 shutdown_connections 2024-05-12T10:50:01.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 --2- 172.21.15.115:0/1614908404 >> v2:172.21.15.134:3300/0 conn(0x7f3b6415c7e0 0x7f3b640c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 --2- 172.21.15.115:0/1614908404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b64159300 0x7f3b640c9fa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 -- 172.21.15.115:0/1614908404 >> 172.21.15.115:0/1614908404 conn(0x7f3b6406c440 msgr2=0x7f3b6406c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:01.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 -- 172.21.15.115:0/1614908404 shutdown_connections 2024-05-12T10:50:01.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 -- 172.21.15.115:0/1614908404 wait complete. 2024-05-12T10:50:01.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 Processor -- start 2024-05-12T10:50:01.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 -- start start 2024-05-12T10:50:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6406d650 0x7f3b640c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b64159300 0x7f3b640cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b6415c7e0 0x7f3b641f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6406e5d0 con 0x7f3b64159300 2024-05-12T10:50:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3b640c5790 con 0x7f3b6406d650 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.185+0000 7f3b69400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3b6406e750 con 0x7f3b6415c7e0 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b61e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b64159300 0x7f3b640cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b61e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b64159300 0x7f3b640cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60404/0 (socket says 172.21.15.115:60404) 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b61e00640 1 -- 172.21.15.115:0/2880661142 learned_addr learned my addr 172.21.15.115:0/2880661142 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b62800640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6406d650 0x7f3b640c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b63200640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b6415c7e0 0x7f3b641f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b61e00640 1 -- 172.21.15.115:0/2880661142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b6415c7e0 msgr2=0x7f3b641f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b61e00640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b6415c7e0 0x7f3b641f7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b61e00640 1 -- 172.21.15.115:0/2880661142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6406d650 msgr2=0x7f3b640c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b61e00640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6406d650 0x7f3b640c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b61e00640 1 -- 172.21.15.115:0/2880661142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b640c8760 con 0x7f3b64159300 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b61e00640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b64159300 0x7f3b640cbf80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000c460 tx=0x7f3b5000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b5aa00640 1 -- 172.21.15.115:0/2880661142 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50018070 con 0x7f3b64159300 2024-05-12T10:50:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b5aa00640 1 -- 172.21.15.115:0/2880661142 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b50007500 con 0x7f3b64159300 2024-05-12T10:50:01.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b5aa00640 1 -- 172.21.15.115:0/2880661142 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50004a30 con 0x7f3b64159300 2024-05-12T10:50:01.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b69400640 1 -- 172.21.15.115:0/2880661142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b640c6ca0 con 0x7f3b64159300 2024-05-12T10:50:01.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b69400640 1 -- 172.21.15.115:0/2880661142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b640c8d40 con 0x7f3b64159300 2024-05-12T10:50:01.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b69400640 1 -- 172.21.15.115:0/2880661142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b64069730 con 0x7f3b64159300 2024-05-12T10:50:01.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.189+0000 7f3b5aa00640 1 -- 172.21.15.115:0/2880661142 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3b50004bd0 con 0x7f3b64159300 2024-05-12T10:50:01.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.193+0000 7f3b5aa00640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3b4406f430 0x7f3b440718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.193+0000 7f3b5aa00640 1 -- 172.21.15.115:0/2880661142 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3b5008e730 con 0x7f3b64159300 2024-05-12T10:50:01.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.193+0000 7f3b62800640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3b4406f430 0x7f3b440718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.193+0000 7f3b62800640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3b4406f430 0x7f3b440718f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3b540af000 tx=0x7f3b540a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:01.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.197+0000 7f3b5aa00640 1 -- 172.21.15.115:0/2880661142 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3b5005adb0 con 0x7f3b64159300 2024-05-12T10:50:01.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.353+0000 7f3b69400640 1 -- 172.21.15.115:0/2880661142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b6406f550 con 0x7f3b64159300 2024-05-12T10:50:01.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.353+0000 7f3b5aa00640 1 -- 172.21.15.115:0/2880661142 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18563 (secure 0 0 0) 0x7f3b5005f0b0 con 0x7f3b64159300 2024-05-12T10:50:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:01.352 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":25,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:00.032222+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:50:01.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 -- 172.21.15.115:0/2880661142 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3b4406f430 msgr2=0x7f3b440718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3b4406f430 0x7f3b440718f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3b540af000 tx=0x7f3b540a7070 comp rx=0 tx=0).stop 2024-05-12T10:50:01.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 -- 172.21.15.115:0/2880661142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b64159300 msgr2=0x7f3b640cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b64159300 0x7f3b640cbf80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000c460 tx=0x7f3b5000c920 comp rx=0 tx=0).stop 2024-05-12T10:50:01.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 -- 172.21.15.115:0/2880661142 shutdown_connections 2024-05-12T10:50:01.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3b4406f430 0x7f3b440718f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b6415c7e0 0x7f3b641f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b64159300 0x7f3b640cbf80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 --2- 172.21.15.115:0/2880661142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b6406d650 0x7f3b640c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 -- 172.21.15.115:0/2880661142 >> 172.21.15.115:0/2880661142 conn(0x7f3b6406c440 msgr2=0x7f3b640cede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:01.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 -- 172.21.15.115:0/2880661142 shutdown_connections 2024-05-12T10:50:01.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.357+0000 7f3b69400640 1 -- 172.21.15.115:0/2880661142 wait complete. 2024-05-12T10:50:01.372 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:50:01.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.509+0000 7f51c7a00640 1 Processor -- start 2024-05-12T10:50:01.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.509+0000 7f51c7a00640 1 -- start start 2024-05-12T10:50:01.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c7a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f51c0152350 0x7f51c00723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c7a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51c00c5dc0 0x7f51c00ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c7a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f51c015b6e0 0x7f51c015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c7a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f51c00c9fe0 con 0x7f51c015b6e0 2024-05-12T10:50:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c7a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f51c00c8830 con 0x7f51c0152350 2024-05-12T10:50:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c7a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f51c00ca9b0 con 0x7f51c00c5dc0 2024-05-12T10:50:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c5a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f51c015b6e0 0x7f51c015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c5a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f51c015b6e0 0x7f51c015bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60406/0 (socket says 172.21.15.115:60406) 2024-05-12T10:50:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c5a00640 1 -- 172.21.15.115:0/2145554343 learned_addr learned my addr 172.21.15.115:0/2145554343 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c5000640 1 --2- 172.21.15.115:0/2145554343 >> v2:172.21.15.134:3300/0 conn(0x7f51c0152350 0x7f51c00723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51b7e00640 1 --2- 172.21.15.115:0/2145554343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51c00c5dc0 0x7f51c00ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c5a00640 1 -- 172.21.15.115:0/2145554343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51c00c5dc0 msgr2=0x7f51c00ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c5a00640 1 --2- 172.21.15.115:0/2145554343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51c00c5dc0 0x7f51c00ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c5a00640 1 -- 172.21.15.115:0/2145554343 >> v2:172.21.15.134:3300/0 conn(0x7f51c0152350 msgr2=0x7f51c00723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c5a00640 1 --2- 172.21.15.115:0/2145554343 >> v2:172.21.15.134:3300/0 conn(0x7f51c0152350 0x7f51c00723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.513+0000 7f51c5a00640 1 -- 172.21.15.115:0/2145554343 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c00c8af0 con 0x7f51c015b6e0 2024-05-12T10:50:01.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c5a00640 1 --2- 172.21.15.115:0/2145554343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51c015b6e0 0x7f51c015bb00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f51c006c670 tx=0x7f51b801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbeddba08a287272 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:01.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51bfe00640 1 -- 172.21.15.115:0/2145554343 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b80a5670 con 0x7f51c015b6e0 2024-05-12T10:50:01.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51bfe00640 1 -- 172.21.15.115:0/2145554343 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b80a5810 con 0x7f51c015b6e0 2024-05-12T10:50:01.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51bfe00640 1 -- 172.21.15.115:0/2145554343 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b80a5be0 con 0x7f51c015b6e0 2024-05-12T10:50:01.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c7a00640 1 -- 172.21.15.115:0/2145554343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51c015b6e0 msgr2=0x7f51c015bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c7a00640 1 --2- 172.21.15.115:0/2145554343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51c015b6e0 0x7f51c015bb00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f51c006c670 tx=0x7f51b801c9f0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c7a00640 1 -- 172.21.15.115:0/2145554343 shutdown_connections 2024-05-12T10:50:01.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c7a00640 1 --2- 172.21.15.115:0/2145554343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51c015b6e0 0x7f51c015bb00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c7a00640 1 --2- 172.21.15.115:0/2145554343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51c00c5dc0 0x7f51c00ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c7a00640 1 --2- 172.21.15.115:0/2145554343 >> v2:172.21.15.134:3300/0 conn(0x7f51c0152350 0x7f51c00723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c7a00640 1 -- 172.21.15.115:0/2145554343 >> 172.21.15.115:0/2145554343 conn(0x7f51c00681c0 msgr2=0x7f51c00685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c7a00640 1 -- 172.21.15.115:0/2145554343 shutdown_connections 2024-05-12T10:50:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c7a00640 1 -- 172.21.15.115:0/2145554343 wait complete. 2024-05-12T10:50:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c7a00640 1 Processor -- start 2024-05-12T10:50:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.517+0000 7f51c7a00640 1 -- start start 2024-05-12T10:50:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c7a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51c00c5dc0 0x7f51c01441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c7a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51c0152350 0x7f51c01f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c7a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51c015b6e0 0x7f51c01f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c7a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f51c00ce1f0 con 0x7f51c00c5dc0 2024-05-12T10:50:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c7a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51c015c450 con 0x7f51c015b6e0 2024-05-12T10:50:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c7a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f51c0152730 con 0x7f51c0152350 2024-05-12T10:50:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c5000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51c00c5dc0 0x7f51c01441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c5000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51c00c5dc0 0x7f51c01441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60422/0 (socket says 172.21.15.115:60422) 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c5000640 1 -- 172.21.15.115:0/2809812898 learned_addr learned my addr 172.21.15.115:0/2809812898 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c5a00640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51c015b6e0 0x7f51c01f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51b7e00640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51c0152350 0x7f51c01f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c5000640 1 -- 172.21.15.115:0/2809812898 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51c0152350 msgr2=0x7f51c01f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c5000640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51c0152350 0x7f51c01f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c5000640 1 -- 172.21.15.115:0/2809812898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51c015b6e0 msgr2=0x7f51c01f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c5000640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51c015b6e0 0x7f51c01f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c5000640 1 -- 172.21.15.115:0/2809812898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c0072e50 con 0x7f51c00c5dc0 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c5000640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51c00c5dc0 0x7f51c01441e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f51b000d5f0 tx=0x7f51b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51bd600640 1 -- 172.21.15.115:0/2809812898 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b00125f0 con 0x7f51c00c5dc0 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51bd600640 1 -- 172.21.15.115:0/2809812898 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b0019070 con 0x7f51c00c5dc0 2024-05-12T10:50:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51bd600640 1 -- 172.21.15.115:0/2809812898 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b00129b0 con 0x7f51c00c5dc0 2024-05-12T10:50:01.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c7a00640 1 -- 172.21.15.115:0/2809812898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c00cb510 con 0x7f51c00c5dc0 2024-05-12T10:50:01.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c7a00640 1 -- 172.21.15.115:0/2809812898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c0162600 con 0x7f51c00c5dc0 2024-05-12T10:50:01.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51c7a00640 1 -- 172.21.15.115:0/2809812898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c0069730 con 0x7f51c00c5dc0 2024-05-12T10:50:01.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.521+0000 7f51bd600640 1 -- 172.21.15.115:0/2809812898 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f51b0012b50 con 0x7f51c00c5dc0 2024-05-12T10:50:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.525+0000 7f51bd600640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f519c06f400 0x7f519c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.525+0000 7f51bd600640 1 -- 172.21.15.115:0/2809812898 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f51b008f920 con 0x7f51c00c5dc0 2024-05-12T10:50:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.525+0000 7f51b7e00640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f519c06f400 0x7f519c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.525+0000 7f51b7e00640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f519c06f400 0x7f519c0718c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f51c006a090 tx=0x7f51a8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:01.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.529+0000 7f51bd600640 1 -- 172.21.15.115:0/2809812898 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f51b005c550 con 0x7f51c00c5dc0 2024-05-12T10:50:01.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.693+0000 7f51c7a00640 1 -- 172.21.15.115:0/2809812898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51c00cbaf0 con 0x7f51c00c5dc0 2024-05-12T10:50:01.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.693+0000 7f51bd600640 1 -- 172.21.15.115:0/2809812898 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f51b005be50 con 0x7f51c00c5dc0 2024-05-12T10:50:01.689 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:01.689 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:01.648279+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:50:01.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.693+0000 7f51c7a00640 1 -- 172.21.15.115:0/2809812898 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f519c06f400 msgr2=0x7f519c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.693+0000 7f51c7a00640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f519c06f400 0x7f519c0718c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f51c006a090 tx=0x7f51a8008040 comp rx=0 tx=0).stop 2024-05-12T10:50:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.693+0000 7f51c7a00640 1 -- 172.21.15.115:0/2809812898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51c00c5dc0 msgr2=0x7f51c01441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.693+0000 7f51c7a00640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51c00c5dc0 0x7f51c01441e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f51b000d5f0 tx=0x7f51b000dab0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.693+0000 7f51c7a00640 1 -- 172.21.15.115:0/2809812898 shutdown_connections 2024-05-12T10:50:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.697+0000 7f51c7a00640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f519c06f400 0x7f519c0718c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.697+0000 7f51c7a00640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51c015b6e0 0x7f51c01f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.697+0000 7f51c7a00640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51c0152350 0x7f51c01f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.697+0000 7f51c7a00640 1 --2- 172.21.15.115:0/2809812898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51c00c5dc0 0x7f51c01441e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.697+0000 7f51c7a00640 1 -- 172.21.15.115:0/2809812898 >> 172.21.15.115:0/2809812898 conn(0x7f51c00681c0 msgr2=0x7f51c00c4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.697+0000 7f51c7a00640 1 -- 172.21.15.115:0/2809812898 shutdown_connections 2024-05-12T10:50:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.697+0000 7f51c7a00640 1 -- 172.21.15.115:0/2809812898 wait complete. 2024-05-12T10:50:01.725 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:50:01.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9243a00640 1 Processor -- start 2024-05-12T10:50:01.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9243a00640 1 -- start start 2024-05-12T10:50:01.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9243a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f923c155d90 0x7f923c068250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9243a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923c0cb5e0 con 0x7f923c0c9450 2024-05-12T10:50:01.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9243a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923c1600e0 con 0x7f923c156170 2024-05-12T10:50:01.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9243a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f923c0cc4b0 con 0x7f923c155d90 2024-05-12T10:50:01.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9241000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f923c155d90 0x7f923c068250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9241a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f923c0c9450 0x7f923c15f2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42580/0 (socket says 172.21.15.115:42580) 2024-05-12T10:50:01.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9241a00640 1 -- 172.21.15.115:0/225040382 learned_addr learned my addr 172.21.15.115:0/225040382 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:01.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9241000640 1 -- 172.21.15.115:0/225040382 >> v1:172.21.15.134:6789/0 conn(0x7f923c156170 legacy=0x7f923c0c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9241000640 1 -- 172.21.15.115:0/225040382 >> v1:172.21.15.115:6789/0 conn(0x7f923c0c9450 legacy=0x7f923c15f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f9241000640 1 -- 172.21.15.115:0/225040382 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923c0cc700 con 0x7f923c155d90 2024-05-12T10:50:01.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.865+0000 7f923b400640 1 -- 172.21.15.115:0/225040382 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386608354 0 0) 0x7f923c0cb5e0 con 0x7f923c0c9450 2024-05-12T10:50:01.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.869+0000 7f9241000640 1 --2- 172.21.15.115:0/225040382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f923c155d90 0x7f923c068250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f922c0097c0 tx=0x7f922c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ba69f0f41aa75c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:01.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.869+0000 7f923b400640 1 -- 172.21.15.115:0/225040382 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c0b5070 con 0x7f923c155d90 2024-05-12T10:50:01.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.869+0000 7f923b400640 1 -- 172.21.15.115:0/225040382 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c0a8990 con 0x7f923c155d90 2024-05-12T10:50:01.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.869+0000 7f923b400640 1 -- 172.21.15.115:0/225040382 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c0a8d60 con 0x7f923c155d90 2024-05-12T10:50:01.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.869+0000 7f9243a00640 1 -- 172.21.15.115:0/225040382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f923c155d90 msgr2=0x7f923c068250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.869+0000 7f9243a00640 1 --2- 172.21.15.115:0/225040382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f923c155d90 0x7f923c068250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f922c0097c0 tx=0x7f922c01ec90 comp rx=0 tx=0).stop 2024-05-12T10:50:01.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.869+0000 7f9243a00640 1 -- 172.21.15.115:0/225040382 shutdown_connections 2024-05-12T10:50:01.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.869+0000 7f9243a00640 1 --2- 172.21.15.115:0/225040382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f923c155d90 0x7f923c068250 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.869+0000 7f9243a00640 1 -- 172.21.15.115:0/225040382 >> 172.21.15.115:0/225040382 conn(0x7f923c0ca7a0 msgr2=0x7f923c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:01.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.869+0000 7f9243a00640 1 -- 172.21.15.115:0/225040382 shutdown_connections 2024-05-12T10:50:01.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.869+0000 7f9243a00640 1 -- 172.21.15.115:0/225040382 wait complete. 2024-05-12T10:50:01.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9243a00640 1 Processor -- start 2024-05-12T10:50:01.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9243a00640 1 -- start start 2024-05-12T10:50:01.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9243a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c0c9450 0x7f923c1f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9243a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f923c155d90 0x7f923c151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9243a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f923c156170 0x7f923c1f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9243a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f923c15fa00 con 0x7f923c156170 2024-05-12T10:50:01.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9243a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f923c0c8820 con 0x7f923c0c9450 2024-05-12T10:50:01.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9243a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f923c15fb80 con 0x7f923c155d90 2024-05-12T10:50:01.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9241a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f923c156170 0x7f923c1f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9241a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f923c156170 0x7f923c1f2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60432/0 (socket says 172.21.15.115:60432) 2024-05-12T10:50:01.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9241a00640 1 -- 172.21.15.115:0/1127717051 learned_addr learned my addr 172.21.15.115:0/1127717051 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:01.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9241000640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c0c9450 0x7f923c1f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f923be00640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f923c155d90 0x7f923c151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9241a00640 1 -- 172.21.15.115:0/1127717051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f923c155d90 msgr2=0x7f923c151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9241a00640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f923c155d90 0x7f923c151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9241a00640 1 -- 172.21.15.115:0/1127717051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c0c9450 msgr2=0x7f923c1f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:01.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9241a00640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c0c9450 0x7f923c1f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:01.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9241a00640 1 -- 172.21.15.115:0/1127717051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923c1f5d60 con 0x7f923c156170 2024-05-12T10:50:01.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9241000640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c0c9450 0x7f923c1f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:01.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9241a00640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f923c156170 0x7f923c1f2140 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f923400c7d0 tx=0x7f923400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:01.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9238c00640 1 -- 172.21.15.115:0/1127717051 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9234018070 con 0x7f923c156170 2024-05-12T10:50:01.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9238c00640 1 -- 172.21.15.115:0/1127717051 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923400a640 con 0x7f923c156170 2024-05-12T10:50:01.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9238c00640 1 -- 172.21.15.115:0/1127717051 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923400aa30 con 0x7f923c156170 2024-05-12T10:50:01.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9243a00640 1 -- 172.21.15.115:0/1127717051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923c074880 con 0x7f923c156170 2024-05-12T10:50:01.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9243a00640 1 -- 172.21.15.115:0/1127717051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f923c0741d0 con 0x7f923c156170 2024-05-12T10:50:01.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.873+0000 7f9243a00640 1 -- 172.21.15.115:0/1127717051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f923c069730 con 0x7f923c156170 2024-05-12T10:50:01.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.877+0000 7f9238c00640 1 -- 172.21.15.115:0/1127717051 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f923400abd0 con 0x7f923c156170 2024-05-12T10:50:01.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.877+0000 7f9238c00640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f921c06f400 0x7f921c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:01.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.877+0000 7f9238c00640 1 -- 172.21.15.115:0/1127717051 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f923408ebc0 con 0x7f923c156170 2024-05-12T10:50:01.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.877+0000 7f9241000640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f921c06f400 0x7f921c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:01.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.877+0000 7f9241000640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f921c06f400 0x7f921c0718c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f922c0b2000 tx=0x7f922c0aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:01.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:01.881+0000 7f9238c00640 1 -- 172.21.15.115:0/1127717051 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f923405b7f0 con 0x7f923c156170 2024-05-12T10:50:02.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 -- 172.21.15.115:0/1127717051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f923c070000 con 0x7f923c156170 2024-05-12T10:50:02.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9238c00640 1 -- 172.21.15.115:0/1127717051 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6843 (secure 0 0 0) 0x7f923405b0f0 con 0x7f923c156170 2024-05-12T10:50:02.069 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:02.069 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:00.646899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4321,"qdb_cluster":[4321]},"id":1}]} 2024-05-12T10:50:02.069 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 6 2024-05-12T10:50:02.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 -- 172.21.15.115:0/1127717051 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f921c06f400 msgr2=0x7f921c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:02.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f921c06f400 0x7f921c0718c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f922c0b2000 tx=0x7f922c0aa070 comp rx=0 tx=0).stop 2024-05-12T10:50:02.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 -- 172.21.15.115:0/1127717051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f923c156170 msgr2=0x7f923c1f2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:02.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f923c156170 0x7f923c1f2140 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f923400c7d0 tx=0x7f923400cc90 comp rx=0 tx=0).stop 2024-05-12T10:50:02.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 -- 172.21.15.115:0/1127717051 shutdown_connections 2024-05-12T10:50:02.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f921c06f400 0x7f921c0718c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f923c156170 0x7f923c1f2140 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f923c155d90 0x7f923c151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 --2- 172.21.15.115:0/1127717051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c0c9450 0x7f923c1f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 -- 172.21.15.115:0/1127717051 >> 172.21.15.115:0/1127717051 conn(0x7f923c0ca7a0 msgr2=0x7f923c0c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:02.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 -- 172.21.15.115:0/1127717051 shutdown_connections 2024-05-12T10:50:02.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.073+0000 7f9243a00640 1 -- 172.21.15.115:0/1127717051 wait complete. 2024-05-12T10:50:02.090 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:50:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f4190000640 1 Processor -- start 2024-05-12T10:50:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f4190000640 1 -- start start 2024-05-12T10:50:02.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f4190000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4188155f20 0x7f41880c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:02.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f4190000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41880c9950 0x7f418815f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:02.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f4190000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f41880723c0 0x7f41880c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:02.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f4190000640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f41880c9710 con 0x7f41880723c0 2024-05-12T10:50:02.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f4190000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f418815bc20 con 0x7f4188155f20 2024-05-12T10:50:02.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f4190000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f41880c8200 con 0x7f41880c9950 2024-05-12T10:50:02.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f418e000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f41880723c0 0x7f41880c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:02.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f418e000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f41880723c0 0x7f41880c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57326/0 (socket says 172.21.15.115:57326) 2024-05-12T10:50:02.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f418e000640 1 -- 172.21.15.115:0/712161716 learned_addr learned my addr 172.21.15.115:0/712161716 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:02.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f418d600640 1 --2- 172.21.15.115:0/712161716 >> v2:172.21.15.134:3300/0 conn(0x7f4188155f20 0x7f41880c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:02.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f418cc00640 1 --2- 172.21.15.115:0/712161716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41880c9950 0x7f418815f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:02.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f418e000640 1 -- 172.21.15.115:0/712161716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41880c9950 msgr2=0x7f418815f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:02.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.229+0000 7f418e000640 1 --2- 172.21.15.115:0/712161716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41880c9950 0x7f418815f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f418e000640 1 -- 172.21.15.115:0/712161716 >> v2:172.21.15.134:3300/0 conn(0x7f4188155f20 msgr2=0x7f41880c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:02.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f418e000640 1 --2- 172.21.15.115:0/712161716 >> v2:172.21.15.134:3300/0 conn(0x7f4188155f20 0x7f41880c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f418e000640 1 -- 172.21.15.115:0/712161716 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41880c84e0 con 0x7f41880723c0 2024-05-12T10:50:02.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f418e000640 1 --2- 172.21.15.115:0/712161716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41880723c0 0x7f41880c88c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f418806f060 tx=0x7f418001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3a8558b12828d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:02.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4187e00640 1 -- 172.21.15.115:0/712161716 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800b0070 con 0x7f41880723c0 2024-05-12T10:50:02.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4187e00640 1 -- 172.21.15.115:0/712161716 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41800ab600 con 0x7f41880723c0 2024-05-12T10:50:02.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4187e00640 1 -- 172.21.15.115:0/712161716 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800ab9d0 con 0x7f41880723c0 2024-05-12T10:50:02.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4190000640 1 -- 172.21.15.115:0/712161716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41880723c0 msgr2=0x7f41880c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:02.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4190000640 1 --2- 172.21.15.115:0/712161716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41880723c0 0x7f41880c88c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f418806f060 tx=0x7f418001c460 comp rx=0 tx=0).stop 2024-05-12T10:50:02.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4190000640 1 -- 172.21.15.115:0/712161716 shutdown_connections 2024-05-12T10:50:02.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4190000640 1 --2- 172.21.15.115:0/712161716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41880723c0 0x7f41880c88c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4190000640 1 --2- 172.21.15.115:0/712161716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41880c9950 0x7f418815f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4190000640 1 --2- 172.21.15.115:0/712161716 >> v2:172.21.15.134:3300/0 conn(0x7f4188155f20 0x7f41880c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4190000640 1 -- 172.21.15.115:0/712161716 >> 172.21.15.115:0/712161716 conn(0x7f41880681c0 msgr2=0x7f41880685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:02.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4190000640 1 -- 172.21.15.115:0/712161716 shutdown_connections 2024-05-12T10:50:02.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.233+0000 7f4190000640 1 -- 172.21.15.115:0/712161716 wait complete. 2024-05-12T10:50:02.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4190000640 1 Processor -- start 2024-05-12T10:50:02.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4190000640 1 -- start start 2024-05-12T10:50:02.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4190000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41880723c0 0x7f41881f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:02.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4190000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41880c9950 0x7f4188154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:02.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4190000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4188155f20 0x7f41881485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:02.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4190000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f418815f6f0 con 0x7f4188155f20 2024-05-12T10:50:02.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4190000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4188156300 con 0x7f41880c9950 2024-05-12T10:50:02.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4190000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f418815c9c0 con 0x7f41880723c0 2024-05-12T10:50:02.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418e000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4188155f20 0x7f41881485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:02.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418e000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4188155f20 0x7f41881485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57342/0 (socket says 172.21.15.115:57342) 2024-05-12T10:50:02.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418e000640 1 -- 172.21.15.115:0/1205788902 learned_addr learned my addr 172.21.15.115:0/1205788902 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:02.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418d600640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41880723c0 0x7f41881f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:02.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418cc00640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41880c9950 0x7f4188154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:02.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418e000640 1 -- 172.21.15.115:0/1205788902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41880723c0 msgr2=0x7f41881f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:02.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418e000640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41880723c0 0x7f41881f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418e000640 1 -- 172.21.15.115:0/1205788902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41880c9950 msgr2=0x7f4188154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:02.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418e000640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41880c9950 0x7f4188154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418e000640 1 -- 172.21.15.115:0/1205788902 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418814bed0 con 0x7f4188155f20 2024-05-12T10:50:02.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418cc00640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41880c9950 0x7f4188154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:02.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f418e000640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4188155f20 0x7f41881485b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f41800ae040 tx=0x7f4180019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:02.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4185600640 1 -- 172.21.15.115:0/1205788902 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800b0040 con 0x7f4188155f20 2024-05-12T10:50:02.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4185600640 1 -- 172.21.15.115:0/1205788902 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41800ba070 con 0x7f4188155f20 2024-05-12T10:50:02.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4185600640 1 -- 172.21.15.115:0/1205788902 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800b4630 con 0x7f4188155f20 2024-05-12T10:50:02.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4190000640 1 -- 172.21.15.115:0/1205788902 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418814c1b0 con 0x7f4188155f20 2024-05-12T10:50:02.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.237+0000 7f4190000640 1 -- 172.21.15.115:0/1205788902 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41881f4fa0 con 0x7f4188155f20 2024-05-12T10:50:02.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.241+0000 7f4190000640 1 -- 172.21.15.115:0/1205788902 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41881f4ab0 con 0x7f4188155f20 2024-05-12T10:50:02.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.241+0000 7f4185600640 1 -- 172.21.15.115:0/1205788902 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f41800b47d0 con 0x7f4188155f20 2024-05-12T10:50:02.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.241+0000 7f4185600640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f416806f400 0x7f41680718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:02.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.241+0000 7f4185600640 1 -- 172.21.15.115:0/1205788902 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f41801291d0 con 0x7f4188155f20 2024-05-12T10:50:02.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.241+0000 7f418d600640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f416806f400 0x7f41680718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:02.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.245+0000 7f418d600640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f416806f400 0x7f41680718c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f417c0113e0 tx=0x7f417c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:02.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.245+0000 7f4185600640 1 -- 172.21.15.115:0/1205788902 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4180016110 con 0x7f4188155f20 2024-05-12T10:50:02.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 -- 172.21.15.115:0/1205788902 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4188069730 con 0x7f4188155f20 2024-05-12T10:50:02.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4185600640 1 -- 172.21.15.115:0/1205788902 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f41800f5ce0 con 0x7f4188155f20 2024-05-12T10:50:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:02.401 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:01.648279+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:50:02.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 -- 172.21.15.115:0/1205788902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f416806f400 msgr2=0x7f41680718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:02.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f416806f400 0x7f41680718c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f417c0113e0 tx=0x7f417c00b040 comp rx=0 tx=0).stop 2024-05-12T10:50:02.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 -- 172.21.15.115:0/1205788902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4188155f20 msgr2=0x7f41881485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:02.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4188155f20 0x7f41881485b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f41800ae040 tx=0x7f4180019200 comp rx=0 tx=0).stop 2024-05-12T10:50:02.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 -- 172.21.15.115:0/1205788902 shutdown_connections 2024-05-12T10:50:02.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f416806f400 0x7f41680718c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4188155f20 0x7f41881485b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41880c9950 0x7f4188154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 --2- 172.21.15.115:0/1205788902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41880723c0 0x7f41881f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:02.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 -- 172.21.15.115:0/1205788902 >> 172.21.15.115:0/1205788902 conn(0x7f41880681c0 msgr2=0x7f418813f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:02.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.405+0000 7f4190000640 1 -- 172.21.15.115:0/1205788902 shutdown_connections 2024-05-12T10:50:02.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:02.409+0000 7f4190000640 1 -- 172.21.15.115:0/1205788902 wait complete. 2024-05-12T10:50:03.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-12T10:49:54.988983+0000', 'modified': '2024-05-12T10:50:00.646899+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4321}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4321': {'gid': 4321, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6835/1447701149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 1447701149}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 1447701149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4321, 'qdb_cluster': [4321]} 2024-05-12T10:50:03.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-12T10:50:03.027 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-12T10:50:03.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f567ce00640 1 Processor -- start 2024-05-12T10:50:03.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f567ce00640 1 -- start start 2024-05-12T10:50:03.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f567ce00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f567815a7b0 0x7f56780c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f567ce00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5678071b80 con 0x7f5678153e60 2024-05-12T10:50:03.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f567ce00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5678071100 con 0x7f56780ca470 2024-05-12T10:50:03.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f567ce00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f56780716c0 con 0x7f567815a7b0 2024-05-12T10:50:03.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5675e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5678153e60 0x7f56780cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53808/0 (socket says 172.21.15.115:53808) 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5675e00640 1 -- 172.21.15.115:0/59545201 learned_addr learned my addr 172.21.15.115:0/59545201 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5675400640 1 --2- 172.21.15.115:0/59545201 >> v2:172.21.15.134:3300/0 conn(0x7f567815a7b0 0x7f56780c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481477016 0 0) 0x7f5678071b80 con 0x7f5678153e60 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f565c003530 con 0x7f5678153e60 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848583245 0 0) 0x7f5678071100 con 0x7f56780ca470 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5678071b80 con 0x7f56780ca470 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 697346670 0 0) 0x7f565c003530 con 0x7f5678153e60 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 >> v2:172.21.15.134:3300/0 conn(0x7f567815a7b0 msgr2=0x7f56780c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 --2- 172.21.15.115:0/59545201 >> v2:172.21.15.134:3300/0 conn(0x7f567815a7b0 0x7f56780c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 >> v1:172.21.15.134:6789/0 conn(0x7f56780ca470 legacy=0x7f56780c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56780713e0 con 0x7f5678153e60 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f5668001a80 con 0x7f5678153e60 2024-05-12T10:50:03.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 >> v1:172.21.15.115:6789/0 conn(0x7f5678153e60 legacy=0x7f56780cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 0x7f565c004090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565c004810 0x7f565c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f565c005240 0x7f565c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f56780716c0 con 0x7f565c003c90 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f565c00c1a0 con 0x7f565c004810 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f565c00c3a0 con 0x7f565c005240 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5675e00640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 0x7f565c004090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5676800640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f565c005240 0x7f565c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5675e00640 1 -- 172.21.15.115:0/59545201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f565c005240 msgr2=0x7f565c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5675400640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565c004810 0x7f565c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5675e00640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f565c005240 0x7f565c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5675e00640 1 -- 172.21.15.115:0/59545201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565c004810 msgr2=0x7f565c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5675e00640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565c004810 0x7f565c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5675e00640 1 -- 172.21.15.115:0/59545201 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565c003530 con 0x7f565c003c90 2024-05-12T10:50:03.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5676800640 1 -- 172.21.15.115:0/59545201 reap_dead start 2024-05-12T10:50:03.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.169+0000 7f5675400640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565c004810 0x7f565c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:03.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.173+0000 7f5675e00640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 0x7f565c004090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f566800a770 tx=0x7f566801d1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a75cbf64d88173 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:03.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.173+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566800a390 con 0x7f565c003c90 2024-05-12T10:50:03.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.173+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56680ad650 con 0x7f565c003c90 2024-05-12T10:50:03.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.173+0000 7f5674a00640 1 -- 172.21.15.115:0/59545201 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56680ada40 con 0x7f565c003c90 2024-05-12T10:50:03.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.173+0000 7f567ce00640 1 -- 172.21.15.115:0/59545201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 msgr2=0x7f565c004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:03.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.173+0000 7f567ce00640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 0x7f565c004090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f566800a770 tx=0x7f566801d1b0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.173+0000 7f567ce00640 1 -- 172.21.15.115:0/59545201 shutdown_connections 2024-05-12T10:50:03.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.173+0000 7f567ce00640 1 --2- 172.21.15.115:0/59545201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 0x7f565c004090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.173+0000 7f567ce00640 1 -- 172.21.15.115:0/59545201 >> 172.21.15.115:0/59545201 conn(0x7f567806c440 msgr2=0x7f567806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:03.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.173+0000 7f567ce00640 1 -- 172.21.15.115:0/59545201 shutdown_connections 2024-05-12T10:50:03.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.173+0000 7f567ce00640 1 -- 172.21.15.115:0/59545201 wait complete. 2024-05-12T10:50:03.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f567ce00640 1 Processor -- start 2024-05-12T10:50:03.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f567ce00640 1 -- start start 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f567ce00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 0x7f567814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f567ce00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56780c9760 0x7f567814ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f567ce00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56780c79a0 0x7f56780c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f567ce00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f56780c4d60 con 0x7f565c003c90 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f567ce00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5678154240 con 0x7f56780c9760 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f567ce00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f56780cb450 con 0x7f56780c79a0 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f5675e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 0x7f567814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f5675e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 0x7f567814a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57362/0 (socket says 172.21.15.115:57362) 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f5675e00640 1 -- 172.21.15.115:0/4265600705 learned_addr learned my addr 172.21.15.115:0/4265600705 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f5675400640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56780c9760 0x7f567814ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f5676800640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56780c79a0 0x7f56780c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f5675e00640 1 -- 172.21.15.115:0/4265600705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56780c79a0 msgr2=0x7f56780c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f5675e00640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56780c79a0 0x7f56780c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f5675e00640 1 -- 172.21.15.115:0/4265600705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56780c9760 msgr2=0x7f567814ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f5675e00640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56780c9760 0x7f567814ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f5675e00640 1 -- 172.21.15.115:0/4265600705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56780c8370 con 0x7f565c003c90 2024-05-12T10:50:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f5675e00640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 0x7f567814a0f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f566801b8b0 tx=0x7f565c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f566e000640 1 -- 172.21.15.115:0/4265600705 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668001880 con 0x7f565c003c90 2024-05-12T10:50:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f566e000640 1 -- 172.21.15.115:0/4265600705 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5668001a20 con 0x7f565c003c90 2024-05-12T10:50:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f566e000640 1 -- 172.21.15.115:0/4265600705 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56680ada00 con 0x7f565c003c90 2024-05-12T10:50:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f567ce00640 1 -- 172.21.15.115:0/4265600705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56780c72a0 con 0x7f565c003c90 2024-05-12T10:50:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.177+0000 7f567ce00640 1 -- 172.21.15.115:0/4265600705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56780cd970 con 0x7f565c003c90 2024-05-12T10:50:03.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.181+0000 7f566e000640 1 -- 172.21.15.115:0/4265600705 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f56680ad4f0 con 0x7f565c003c90 2024-05-12T10:50:03.178 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.181+0000 7f566e000640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f565806f430 0x7f56580718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.178 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.181+0000 7f566e000640 1 -- 172.21.15.115:0/4265600705 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5668129170 con 0x7f565c003c90 2024-05-12T10:50:03.178 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.181+0000 7f5675400640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f565806f430 0x7f56580718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.178 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.181+0000 7f56802f2000 1 Processor -- start 2024-05-12T10:50:03.178 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.181+0000 7f56802f2000 1 -- start start 2024-05-12T10:50:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.181+0000 7f5675400640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f565806f430 0x7f56580718f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f567815e1f0 tx=0x7f5664008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.181+0000 7f56802f2000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae18a0 0x559086ae1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.181+0000 7f56802f2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086ae25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.181+0000 7f56802f2000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae2ae0 0x559086aecb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.181+0000 7f56802f2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559086987600 con 0x559086ae21c0 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5590868a2720 con 0x559086ae2ae0 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5590868f0070 con 0x559086ae18a0 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086ae25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086ae25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57372/0 (socket says 172.21.15.115:57372) 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675400640 1 -- 172.21.15.115:0/3891235117 learned_addr learned my addr 172.21.15.115:0/3891235117 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675e00640 1 --2- 172.21.15.115:0/3891235117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae18a0 0x559086ae1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5676800640 1 --2- 172.21.15.115:0/3891235117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae2ae0 0x559086aecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675400640 1 -- 172.21.15.115:0/3891235117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae18a0 msgr2=0x559086ae1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675400640 1 --2- 172.21.15.115:0/3891235117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae18a0 0x559086ae1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675400640 1 -- 172.21.15.115:0/3891235117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae2ae0 msgr2=0x559086aecb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675400640 1 --2- 172.21.15.115:0/3891235117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae2ae0 0x559086aecb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675400640 1 -- 172.21.15.115:0/3891235117 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559086a84080 con 0x559086ae21c0 2024-05-12T10:50:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675400640 1 --2- 172.21.15.115:0/3891235117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086ae25a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5664004350 tx=0x7f5664015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85b8c9e836e7b33 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:03.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5662a00640 1 -- 172.21.15.115:0/3891235117 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5664028070 con 0x559086ae21c0 2024-05-12T10:50:03.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5662a00640 1 -- 172.21.15.115:0/3891235117 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566401e050 con 0x559086ae21c0 2024-05-12T10:50:03.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5662a00640 1 -- 172.21.15.115:0/3891235117 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566400f040 con 0x559086ae21c0 2024-05-12T10:50:03.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 -- 172.21.15.115:0/3891235117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 msgr2=0x559086ae25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:03.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 --2- 172.21.15.115:0/3891235117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086ae25a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5664004350 tx=0x7f5664015000 comp rx=0 tx=0).stop 2024-05-12T10:50:03.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 -- 172.21.15.115:0/3891235117 shutdown_connections 2024-05-12T10:50:03.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 --2- 172.21.15.115:0/3891235117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae2ae0 0x559086aecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 --2- 172.21.15.115:0/3891235117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086ae25a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 --2- 172.21.15.115:0/3891235117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae18a0 0x559086ae1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 -- 172.21.15.115:0/3891235117 >> 172.21.15.115:0/3891235117 conn(0x559086add650 msgr2=0x559086adfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 -- 172.21.15.115:0/3891235117 shutdown_connections 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 -- 172.21.15.115:0/3891235117 wait complete. 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 -- start start 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 Processor -- start 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086aa5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae21c0 0x559086aa6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae2ae0 0x559086aa1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5590868ec030 con 0x559086ae18a0 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5590868a8ea0 con 0x559086ae21c0 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55908688fc70 con 0x559086ae2ae0 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f56802f2000 10 client.0 _ll_register_callbacks cb 0x559086a8be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086aa5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086aa5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57382/0 (socket says 172.21.15.115:57382) 2024-05-12T10:50:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.185+0000 7f5675e00640 1 -- 172.21.15.115:0/4259175156 learned_addr learned my addr 172.21.15.115:0/4259175156 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5676800640 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae2ae0 0x559086aa1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5675400640 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae21c0 0x559086aa6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5675e00640 1 -- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae2ae0 msgr2=0x559086aa1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5675e00640 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae2ae0 0x559086aa1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5675e00640 1 -- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae21c0 msgr2=0x559086aa6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5675e00640 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae21c0 0x559086aa6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5675e00640 1 -- 172.21.15.115:0/4259175156 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55908699a6d0 con 0x559086ae18a0 2024-05-12T10:50:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5675e00640 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086aa5de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f566800a770 tx=0x7f56680f4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d122b72337e9342 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5657400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5657400640 1 -- 172.21.15.115:0/4259175156 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56680bc040 con 0x559086ae18a0 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5657400640 1 -- 172.21.15.115:0/4259175156 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f56680fdf50 con 0x559086ae18a0 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f56802f2000 1 -- 172.21.15.115:0/4259175156 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f566401e050 con 0x559086ae18a0 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5657400640 1 -- 172.21.15.115:0/4259175156 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f56680f5c80 con 0x559086ae18a0 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f56802f2000 10 client.4389 fetch_fsmap learned FSMap version 6 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f56802f2000 1 -- 172.21.15.115:0/4259175156 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x559086996680 con 0x559086ae18a0 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5657400640 1 -- 172.21.15.115:0/4259175156 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566401e050 con 0x559086ae18a0 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5657400640 1 -- 172.21.15.115:0/4259175156 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f56680bf060 con 0x559086ae18a0 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f56802f2000 10 client.4389 fetch_fsmap finished waiting for FSMap version 6 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f56802f2000 10 client.4389 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f56802f2000 20 client.4389 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f56802f2000 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086af5290 0x559086af7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f56802f2000 4 client.4389 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:50:03.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f56802f2000 1 -- 172.21.15.115:0/4259175156 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559086888bc0 con 0x559086af5290 2024-05-12T10:50:03.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5675400640 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086af5290 0x559086af7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:03.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5675400640 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086af5290 0x559086af7680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f772373af950ddf server_cookie=f259f0ba14328e7e in_seq=0 out_seq=0 2024-05-12T10:50:03.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:03.189+0000 7f5657400640 10 client.4389 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:05.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f5657400640 1 -- 172.21.15.115:0/4259175156 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559086888bc0 con 0x559086af5290 2024-05-12T10:50:05.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f5657400640 10 client.4389 handle_command_reply: tid=0 2024-05-12T10:50:05.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 1 client.4389 shutdown 2024-05-12T10:50:05.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 1 -- 172.21.15.115:0/4259175156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 msgr2=0x559086aa5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086aa5de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f566800a770 tx=0x7f56680f4f90 comp rx=0 tx=0).stop 2024-05-12T10:50:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 1 -- 172.21.15.115:0/4259175156 shutdown_connections 2024-05-12T10:50:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae2ae0 0x559086aa1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086af5290 0x559086af7680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae21c0 0x559086aa6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 1 --2- 172.21.15.115:0/4259175156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086aa5de0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f5657400640 0 client.4389 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 1 -- 172.21.15.115:0/4259175156 >> 172.21.15.115:0/4259175156 conn(0x559086add650 msgr2=0x559086adfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 1 -- 172.21.15.115:0/4259175156 shutdown_connections 2024-05-12T10:50:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 1 -- 172.21.15.115:0/4259175156 wait complete. 2024-05-12T10:50:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.657+0000 7f56802f2000 20 client.4389 trim_cache size 0 max 16384 2024-05-12T10:50:05.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f56802f2000 1 Processor -- start 2024-05-12T10:50:05.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f56802f2000 1 -- start start 2024-05-12T10:50:05.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f56802f2000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086add650 0x559086ae0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:05.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f56802f2000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae18a0 0x559086adc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:05.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f56802f2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086adc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:05.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f56802f2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5678201b40 con 0x559086ae21c0 2024-05-12T10:50:05.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f56802f2000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5678202190 con 0x559086add650 2024-05-12T10:50:05.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f56802f2000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5590868fd470 con 0x559086ae18a0 2024-05-12T10:50:05.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f5676800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086adc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:05.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f5676800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086adc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57394/0 (socket says 172.21.15.115:57394) 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f5676800640 1 -- 172.21.15.115:0/3747839270 learned_addr learned my addr 172.21.15.115:0/3747839270 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f5675e00640 1 --2- 172.21.15.115:0/3747839270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086add650 0x559086ae0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f5675400640 1 --2- 172.21.15.115:0/3747839270 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae18a0 0x559086adc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f5676800640 1 -- 172.21.15.115:0/3747839270 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae18a0 msgr2=0x559086adc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f5676800640 1 --2- 172.21.15.115:0/3747839270 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae18a0 0x559086adc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f5676800640 1 -- 172.21.15.115:0/3747839270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086add650 msgr2=0x559086ae0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f5676800640 1 --2- 172.21.15.115:0/3747839270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086add650 0x559086ae0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.677+0000 7f5676800640 1 -- 172.21.15.115:0/3747839270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590868c9ad0 con 0x559086ae21c0 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f5676800640 1 --2- 172.21.15.115:0/3747839270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086adc990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5678157760 tx=0x7f5670001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77f47510c4bc96a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f5662000640 1 -- 172.21.15.115:0/3747839270 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567001a020 con 0x559086ae21c0 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f5662000640 1 -- 172.21.15.115:0/3747839270 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56700050d0 con 0x559086ae21c0 2024-05-12T10:50:05.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f5662000640 1 -- 172.21.15.115:0/3747839270 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670003600 con 0x559086ae21c0 2024-05-12T10:50:05.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 -- 172.21.15.115:0/3747839270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 msgr2=0x559086adc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:05.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 --2- 172.21.15.115:0/3747839270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086adc990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5678157760 tx=0x7f5670001900 comp rx=0 tx=0).stop 2024-05-12T10:50:05.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 -- 172.21.15.115:0/3747839270 shutdown_connections 2024-05-12T10:50:05.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 --2- 172.21.15.115:0/3747839270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae21c0 0x559086adc990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 --2- 172.21.15.115:0/3747839270 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086ae18a0 0x559086adc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 --2- 172.21.15.115:0/3747839270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086add650 0x559086ae0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 -- 172.21.15.115:0/3747839270 >> 172.21.15.115:0/3747839270 conn(0x559086aa0ac0 msgr2=0x559086aa4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:05.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 -- 172.21.15.115:0/3747839270 shutdown_connections 2024-05-12T10:50:05.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 -- 172.21.15.115:0/3747839270 wait complete. 2024-05-12T10:50:05.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 -- start start 2024-05-12T10:50:05.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 Processor -- start 2024-05-12T10:50:05.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086add650 0x559086b56d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:05.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086b57260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:05.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae21c0 0x559086af86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:05.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5590868ef380 con 0x559086ae18a0 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5590868ec030 con 0x559086ae21c0 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5590869aad60 con 0x559086add650 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f56802f2000 10 client.0 _ll_register_callbacks cb 0x7f56680f1530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f5675400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086b57260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f5675400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086b57260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57398/0 (socket says 172.21.15.115:57398) 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f5675400640 1 -- 172.21.15.115:0/115669866 learned_addr learned my addr 172.21.15.115:0/115669866 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f5676800640 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae21c0 0x559086af86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.681+0000 7f5675e00640 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086add650 0x559086b56d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5675400640 1 -- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086add650 msgr2=0x559086b56d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5675400640 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086add650 0x559086b56d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5675400640 1 -- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae21c0 msgr2=0x559086af86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5675400640 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae21c0 0x559086af86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5675400640 1 -- 172.21.15.115:0/115669866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590868c8e20 con 0x559086ae18a0 2024-05-12T10:50:05.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5675e00640 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086add650 0x559086b56d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:05.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5675400640 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086b57260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56640046a0 tx=0x7f5664004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3684648281b49071 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:05.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5657400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:05.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5657400640 1 -- 172.21.15.115:0/115669866 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5664028040 con 0x559086ae18a0 2024-05-12T10:50:05.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5657400640 1 -- 172.21.15.115:0/115669866 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5664003da0 con 0x559086ae18a0 2024-05-12T10:50:05.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f56802f2000 1 -- 172.21.15.115:0/115669866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56700050d0 con 0x559086ae18a0 2024-05-12T10:50:05.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5657400640 1 -- 172.21.15.115:0/115669866 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f566403c2c0 con 0x559086ae18a0 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f56802f2000 10 client.4395 fetch_fsmap learned FSMap version 6 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f56802f2000 1 -- 172.21.15.115:0/115669866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5590869704c0 con 0x559086ae18a0 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5657400640 1 -- 172.21.15.115:0/115669866 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56700050d0 con 0x559086ae18a0 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5657400640 1 -- 172.21.15.115:0/115669866 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f5664044020 con 0x559086ae18a0 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f56802f2000 10 client.4395 fetch_fsmap finished waiting for FSMap version 6 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f56802f2000 10 client.4395 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f56802f2000 20 client.4395 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f56802f2000 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086ae2ae0 0x559086af9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f56802f2000 4 client.4395 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f56802f2000 1 -- 172.21.15.115:0/115669866 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "status"}) -- 0x5590868fdc80 con 0x559086ae2ae0 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5675e00640 1 -- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086ae2ae0 msgr2=0x559086af9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5675e00640 1 -- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086ae2ae0 msgr2=0x559086af9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5675e00640 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086ae2ae0 0x559086af9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2024-05-12T10:50:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.685+0000 7f5675e00640 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086ae2ae0 0x559086af9060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T10:50:05.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f5675e00640 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086ae2ae0 0x559086af9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:05.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f5675e00640 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086ae2ae0 0x559086af9060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af88d127c099c2a server_cookie=bc0174b897293684 in_seq=0 out_seq=0 2024-05-12T10:50:05.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f5657400640 10 client.4395 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:05.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f5657400640 1 -- 172.21.15.115:0/115669866 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5590868fdc80 con 0x559086ae2ae0 2024-05-12T10:50:05.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f5657400640 10 client.4395 handle_command_reply: tid=0 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 1 client.4395 shutdown 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 1 -- 172.21.15.115:0/115669866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 msgr2=0x559086b57260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086b57260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56640046a0 tx=0x7f5664004740 comp rx=0 tx=0).stop 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 1 -- 172.21.15.115:0/115669866 shutdown_connections 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559086ae2ae0 0x559086af9060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559086ae21c0 0x559086af86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559086ae18a0 0x559086b57260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f5657400640 0 client.4395 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 1 --2- 172.21.15.115:0/115669866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559086add650 0x559086b56d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 1 -- 172.21.15.115:0/115669866 >> 172.21.15.115:0/115669866 conn(0x559086aa0ac0 msgr2=0x559086aa4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 1 -- 172.21.15.115:0/115669866 shutdown_connections 2024-05-12T10:50:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 1 -- 172.21.15.115:0/115669866 wait complete. 2024-05-12T10:50:05.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f56802f2000 20 client.4395 trim_cache size 0 max 16384 2024-05-12T10:50:05.887 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:50:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "afd333ea-2e10-495a-8d22-6858d0930293", 2024-05-12T10:50:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2024-05-12T10:50:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 4321, 2024-05-12T10:50:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2024-05-12T10:50:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2024-05-12T10:50:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2024-05-12T10:50:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 10.278615007000001, 2024-05-12T10:50:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 5, 2024-05-12T10:50:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 26, 2024-05-12T10:50:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 25, 2024-05-12T10:50:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 16.334177881999999 2024-05-12T10:50:05.888 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 -- 172.21.15.115:0/4265600705 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f565806f430 msgr2=0x7f56580718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f565806f430 0x7f56580718f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f567815e1f0 tx=0x7f5664008040 comp rx=0 tx=0).stop 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 -- 172.21.15.115:0/4265600705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 msgr2=0x7f567814a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 0x7f567814a0f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f566801b8b0 tx=0x7f565c005840 comp rx=0 tx=0).stop 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 -- 172.21.15.115:0/4265600705 shutdown_connections 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f565806f430 0x7f56580718f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56780c79a0 0x7f56780c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56780c9760 0x7f567814ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 --2- 172.21.15.115:0/4265600705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c003c90 0x7f567814a0f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 -- 172.21.15.115:0/4265600705 >> 172.21.15.115:0/4265600705 conn(0x7f567806c440 msgr2=0x7f5678153480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 -- 172.21.15.115:0/4265600705 shutdown_connections 2024-05-12T10:50:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:05.889+0000 7f567ce00640 1 -- 172.21.15.115:0/4265600705 wait complete. 2024-05-12T10:50:05.911 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-12T10:50:05.911 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-12T10:50:05.911 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-12T10:50:06.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.057+0000 7f7ddfe00640 1 Processor -- start 2024-05-12T10:50:06.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.057+0000 7f7ddfe00640 1 -- start start 2024-05-12T10:50:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.057+0000 7f7ddfe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7de006e150 0x7f7de00ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.057+0000 7f7ddfe00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de00cfb40 con 0x7f7de0159250 2024-05-12T10:50:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.057+0000 7f7ddfe00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de015c7d0 con 0x7f7de00cccc0 2024-05-12T10:50:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.057+0000 7f7ddfe00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7de006c440 con 0x7f7de006e150 2024-05-12T10:50:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.057+0000 7f7ddea00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7de0159250 0x7f7de0070410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53812/0 (socket says 172.21.15.115:53812) 2024-05-12T10:50:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.057+0000 7f7ddea00640 1 -- 172.21.15.115:0/1763904490 learned_addr learned my addr 172.21.15.115:0/1763904490 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddf400640 1 --2- 172.21.15.115:0/1763904490 >> v2:172.21.15.134:3300/0 conn(0x7f7de006e150 0x7f7de00ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224320355 0 0) 0x7f7de00cfb40 con 0x7f7de0159250 2024-05-12T10:50:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dc4003530 con 0x7f7de0159250 2024-05-12T10:50:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 735138312 0 0) 0x7f7dc4003530 con 0x7f7de0159250 2024-05-12T10:50:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 >> v2:172.21.15.134:3300/0 conn(0x7f7de006e150 msgr2=0x7f7de00ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 --2- 172.21.15.115:0/1763904490 >> v2:172.21.15.134:3300/0 conn(0x7f7de006e150 0x7f7de00ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 >> v1:172.21.15.134:6789/0 conn(0x7f7de00cccc0 legacy=0x7f7de0164540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de015cab0 con 0x7f7de0159250 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f7dd0001a80 con 0x7f7de0159250 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 >> v1:172.21.15.115:6789/0 conn(0x7f7de0159250 legacy=0x7f7de0070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 --2- 172.21.15.115:0/1763904490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 0x7f7dc4003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 --2- 172.21.15.115:0/1763904490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dc4004810 0x7f7dc4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 --2- 172.21.15.115:0/1763904490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dc40051d0 0x7f7dc400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7de006c440 con 0x7f7dc4003a60 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc400c170 con 0x7f7dc40051d0 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc400c370 con 0x7f7dc4004810 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddea00640 1 --2- 172.21.15.115:0/1763904490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 0x7f7dc4003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddf400640 1 --2- 172.21.15.115:0/1763904490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dc40051d0 0x7f7dc400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7dde000640 1 --2- 172.21.15.115:0/1763904490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dc4004810 0x7f7dc4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddea00640 1 -- 172.21.15.115:0/1763904490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dc4004810 msgr2=0x7f7dc4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddea00640 1 --2- 172.21.15.115:0/1763904490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dc4004810 0x7f7dc4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddea00640 1 -- 172.21.15.115:0/1763904490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dc40051d0 msgr2=0x7f7dc400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddea00640 1 --2- 172.21.15.115:0/1763904490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dc40051d0 0x7f7dc400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddea00640 1 -- 172.21.15.115:0/1763904490 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc4003530 con 0x7f7dc4003a60 2024-05-12T10:50:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.061+0000 7f7ddf400640 1 -- 172.21.15.115:0/1763904490 reap_dead start 2024-05-12T10:50:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddea00640 1 --2- 172.21.15.115:0/1763904490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 0x7f7dc4003e80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000a8b0 tx=0x7f7dd001d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd37219b8825ac70 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:06.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000a4d0 con 0x7f7dc4003a60 2024-05-12T10:50:06.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd00ad630 con 0x7f7dc4003a60 2024-05-12T10:50:06.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddd600640 1 -- 172.21.15.115:0/1763904490 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00ada60 con 0x7f7dc4003a60 2024-05-12T10:50:06.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 -- 172.21.15.115:0/1763904490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 msgr2=0x7f7dc4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 --2- 172.21.15.115:0/1763904490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 0x7f7dc4003e80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000a8b0 tx=0x7f7dd001d2c0 comp rx=0 tx=0).stop 2024-05-12T10:50:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 -- 172.21.15.115:0/1763904490 shutdown_connections 2024-05-12T10:50:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 --2- 172.21.15.115:0/1763904490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 0x7f7dc4003e80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 -- 172.21.15.115:0/1763904490 >> 172.21.15.115:0/1763904490 conn(0x7f7de0071780 msgr2=0x7f7de0076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 -- 172.21.15.115:0/1763904490 shutdown_connections 2024-05-12T10:50:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 -- 172.21.15.115:0/1763904490 wait complete. 2024-05-12T10:50:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 Processor -- start 2024-05-12T10:50:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 -- start start 2024-05-12T10:50:06.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 0x7f7de01f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:06.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7de00b3ef0 0x7f7de0155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7de01558b0 0x7f7de014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7de006cc50 con 0x7f7dc4003a60 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7de00cad30 con 0x7f7de01558b0 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.065+0000 7f7ddfe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7de0159630 con 0x7f7de00b3ef0 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddea00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 0x7f7de01f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddea00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 0x7f7de01f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57424/0 (socket says 172.21.15.115:57424) 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddea00640 1 -- 172.21.15.115:0/4100064375 learned_addr learned my addr 172.21.15.115:0/4100064375 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7dde000640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7de00b3ef0 0x7f7de0155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddf400640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7de01558b0 0x7f7de014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddea00640 1 -- 172.21.15.115:0/4100064375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7de00b3ef0 msgr2=0x7f7de0155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddea00640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7de00b3ef0 0x7f7de0155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddea00640 1 -- 172.21.15.115:0/4100064375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7de01558b0 msgr2=0x7f7de014ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddea00640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7de01558b0 0x7f7de014ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddea00640 1 -- 172.21.15.115:0/4100064375 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de01f5f20 con 0x7f7dc4003a60 2024-05-12T10:50:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddea00640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 0x7f7de01f5530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7dd001b9c0 tx=0x7f7dc4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7dd6a00640 1 -- 172.21.15.115:0/4100064375 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00b2040 con 0x7f7dc4003a60 2024-05-12T10:50:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7dd6a00640 1 -- 172.21.15.115:0/4100064375 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd0001840 con 0x7f7dc4003a60 2024-05-12T10:50:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddfe00640 1 -- 172.21.15.115:0/4100064375 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de00b21a0 con 0x7f7dc4003a60 2024-05-12T10:50:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7dd6a00640 1 -- 172.21.15.115:0/4100064375 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0002030 con 0x7f7dc4003a60 2024-05-12T10:50:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddfe00640 1 -- 172.21.15.115:0/4100064375 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de00b2760 con 0x7f7dc4003a60 2024-05-12T10:50:06.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7ddfe00640 1 -- 172.21.15.115:0/4100064375 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de00b29a0 con 0x7f7dc4003a60 2024-05-12T10:50:06.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.069+0000 7f7dd6a00640 1 -- 172.21.15.115:0/4100064375 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7dd00ad630 con 0x7f7dc4003a60 2024-05-12T10:50:06.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.073+0000 7f7dd6a00640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7dc006f400 0x7f7dc00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.073+0000 7f7dd6a00640 1 -- 172.21.15.115:0/4100064375 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7dd0129420 con 0x7f7dc4003a60 2024-05-12T10:50:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.073+0000 7f7dde000640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7dc006f400 0x7f7dc00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.073+0000 7f7dde000640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7dc006f400 0x7f7dc00718c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc000c10 tx=0x7f7dcc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:06.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.077+0000 7f7dd6a00640 1 -- 172.21.15.115:0/4100064375 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7dd0017070 con 0x7f7dc4003a60 2024-05-12T10:50:06.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.265+0000 7f7ddfe00640 1 -- 172.21.15.115:0/4100064375 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7de0050750 con 0x7f7dc4003a60 2024-05-12T10:50:06.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.265+0000 7f7dd6a00640 1 -- 172.21.15.115:0/4100064375 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f7dd00f5fc0 con 0x7f7dc4003a60 2024-05-12T10:50:06.263 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-12T10:50:06.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 -- 172.21.15.115:0/4100064375 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7dc006f400 msgr2=0x7f7dc00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:06.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7dc006f400 0x7f7dc00718c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc000c10 tx=0x7f7dcc009040 comp rx=0 tx=0).stop 2024-05-12T10:50:06.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 -- 172.21.15.115:0/4100064375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 msgr2=0x7f7de01f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:06.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 0x7f7de01f5530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7dd001b9c0 tx=0x7f7dc4005840 comp rx=0 tx=0).stop 2024-05-12T10:50:06.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 -- 172.21.15.115:0/4100064375 shutdown_connections 2024-05-12T10:50:06.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7dc006f400 0x7f7dc00718c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:06.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7de01558b0 0x7f7de014ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:06.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7de00b3ef0 0x7f7de0155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:06.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 --2- 172.21.15.115:0/4100064375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dc4003a60 0x7f7de01f5530 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:06.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 -- 172.21.15.115:0/4100064375 >> 172.21.15.115:0/4100064375 conn(0x7f7de0071780 msgr2=0x7f7de015abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:06.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 -- 172.21.15.115:0/4100064375 shutdown_connections 2024-05-12T10:50:06.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06.269+0000 7f7ddfe00640 1 -- 172.21.15.115:0/4100064375 wait complete. 2024-05-12T10:50:06.284 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-12T10:50:06.284 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-12T10:50:06.284 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2024-05-12T10:50:06.284 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-12T10:50:06.284 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-12T10:50:06.284 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-12T10:50:06.284 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-12T10:50:06.284 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-12T10:50:06.284 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-12T10:50:06.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:06.284 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2024-05-12T10:50:06.293 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-12T10:50:06.293 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-12T10:50:06.293 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2024-05-12T10:50:06.293 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-05-12T10:50:06.293 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2024-05-12T10:50:06.293 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-05-12T10:50:06.293 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-12T10:50:06.293 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42444sec preferred_lft 42444sec 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-12T10:50:06.294 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 02:42:36:49:fd:5a brd ff:ff:ff:ff:ff:ff 2024-05-12T10:50:06.295 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-12T10:50:06.295 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-05-12T10:50:06.296 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-12T10:50:06.296 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T10:50:06.296 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-05-12T10:50:06.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add name ceph-brx type bridge 2024-05-12T10:50:06.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr flush dev ceph-brx 2024-05-12T10:50:06.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set ceph-brx up 2024-05-12T10:50:06.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-12T10:50:06.296 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-05-12T10:50:06.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T10:50:06.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:06.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:06.450 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-12T10:50:06.468 INFO:teuthology.orchestra.run.smithi115.stdout:1 2024-05-12T10:50:06.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:06.470 DEBUG:teuthology.orchestra.run.smithi115:> route 2024-05-12T10:50:06.544 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2024-05-12T10:50:06.544 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-12T10:50:06.545 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-12T10:50:06.545 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-12T10:50:06.545 INFO:teuthology.orchestra.run.smithi115.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-12T10:50:06.545 INFO:teuthology.orchestra.run.smithi115.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-12T10:50:06.545 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-12T10:50:06.545 INFO:teuthology.orchestra.run.smithi115.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-12T10:50:06.545 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-12T10:50:06.545 INFO:teuthology.orchestra.run.smithi115.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-12T10:50:06.545 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-12T10:50:06.546 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T10:50:06.546 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-05-12T10:50:06.546 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-12T10:50:06.546 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-12T10:50:06.546 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-12T10:50:06.546 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-05-12T10:50:06.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T10:50:06.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:06.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:06.681 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-05-12T10:50:06.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:06.691 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2024-05-12T10:50:06.743 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T10:50:06.743 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-05-12T10:50:06.743 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-12T10:50:06.743 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-12T10:50:06.743 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-05-12T10:50:06.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T10:50:06.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:06.869 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-12T10:50:06.869 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T10:50:06.869 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-05-12T10:50:06.869 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-12T10:50:06.869 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-12T10:50:06.869 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-12T10:50:06.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-12T10:50:06.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-12T10:50:06.870 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-05-12T10:50:06.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T10:50:07.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:07.074 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T10:50:07.074 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-05-12T10:50:07.074 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2024-05-12T10:50:07.074 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.0 master ceph-brx 2024-05-12T10:50:07.074 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-05-12T10:50:07.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T10:50:07.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:07.198 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-12T10:50:07.198 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-12T10:50:07.199 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-12T10:50:07.251 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-12T10:50:07.251 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-12T10:50:07.251 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-12T10:50:07.302 DEBUG:teuthology.orchestra.run.smithi115:> sudo modprobe fuse 2024-05-12T10:50:07.363 DEBUG:teuthology.orchestra.run.smithi115:> cat /proc/self/mounts | awk '{print $2}' 2024-05-12T10:50:07.416 INFO:teuthology.orchestra.run.smithi115.stdout:/sys 2024-05-12T10:50:07.416 INFO:teuthology.orchestra.run.smithi115.stdout:/proc 2024-05-12T10:50:07.416 INFO:teuthology.orchestra.run.smithi115.stdout:/dev 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/pts 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/run 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/ 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/security 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/shm 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/run/lock 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/cgroup 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/pstore 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/bpf 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/proc/sys/fs/binfmt_misc 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/hugepages 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/mqueue 2024-05-12T10:50:07.417 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/debug 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/tracing 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/proc/fs/nfsd 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/fuse/connections 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/config 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/run/credentials/systemd-sysusers.service 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/run/rpc_pipefs 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/run/user/1000 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-0 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-1 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-2 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-3 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/run/netns 2024-05-12T10:50:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-12T10:50:07.419 INFO:teuthology.orchestra.run.smithi115.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-12T10:50:07.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:07.420 DEBUG:teuthology.orchestra.run.smithi115:> ls /sys/fs/fuse/connections 2024-05-12T10:50:07.470 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-12T10:50:07.470 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-12T10:50:07.513 DEBUG:teuthology.orchestra.run.smithi115:> sudo modprobe fuse 2024-05-12T10:50:07.533 DEBUG:teuthology.orchestra.run.smithi115:> cat /proc/self/mounts | awk '{print $2}' 2024-05-12T10:50:07.584 INFO:teuthology.orchestra.run.smithi115.stdout:/sys 2024-05-12T10:50:07.584 INFO:teuthology.orchestra.run.smithi115.stdout:/proc 2024-05-12T10:50:07.584 INFO:teuthology.orchestra.run.smithi115.stdout:/dev 2024-05-12T10:50:07.584 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/pts 2024-05-12T10:50:07.584 INFO:teuthology.orchestra.run.smithi115.stdout:/run 2024-05-12T10:50:07.584 INFO:teuthology.orchestra.run.smithi115.stdout:/ 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/security 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/shm 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/run/lock 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/cgroup 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/pstore 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/bpf 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/proc/sys/fs/binfmt_misc 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/hugepages 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/mqueue 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/debug 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/tracing 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/proc/fs/nfsd 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/fuse/connections 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/config 2024-05-12T10:50:07.585 INFO:teuthology.orchestra.run.smithi115.stdout:/run/credentials/systemd-sysusers.service 2024-05-12T10:50:07.586 INFO:teuthology.orchestra.run.smithi115.stdout:/run/rpc_pipefs 2024-05-12T10:50:07.586 INFO:teuthology.orchestra.run.smithi115.stdout:/run/user/1000 2024-05-12T10:50:07.586 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph 2024-05-12T10:50:07.586 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-0 2024-05-12T10:50:07.586 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-1 2024-05-12T10:50:07.586 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-2 2024-05-12T10:50:07.586 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-3 2024-05-12T10:50:07.586 INFO:teuthology.orchestra.run.smithi115.stdout:/run/netns 2024-05-12T10:50:07.586 INFO:teuthology.orchestra.run.smithi115.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-12T10:50:07.586 INFO:teuthology.orchestra.run.smithi115.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-12T10:50:07.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:07.587 DEBUG:teuthology.orchestra.run.smithi115:> ls /sys/fs/fuse/connections 2024-05-12T10:50:07.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi115.stderr:2024-05-12T10:50:07.613+0000 7fe67b82b580 -1 init, newargv = 0x55b0e625e4d0 newargc=15 2024-05-12T10:50:07.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi115.stderr:ceph-fuse[33460]: starting ceph client 2024-05-12T10:50:07.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi115.stderr:ceph-fuse[33460]: starting fuse 2024-05-12T10:50:08.719 DEBUG:teuthology.orchestra.run.smithi115:> sudo modprobe fuse 2024-05-12T10:50:08.741 DEBUG:teuthology.orchestra.run.smithi115:> cat /proc/self/mounts | awk '{print $2}' 2024-05-12T10:50:08.792 INFO:teuthology.orchestra.run.smithi115.stdout:/sys 2024-05-12T10:50:08.792 INFO:teuthology.orchestra.run.smithi115.stdout:/proc 2024-05-12T10:50:08.792 INFO:teuthology.orchestra.run.smithi115.stdout:/dev 2024-05-12T10:50:08.792 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/pts 2024-05-12T10:50:08.792 INFO:teuthology.orchestra.run.smithi115.stdout:/run 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/ 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/security 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/shm 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/run/lock 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/cgroup 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/pstore 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/bpf 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/proc/sys/fs/binfmt_misc 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/hugepages 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/dev/mqueue 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/debug 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/tracing 2024-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi115.stdout:/proc/fs/nfsd 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/fs/fuse/connections 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/sys/kernel/config 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/run/credentials/systemd-sysusers.service 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/run/rpc_pipefs 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/run/user/1000 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-0 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-1 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-2 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/var/lib/ceph/osd/ceph-3 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/run/netns 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-12T10:50:08.794 INFO:teuthology.orchestra.run.smithi115.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-12T10:50:08.795 INFO:teuthology.orchestra.run.smithi115.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-12T10:50:08.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:08.795 DEBUG:teuthology.orchestra.run.smithi115:> ls /sys/fs/fuse/connections 2024-05-12T10:50:08.847 INFO:teuthology.orchestra.run.smithi115.stdout:44 2024-05-12T10:50:08.847 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-12T10:50:08.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo stdin-killer -- python3 -c ' 2024-05-12T10:50:08.847 DEBUG:teuthology.orchestra.run.smithi115:> import glob 2024-05-12T10:50:08.847 DEBUG:teuthology.orchestra.run.smithi115:> import re 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> import os 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> import subprocess 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> def _find_admin_socket(client_name): 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> files = glob.glob(asok_path) 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> # Given a non-glob path, it better be there 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> if "*" not in asok_path: 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> assert(len(files) == 1) 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> return files[0] 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> for f in files: 2024-05-12T10:50:08.848 DEBUG:teuthology.orchestra.run.smithi115:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-12T10:50:08.849 DEBUG:teuthology.orchestra.run.smithi115:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-12T10:50:08.849 DEBUG:teuthology.orchestra.run.smithi115:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-12T10:50:08.849 DEBUG:teuthology.orchestra.run.smithi115:> contents = proc_f.read() 2024-05-12T10:50:08.849 DEBUG:teuthology.orchestra.run.smithi115:> if mountpoint in contents: 2024-05-12T10:50:08.849 DEBUG:teuthology.orchestra.run.smithi115:> return f 2024-05-12T10:50:08.849 DEBUG:teuthology.orchestra.run.smithi115:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-12T10:50:08.849 DEBUG:teuthology.orchestra.run.smithi115:> 2024-05-12T10:50:08.849 DEBUG:teuthology.orchestra.run.smithi115:> print(_find_admin_socket("client.admin")) 2024-05-12T10:50:08.849 DEBUG:teuthology.orchestra.run.smithi115:> ' 2024-05-12T10:50:08.975 INFO:teuthology.orchestra.run.smithi115.stdout:/var/run/ceph/ceph-client.admin.33460.asok 2024-05-12T10:50:08.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:08.986 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33460.asok 2024-05-12T10:50:08.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:08.987 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33460.asok status 2024-05-12T10:50:09.158 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:50:09.158 INFO:teuthology.orchestra.run.smithi115.stdout: "metadata": { 2024-05-12T10:50:09.158 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_sha1": "f1ec882358465db8f363a3865fa83f099183688a", 2024-05-12T10:50:09.158 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_version": "ceph version 19.0.0-3517-gf1ec8823 (f1ec882358465db8f363a3865fa83f099183688a) squid (dev)", 2024-05-12T10:50:09.158 INFO:teuthology.orchestra.run.smithi115.stdout: "entity_id": "admin", 2024-05-12T10:50:09.158 INFO:teuthology.orchestra.run.smithi115.stdout: "hostname": "smithi115", 2024-05-12T10:50:09.158 INFO:teuthology.orchestra.run.smithi115.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-12T10:50:09.158 INFO:teuthology.orchestra.run.smithi115.stdout: "pid": "33460", 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "root": "/" 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "dentry_count": 0, 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "dentry_pinned_count": 0, 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 4407, 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "inst": { 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "name": { 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "type": "client", 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "num": 4407 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "addr": { 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "type": "v1", 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "addr": "192.168.0.1:0", 2024-05-12T10:50:09.159 INFO:teuthology.orchestra.run.smithi115.stdout: "nonce": 3148727404 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: "addr": { 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: "type": "v1", 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: "addr": "192.168.0.1:0", 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: "nonce": 3148727404 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: "inst_str": "client.4407 192.168.0.1:0/3148727404", 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: "addr_str": "192.168.0.1:0/3148727404", 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: "inode_count": 1, 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_epoch": 5, 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_epoch": 26, 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_epoch_barrier": 0, 2024-05-12T10:50:09.160 INFO:teuthology.orchestra.run.smithi115.stdout: "blocklisted": false, 2024-05-12T10:50:09.161 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs" 2024-05-12T10:50:09.161 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:50:09.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:09.175 DEBUG:teuthology.orchestra.run.smithi115:> stat --file-system '--printf=%T 2024-05-12T10:50:09.175 DEBUG:teuthology.orchestra.run.smithi115:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-12T10:50:09.183 INFO:teuthology.orchestra.run.smithi115.stdout:fuseblk 2024-05-12T10:50:09.184 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-12T10:50:09.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:09.184 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-12T10:50:09.250 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-12T10:50:09.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-12T10:50:09.383 INFO:teuthology.orchestra.run.smithi115.stdout:# file: . 2024-05-12T10:50:09.383 INFO:teuthology.orchestra.run.smithi115.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-12T10:50:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:09.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:09.390 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:50:09.390 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-12T10:50:09.399 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-12T10:50:09.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb439c00640 1 Processor -- start 2024-05-12T10:50:09.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb439c00640 1 -- start start 2024-05-12T10:50:09.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb439c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340c7780 0x7fb4341599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb439c00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4340c9370 con 0x7fb4341506f0 2024-05-12T10:50:09.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb439c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4340c9610 con 0x7fb434150310 2024-05-12T10:50:09.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb439c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb4340c98d0 con 0x7fb4340c7780 2024-05-12T10:50:09.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb433400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb4341506f0 0x7fb4340c7e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53824/0 (socket says 172.21.15.115:53824) 2024-05-12T10:50:09.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb433400640 1 -- 172.21.15.115:0/258754323 learned_addr learned my addr 172.21.15.115:0/258754323 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:09.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb42be00640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340c7780 0x7fb4341599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195692749 0 0) 0x7fb4340c9370 con 0x7fb4341506f0 2024-05-12T10:50:09.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb418003530 con 0x7fb4341506f0 2024-05-12T10:50:09.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 362236525 0 0) 0x7fb418003530 con 0x7fb4341506f0 2024-05-12T10:50:09.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340c7780 msgr2=0x7fb4341599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:09.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340c7780 0x7fb4341599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 >> v1:172.21.15.134:6789/0 conn(0x7fb434150310 legacy=0x7fb4340c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4340c9bb0 con 0x7fb4341506f0 2024-05-12T10:50:09.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fb42c001a80 con 0x7fb4341506f0 2024-05-12T10:50:09.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 >> v1:172.21.15.115:6789/0 conn(0x7fb4341506f0 legacy=0x7fb4340c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb418003a40 0x7fb418003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb418004810 0x7fb418004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340c7780 0x7fb418005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340c98d0 con 0x7fb418004810 2024-05-12T10:50:09.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb41800bb60 con 0x7fb418003a40 2024-05-12T10:50:09.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb41800bd60 con 0x7fb4340c7780 2024-05-12T10:50:09.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb42be00640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb418004810 0x7fb418004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432a00640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb418003a40 0x7fb418003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb433400640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340c7780 0x7fb418005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb42be00640 1 -- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340c7780 msgr2=0x7fb418005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:09.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb42be00640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4340c7780 0x7fb418005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb42be00640 1 -- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb418003a40 msgr2=0x7fb418003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:09.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb42be00640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb418003a40 0x7fb418003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb42be00640 1 -- 172.21.15.115:0/258754323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb418003530 con 0x7fb418004810 2024-05-12T10:50:09.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.585+0000 7fb432a00640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb418003a40 0x7fb418003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:09.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.589+0000 7fb42be00640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb418004810 0x7fb418004c90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009ae0 tx=0x7fb41c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b27ca74562cc63 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:09.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.589+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0b2070 con 0x7fb418004810 2024-05-12T10:50:09.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.589+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41c0a5550 con 0x7fb418004810 2024-05-12T10:50:09.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.589+0000 7fb432000640 1 -- 172.21.15.115:0/258754323 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0096b0 con 0x7fb418004810 2024-05-12T10:50:09.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.589+0000 7fb439c00640 1 -- 172.21.15.115:0/258754323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb418004810 msgr2=0x7fb418004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.589+0000 7fb439c00640 1 --2- 172.21.15.115:0/258754323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb418004810 0x7fb418004c90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009ae0 tx=0x7fb41c01ca70 comp rx=0 tx=0).stop 2024-05-12T10:50:09.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.589+0000 7fb433400640 1 -- 172.21.15.115:0/258754323 reap_dead start 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.589+0000 7fb439c00640 1 -- 172.21.15.115:0/258754323 shutdown_connections 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.589+0000 7fb439c00640 1 -- 172.21.15.115:0/258754323 >> 172.21.15.115:0/258754323 conn(0x7fb434076830 msgr2=0x7fb4340681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.589+0000 7fb439c00640 1 -- 172.21.15.115:0/258754323 shutdown_connections 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.589+0000 7fb439c00640 1 -- 172.21.15.115:0/258754323 wait complete. 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb439c00640 1 Processor -- start 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb439c00640 1 -- start start 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb439c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb418004810 0x7fb43414aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb439c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4341f50d0 0x7fb4341f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb439c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb434156410 0x7fb434156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb439c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340c5bb0 con 0x7fb4341f50d0 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb439c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340c58d0 con 0x7fb418004810 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb439c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb4340c52a0 con 0x7fb434156410 2024-05-12T10:50:09.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4341f50d0 0x7fb4341f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4341f50d0 0x7fb4341f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57454/0 (socket says 172.21.15.115:57454) 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42be00640 1 -- 172.21.15.115:0/1648476412 learned_addr learned my addr 172.21.15.115:0/1648476412 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb433400640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb434156410 0x7fb434156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb432a00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb418004810 0x7fb43414aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42be00640 1 -- 172.21.15.115:0/1648476412 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb434156410 msgr2=0x7fb434156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42be00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb434156410 0x7fb434156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42be00640 1 -- 172.21.15.115:0/1648476412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb418004810 msgr2=0x7fb43414aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42be00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb418004810 0x7fb43414aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42be00640 1 -- 172.21.15.115:0/1648476412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4341f5a70 con 0x7fb4341f50d0 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42be00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4341f50d0 0x7fb4341f5530 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb41c01c8a0 tx=0x7fb418005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42aa00640 1 -- 172.21.15.115:0/1648476412 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0b2040 con 0x7fb4341f50d0 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42aa00640 1 -- 172.21.15.115:0/1648476412 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41c004020 con 0x7fb4341f50d0 2024-05-12T10:50:09.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb42aa00640 1 -- 172.21.15.115:0/1648476412 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0096b0 con 0x7fb4341f50d0 2024-05-12T10:50:09.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb439c00640 1 -- 172.21.15.115:0/1648476412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb434155ef0 con 0x7fb4341f50d0 2024-05-12T10:50:09.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.593+0000 7fb439c00640 1 -- 172.21.15.115:0/1648476412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb434155980 con 0x7fb4341f50d0 2024-05-12T10:50:09.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.597+0000 7fb439c00640 1 -- 172.21.15.115:0/1648476412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb434155bc0 con 0x7fb4341f50d0 2024-05-12T10:50:09.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.597+0000 7fb42aa00640 1 -- 172.21.15.115:0/1648476412 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb41c0c0060 con 0x7fb4341f50d0 2024-05-12T10:50:09.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.597+0000 7fb42aa00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb41006f430 0x7fb4100718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.597+0000 7fb42aa00640 1 -- 172.21.15.115:0/1648476412 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb41c129240 con 0x7fb4341f50d0 2024-05-12T10:50:09.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.597+0000 7fb432a00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb41006f430 0x7fb4100718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.597+0000 7fb432a00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb41006f430 0x7fb4100718f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb424005550 tx=0x7fb424009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:09.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.601+0000 7fb42aa00640 1 -- 172.21.15.115:0/1648476412 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb434155bc0 con 0x7fb4341f50d0 2024-05-12T10:50:09.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.773+0000 7fb439c00640 1 -- 172.21.15.115:0/1648476412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb434069730 con 0x7fb4341f50d0 2024-05-12T10:50:09.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.773+0000 7fb42aa00640 1 -- 172.21.15.115:0/1648476412 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fb41c016780 con 0x7fb4341f50d0 2024-05-12T10:50:09.771 INFO:teuthology.orchestra.run.smithi115.stderr:listed 0 entries 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 -- 172.21.15.115:0/1648476412 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb41006f430 msgr2=0x7fb4100718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb41006f430 0x7fb4100718f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb424005550 tx=0x7fb424009040 comp rx=0 tx=0).stop 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 -- 172.21.15.115:0/1648476412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4341f50d0 msgr2=0x7fb4341f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4341f50d0 0x7fb4341f5530 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb41c01c8a0 tx=0x7fb418005840 comp rx=0 tx=0).stop 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 -- 172.21.15.115:0/1648476412 shutdown_connections 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb41006f430 0x7fb4100718f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb434156410 0x7fb434156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4341f50d0 0x7fb4341f5530 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 --2- 172.21.15.115:0/1648476412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb418004810 0x7fb43414aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 -- 172.21.15.115:0/1648476412 >> 172.21.15.115:0/1648476412 conn(0x7fb434076830 msgr2=0x7fb4341e7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 -- 172.21.15.115:0/1648476412 shutdown_connections 2024-05-12T10:50:09.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.777+0000 7fb439c00640 1 -- 172.21.15.115:0/1648476412 wait complete. 2024-05-12T10:50:09.791 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:50:09.791 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-12T10:50:09.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-12T10:50:09.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.981+0000 7f0870800640 1 Processor -- start 2024-05-12T10:50:09.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.981+0000 7f0870800640 1 -- start start 2024-05-12T10:50:09.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f0870800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0868152a10 0x7f0868159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f0870800640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086815be20 con 0x7f0868152df0 2024-05-12T10:50:09.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f0870800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0868072cf0 con 0x7f0868073820 2024-05-12T10:50:09.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f0870800640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f0868072fd0 con 0x7f0868152a10 2024-05-12T10:50:09.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f086de00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0868152a10 0x7f0868159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f086d400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0868152df0 0x7f0868073d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53830/0 (socket says 172.21.15.115:53830) 2024-05-12T10:50:09.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f086d400640 1 -- 172.21.15.115:0/3773875450 learned_addr learned my addr 172.21.15.115:0/3773875450 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:09.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f086ca00640 1 -- 172.21.15.115:0/3773875450 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 425073928 0 0) 0x7f086815be20 con 0x7f0868152df0 2024-05-12T10:50:09.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f086ca00640 1 -- 172.21.15.115:0/3773875450 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0850005740 con 0x7f0868152df0 2024-05-12T10:50:09.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f086de00640 1 -- 172.21.15.115:0/3773875450 >> v1:172.21.15.134:6789/0 conn(0x7f0868073820 legacy=0x7f086815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f086de00640 1 -- 172.21.15.115:0/3773875450 >> v1:172.21.15.115:6789/0 conn(0x7f0868152df0 legacy=0x7f0868073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.985+0000 7f086de00640 1 -- 172.21.15.115:0/3773875450 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08680c4990 con 0x7f0868152a10 2024-05-12T10:50:09.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f086de00640 1 --2- 172.21.15.115:0/3773875450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868152a10 0x7f0868159310 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f085c0097c0 tx=0x7f085c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea572f705ad228 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:09.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f086ca00640 1 -- 172.21.15.115:0/3773875450 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c0b5070 con 0x7f0868152a10 2024-05-12T10:50:09.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f086ca00640 1 -- 172.21.15.115:0/3773875450 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f085c0a8990 con 0x7f0868152a10 2024-05-12T10:50:09.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f086ca00640 1 -- 172.21.15.115:0/3773875450 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c0a8d40 con 0x7f0868152a10 2024-05-12T10:50:09.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 -- 172.21.15.115:0/3773875450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868152a10 msgr2=0x7f0868159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 --2- 172.21.15.115:0/3773875450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868152a10 0x7f0868159310 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f085c0097c0 tx=0x7f085c01ec90 comp rx=0 tx=0).stop 2024-05-12T10:50:09.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 -- 172.21.15.115:0/3773875450 shutdown_connections 2024-05-12T10:50:09.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 --2- 172.21.15.115:0/3773875450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868152a10 0x7f0868159310 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 -- 172.21.15.115:0/3773875450 >> 172.21.15.115:0/3773875450 conn(0x7f0868076830 msgr2=0x7f08680681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:09.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 -- 172.21.15.115:0/3773875450 shutdown_connections 2024-05-12T10:50:09.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 -- 172.21.15.115:0/3773875450 wait complete. 2024-05-12T10:50:09.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 Processor -- start 2024-05-12T10:50:09.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 -- start start 2024-05-12T10:50:09.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868073820 0x7f086814b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0868152a10 0x7f08681e46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0868152df0 0x7f08680cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0868073460 con 0x7f0868073820 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08680c4f50 con 0x7f0868152a10 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.989+0000 7f0870800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f08680735e0 con 0x7f0868152df0 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086de00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868073820 0x7f086814b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086de00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868073820 0x7f086814b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57464/0 (socket says 172.21.15.115:57464) 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086de00640 1 -- 172.21.15.115:0/593421525 learned_addr learned my addr 172.21.15.115:0/593421525 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086d400640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0868152a10 0x7f08681e46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086e800640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0868152df0 0x7f08680cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086de00640 1 -- 172.21.15.115:0/593421525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0868152df0 msgr2=0x7f08680cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086de00640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0868152df0 0x7f08680cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086de00640 1 -- 172.21.15.115:0/593421525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0868152a10 msgr2=0x7f08681e46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086de00640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0868152a10 0x7f08681e46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086de00640 1 -- 172.21.15.115:0/593421525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08681e12d0 con 0x7f0868073820 2024-05-12T10:50:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086d400640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0868152a10 0x7f08681e46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:09.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f086de00640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868073820 0x7f086814b8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f085c0b3040 tx=0x7f085c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:09.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f0862000640 1 -- 172.21.15.115:0/593421525 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c0b5040 con 0x7f0868073820 2024-05-12T10:50:09.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f0862000640 1 -- 172.21.15.115:0/593421525 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f085c004220 con 0x7f0868073820 2024-05-12T10:50:09.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f0870800640 1 -- 172.21.15.115:0/593421525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08681e1570 con 0x7f0868073820 2024-05-12T10:50:09.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f0862000640 1 -- 172.21.15.115:0/593421525 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c003620 con 0x7f0868073820 2024-05-12T10:50:09.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f0870800640 1 -- 172.21.15.115:0/593421525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f086814d010 con 0x7f0868073820 2024-05-12T10:50:09.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f0870800640 1 -- 172.21.15.115:0/593421525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08681e18c0 con 0x7f0868073820 2024-05-12T10:50:09.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.993+0000 7f0862000640 1 -- 172.21.15.115:0/593421525 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f085c0c2060 con 0x7f0868073820 2024-05-12T10:50:09.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.997+0000 7f0862000640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f084c06f430 0x7f084c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:09.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.997+0000 7f0862000640 1 -- 172.21.15.115:0/593421525 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f085c12bd40 con 0x7f0868073820 2024-05-12T10:50:09.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.997+0000 7f086d400640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f084c06f430 0x7f084c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:09.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:09.997+0000 7f086d400640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f084c06f430 0x7f084c0718f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f086814e010 tx=0x7f0858009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:09.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.001+0000 7f0862000640 1 -- 172.21.15.115:0/593421525 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f085c0187f0 con 0x7f0868073820 2024-05-12T10:50:10.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 -- 172.21.15.115:0/593421525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0868069730 con 0x7f0868073820 2024-05-12T10:50:10.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0862000640 1 -- 172.21.15.115:0/593421525 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f085c0f8970 con 0x7f0868073820 2024-05-12T10:50:10.164 INFO:teuthology.orchestra.run.smithi115.stderr:listed 0 entries 2024-05-12T10:50:10.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 -- 172.21.15.115:0/593421525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f084c06f430 msgr2=0x7f084c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:10.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f084c06f430 0x7f084c0718f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f086814e010 tx=0x7f0858009040 comp rx=0 tx=0).stop 2024-05-12T10:50:10.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 -- 172.21.15.115:0/593421525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868073820 msgr2=0x7f086814b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:10.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868073820 0x7f086814b8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f085c0b3040 tx=0x7f085c01ba30 comp rx=0 tx=0).stop 2024-05-12T10:50:10.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 -- 172.21.15.115:0/593421525 shutdown_connections 2024-05-12T10:50:10.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f084c06f430 0x7f084c0718f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:10.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0868152df0 0x7f08680cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:10.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0868152a10 0x7f08681e46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:10.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 --2- 172.21.15.115:0/593421525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868073820 0x7f086814b8f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:10.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 -- 172.21.15.115:0/593421525 >> 172.21.15.115:0/593421525 conn(0x7f0868076830 msgr2=0x7f08680ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:10.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 -- 172.21.15.115:0/593421525 shutdown_connections 2024-05-12T10:50:10.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:10.169+0000 7f0870800640 1 -- 172.21.15.115:0/593421525 wait complete. 2024-05-12T10:50:10.185 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi115.front.sepia.ceph.com... 2024-05-12T10:50:10.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:10.186 DEBUG:teuthology.orchestra.run.smithi115:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-12T10:50:10.222 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi115.stderr:ceph-fuse[33460]: fuse finished with error 0 and tester_r 0 2024-05-12T10:50:10.225 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:50:10.568 INFO:tasks.ceph.mds.b.smithi134.stderr:2024-05-12T10:50:10.573+0000 7f9f96df4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-12T10:50:16.326 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:50:16.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:16.327 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-12T10:50:16.351 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:50:16.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.541+0000 7feb63200640 1 Processor -- start 2024-05-12T10:50:16.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.541+0000 7feb63200640 1 -- start start 2024-05-12T10:50:16.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.541+0000 7feb63200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb5c15cb30 0x7feb5c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.541+0000 7feb63200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb5c0c6560 0x7feb5c0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb63200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c0c69d0 con 0x7feb5c152a90 2024-05-12T10:50:16.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb63200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7feb5c0c4f80 con 0x7feb5c0c6560 2024-05-12T10:50:16.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb63200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7feb5c0cae10 con 0x7feb5c15cb30 2024-05-12T10:50:16.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb61200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb5c0c6560 0x7feb5c0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:16.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb61200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb5c0c6560 0x7feb5c0c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39508/0 (socket says 172.21.15.115:39508) 2024-05-12T10:50:16.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb61200640 1 -- 172.21.15.115:0/3994593275 learned_addr learned my addr 172.21.15.115:0/3994593275 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:16.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb5b400640 1 --2- 172.21.15.115:0/3994593275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb5c15cb30 0x7feb5c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:16.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb61200640 1 -- 172.21.15.115:0/3994593275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb5c15cb30 msgr2=0x7feb5c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:16.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb61200640 1 --2- 172.21.15.115:0/3994593275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb5c15cb30 0x7feb5c0c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb61200640 1 -- 172.21.15.115:0/3994593275 >> v1:172.21.15.134:6789/0 conn(0x7feb5c152a90 legacy=0x7feb5c1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:16.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb61200640 1 -- 172.21.15.115:0/3994593275 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c0ca850 con 0x7feb5c0c6560 2024-05-12T10:50:16.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb61200640 1 --2- 172.21.15.115:0/3994593275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb5c0c6560 0x7feb5c0c8f30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feb54009870 tx=0x7feb5401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead0ff79d328c89e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:16.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb5aa00640 1 -- 172.21.15.115:0/3994593275 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb540b2070 con 0x7feb5c0c6560 2024-05-12T10:50:16.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.545+0000 7feb5aa00640 1 -- 172.21.15.115:0/3994593275 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb540a9070 con 0x7feb5c0c6560 2024-05-12T10:50:16.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb5aa00640 1 -- 172.21.15.115:0/3994593275 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb540ad880 con 0x7feb5c0c6560 2024-05-12T10:50:16.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 -- 172.21.15.115:0/3994593275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb5c0c6560 msgr2=0x7feb5c0c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:16.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 --2- 172.21.15.115:0/3994593275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb5c0c6560 0x7feb5c0c8f30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feb54009870 tx=0x7feb5401c560 comp rx=0 tx=0).stop 2024-05-12T10:50:16.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 -- 172.21.15.115:0/3994593275 shutdown_connections 2024-05-12T10:50:16.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 --2- 172.21.15.115:0/3994593275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb5c0c6560 0x7feb5c0c8f30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 --2- 172.21.15.115:0/3994593275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb5c15cb30 0x7feb5c0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 -- 172.21.15.115:0/3994593275 >> 172.21.15.115:0/3994593275 conn(0x7feb5c0681c0 msgr2=0x7feb5c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:16.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 -- 172.21.15.115:0/3994593275 shutdown_connections 2024-05-12T10:50:16.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 -- 172.21.15.115:0/3994593275 wait complete. 2024-05-12T10:50:16.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 Processor -- start 2024-05-12T10:50:16.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 -- start start 2024-05-12T10:50:16.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb5c0c6560 0x7feb5c1f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb5c152a90 0x7feb5c162d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb5c15cb30 0x7feb5c151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c152ff0 con 0x7feb5c0c6560 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c152e70 con 0x7feb5c152a90 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb63200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7feb5c165ad0 con 0x7feb5c15cb30 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb5be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb5c0c6560 0x7feb5c1f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb5be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb5c0c6560 0x7feb5c1f4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39520/0 (socket says 172.21.15.115:39520) 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb5be00640 1 -- 172.21.15.115:0/178836692 learned_addr learned my addr 172.21.15.115:0/178836692 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb5b400640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb5c152a90 0x7feb5c162d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb5be00640 1 -- 172.21.15.115:0/178836692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb5c15cb30 msgr2=0x7feb5c151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb5be00640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb5c15cb30 0x7feb5c151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb5be00640 1 -- 172.21.15.115:0/178836692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb5c152a90 msgr2=0x7feb5c162d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb5be00640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb5c152a90 0x7feb5c162d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.549+0000 7feb5be00640 1 -- 172.21.15.115:0/178836692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c15acf0 con 0x7feb5c0c6560 2024-05-12T10:50:16.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.553+0000 7feb5be00640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb5c0c6560 0x7feb5c1f4f50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c8a0 tx=0x7feb4c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:16.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.553+0000 7feb53e00640 1 -- 172.21.15.115:0/178836692 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c003b80 con 0x7feb5c0c6560 2024-05-12T10:50:16.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.553+0000 7feb53e00640 1 -- 172.21.15.115:0/178836692 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c003d40 con 0x7feb5c0c6560 2024-05-12T10:50:16.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.553+0000 7feb53e00640 1 -- 172.21.15.115:0/178836692 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c00aa90 con 0x7feb5c0c6560 2024-05-12T10:50:16.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.553+0000 7feb63200640 1 -- 172.21.15.115:0/178836692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5c159c50 con 0x7feb5c0c6560 2024-05-12T10:50:16.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.553+0000 7feb63200640 1 -- 172.21.15.115:0/178836692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5c15a210 con 0x7feb5c0c6560 2024-05-12T10:50:16.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.553+0000 7feb63200640 1 -- 172.21.15.115:0/178836692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5c069730 con 0x7feb5c0c6560 2024-05-12T10:50:16.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.553+0000 7feb53e00640 1 -- 172.21.15.115:0/178836692 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7feb4c00ac30 con 0x7feb5c0c6560 2024-05-12T10:50:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.553+0000 7feb53e00640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7feb3c06f400 0x7feb3c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.553+0000 7feb53e00640 1 -- 172.21.15.115:0/178836692 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7feb4c0900a0 con 0x7feb5c0c6560 2024-05-12T10:50:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.557+0000 7feb5b400640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7feb3c06f400 0x7feb3c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:16.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.557+0000 7feb5b400640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7feb3c06f400 0x7feb3c0718c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feb5c1f2130 tx=0x7feb48008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:16.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.557+0000 7feb53e00640 1 -- 172.21.15.115:0/178836692 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7feb5c15acf0 con 0x7feb5c0c6560 2024-05-12T10:50:16.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.721+0000 7feb63200640 1 -- 172.21.15.115:0/178836692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb5c15b990 con 0x7feb5c0c6560 2024-05-12T10:50:16.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.721+0000 7feb53e00640 1 -- 172.21.15.115:0/178836692 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7feb4c05cc30 con 0x7feb5c0c6560 2024-05-12T10:50:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:16.717 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:01.648279+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:50:16.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.721+0000 7feb63200640 1 -- 172.21.15.115:0/178836692 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7feb3c06f400 msgr2=0x7feb3c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.721+0000 7feb63200640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7feb3c06f400 0x7feb3c0718c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feb5c1f2130 tx=0x7feb48008040 comp rx=0 tx=0).stop 2024-05-12T10:50:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.721+0000 7feb63200640 1 -- 172.21.15.115:0/178836692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb5c0c6560 msgr2=0x7feb5c1f4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.721+0000 7feb63200640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb5c0c6560 0x7feb5c1f4f50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c8a0 tx=0x7feb4c00cd60 comp rx=0 tx=0).stop 2024-05-12T10:50:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.725+0000 7feb63200640 1 -- 172.21.15.115:0/178836692 shutdown_connections 2024-05-12T10:50:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.725+0000 7feb63200640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7feb3c06f400 0x7feb3c0718c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.725+0000 7feb63200640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb5c15cb30 0x7feb5c151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.725+0000 7feb63200640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb5c152a90 0x7feb5c162d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.725+0000 7feb63200640 1 --2- 172.21.15.115:0/178836692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb5c0c6560 0x7feb5c1f4f50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.725+0000 7feb63200640 1 -- 172.21.15.115:0/178836692 >> 172.21.15.115:0/178836692 conn(0x7feb5c0681c0 msgr2=0x7feb5c0cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.725+0000 7feb63200640 1 -- 172.21.15.115:0/178836692 shutdown_connections 2024-05-12T10:50:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.725+0000 7feb63200640 1 -- 172.21.15.115:0/178836692 wait complete. 2024-05-12T10:50:16.739 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:50:16.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.877+0000 7fadd8e00640 1 Processor -- start 2024-05-12T10:50:16.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.877+0000 7fadd8e00640 1 -- start start 2024-05-12T10:50:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd8e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fadd4153de0 0x7fadd40c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd8e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fadd40cb4e0 0x7fadd40cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd8e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd415ab40 con 0x7fadd40ca040 2024-05-12T10:50:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd8e00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fadd40cbe70 con 0x7fadd4153de0 2024-05-12T10:50:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd8e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fadd4159ce0 con 0x7fadd40cb4e0 2024-05-12T10:50:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd1e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fadd4153de0 0x7fadd40c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd1e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fadd4153de0 0x7fadd40c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39530/0 (socket says 172.21.15.115:39530) 2024-05-12T10:50:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd1e00640 1 -- 172.21.15.115:0/1226542094 learned_addr learned my addr 172.21.15.115:0/1226542094 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd2800640 1 --2- 172.21.15.115:0/1226542094 >> v2:172.21.15.134:3300/0 conn(0x7fadd40cb4e0 0x7fadd40cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:16.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd1e00640 1 -- 172.21.15.115:0/1226542094 >> v2:172.21.15.134:3300/0 conn(0x7fadd40cb4e0 msgr2=0x7fadd40cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:16.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd1e00640 1 --2- 172.21.15.115:0/1226542094 >> v2:172.21.15.134:3300/0 conn(0x7fadd40cb4e0 0x7fadd40cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd1e00640 1 -- 172.21.15.115:0/1226542094 >> v1:172.21.15.134:6789/0 conn(0x7fadd40ca040 legacy=0x7fadd40cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:16.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd1e00640 1 -- 172.21.15.115:0/1226542094 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd4159fc0 con 0x7fadd4153de0 2024-05-12T10:50:16.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.881+0000 7fadd2800640 1 --2- 172.21.15.115:0/1226542094 >> v2:172.21.15.134:3300/0 conn(0x7fadd40cb4e0 0x7fadd40cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd1e00640 1 --2- 172.21.15.115:0/1226542094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadd4153de0 0x7fadd40c45f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fadd4071fc0 tx=0x7fadc401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a27da02d416a57a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd1400640 1 -- 172.21.15.115:0/1226542094 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc40b4070 con 0x7fadd4153de0 2024-05-12T10:50:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd1400640 1 -- 172.21.15.115:0/1226542094 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc40af400 con 0x7fadd4153de0 2024-05-12T10:50:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd1400640 1 -- 172.21.15.115:0/1226542094 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc40af7d0 con 0x7fadd4153de0 2024-05-12T10:50:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd8e00640 1 -- 172.21.15.115:0/1226542094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadd4153de0 msgr2=0x7fadd40c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd8e00640 1 --2- 172.21.15.115:0/1226542094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadd4153de0 0x7fadd40c45f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fadd4071fc0 tx=0x7fadc401f1e0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd8e00640 1 -- 172.21.15.115:0/1226542094 shutdown_connections 2024-05-12T10:50:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd8e00640 1 --2- 172.21.15.115:0/1226542094 >> v2:172.21.15.134:3300/0 conn(0x7fadd40cb4e0 0x7fadd40cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd8e00640 1 --2- 172.21.15.115:0/1226542094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadd4153de0 0x7fadd40c45f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd8e00640 1 -- 172.21.15.115:0/1226542094 >> 172.21.15.115:0/1226542094 conn(0x7fadd406c440 msgr2=0x7fadd406c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:16.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd8e00640 1 -- 172.21.15.115:0/1226542094 shutdown_connections 2024-05-12T10:50:16.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd8e00640 1 -- 172.21.15.115:0/1226542094 wait complete. 2024-05-12T10:50:16.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd8e00640 1 Processor -- start 2024-05-12T10:50:16.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.885+0000 7fadd8e00640 1 -- start start 2024-05-12T10:50:16.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd8e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadd40ca040 0x7fadd4157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd8e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadd40cb4e0 0x7fadd4155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd8e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadd4153de0 0x7fadd414fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd8e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fadd415a860 con 0x7fadd4153de0 2024-05-12T10:50:16.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd8e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fadd415a580 con 0x7fadd40cb4e0 2024-05-12T10:50:16.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd8e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fadd406d0b0 con 0x7fadd40ca040 2024-05-12T10:50:16.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd2800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadd4153de0 0x7fadd414fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:16.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd2800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadd4153de0 0x7fadd414fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39540/0 (socket says 172.21.15.115:39540) 2024-05-12T10:50:16.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd2800640 1 -- 172.21.15.115:0/559948886 learned_addr learned my addr 172.21.15.115:0/559948886 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:16.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd1e00640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadd40ca040 0x7fadd4157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadc9400640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadd40cb4e0 0x7fadd4155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd2800640 1 -- 172.21.15.115:0/559948886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadd40ca040 msgr2=0x7fadd4157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd2800640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadd40ca040 0x7fadd4157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd2800640 1 -- 172.21.15.115:0/559948886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadd40cb4e0 msgr2=0x7fadd4155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd2800640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadd40cb4e0 0x7fadd4155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd2800640 1 -- 172.21.15.115:0/559948886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd40cad40 con 0x7fadd4153de0 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadc9400640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadd40cb4e0 0x7fadd4155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd2800640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadd4153de0 0x7fadd414fbd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00e840 tx=0x7fadcc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadcaa00640 1 -- 172.21.15.115:0/559948886 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc017070 con 0x7fadd4153de0 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadcaa00640 1 -- 172.21.15.115:0/559948886 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadcc00c8d0 con 0x7fadd4153de0 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd8e00640 1 -- 172.21.15.115:0/559948886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd40cf440 con 0x7fadd4153de0 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadcaa00640 1 -- 172.21.15.115:0/559948886 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00f040 con 0x7fadd4153de0 2024-05-12T10:50:16.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd8e00640 1 -- 172.21.15.115:0/559948886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd4154cd0 con 0x7fadd4153de0 2024-05-12T10:50:16.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadd8e00640 1 -- 172.21.15.115:0/559948886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd4069730 con 0x7fadd4153de0 2024-05-12T10:50:16.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.889+0000 7fadcaa00640 1 -- 172.21.15.115:0/559948886 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fadcc01a070 con 0x7fadd4153de0 2024-05-12T10:50:16.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.893+0000 7fadcaa00640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadb006f400 0x7fadb00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:16.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.893+0000 7fadcaa00640 1 -- 172.21.15.115:0/559948886 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fadcc08f1c0 con 0x7fadd4153de0 2024-05-12T10:50:16.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.893+0000 7fadd1e00640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadb006f400 0x7fadb00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:16.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.893+0000 7fadd1e00640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadb006f400 0x7fadb00718c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fadc40b1000 tx=0x7fadc40aa000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:16.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:16.897+0000 7fadcaa00640 1 -- 172.21.15.115:0/559948886 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fadcc05b710 con 0x7fadd4153de0 2024-05-12T10:50:17.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.053+0000 7fadd8e00640 1 -- 172.21.15.115:0/559948886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadd40c5d50 con 0x7fadd4153de0 2024-05-12T10:50:17.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadcaa00640 1 -- 172.21.15.115:0/559948886 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7fadcc05fa10 con 0x7fadd4153de0 2024-05-12T10:50:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:17.052 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:01.648279+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:50:17.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 -- 172.21.15.115:0/559948886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadb006f400 msgr2=0x7fadb00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadb006f400 0x7fadb00718c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fadc40b1000 tx=0x7fadc40aa000 comp rx=0 tx=0).stop 2024-05-12T10:50:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 -- 172.21.15.115:0/559948886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadd4153de0 msgr2=0x7fadd414fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadd4153de0 0x7fadd414fbd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00e840 tx=0x7fadcc00ed00 comp rx=0 tx=0).stop 2024-05-12T10:50:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 -- 172.21.15.115:0/559948886 shutdown_connections 2024-05-12T10:50:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadb006f400 0x7fadb00718c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadd4153de0 0x7fadd414fbd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadd40cb4e0 0x7fadd4155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 --2- 172.21.15.115:0/559948886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadd40ca040 0x7fadd4157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 -- 172.21.15.115:0/559948886 >> 172.21.15.115:0/559948886 conn(0x7fadd406c440 msgr2=0x7fadd414e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 -- 172.21.15.115:0/559948886 shutdown_connections 2024-05-12T10:50:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.057+0000 7fadd8e00640 1 -- 172.21.15.115:0/559948886 wait complete. 2024-05-12T10:50:17.073 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-12T10:50:17.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.213+0000 7f104e400640 1 Processor -- start 2024-05-12T10:50:17.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.213+0000 7f104e400640 1 -- start start 2024-05-12T10:50:17.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f104e400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1048153e90 0x7f1048159a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f104e400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f10480cbba0 0x7f1048164350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f104e400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10480cb3e0 con 0x7f1048071a30 2024-05-12T10:50:17.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f104e400640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f10480caa40 con 0x7f10480cbba0 2024-05-12T10:50:17.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f104e400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f10480c6570 con 0x7f1048153e90 2024-05-12T10:50:17.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f1046a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1048071a30 0x7f10480cc060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51278/0 (socket says 172.21.15.115:51278) 2024-05-12T10:50:17.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f1046a00640 1 -- 172.21.15.115:0/330868296 learned_addr learned my addr 172.21.15.115:0/330868296 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:17.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f1047e00640 1 --2- 172.21.15.115:0/330868296 >> v2:172.21.15.115:3300/0 conn(0x7f10480cbba0 0x7f1048164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f1047400640 1 --2- 172.21.15.115:0/330868296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1048153e90 0x7f1048159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f1047e00640 1 -- 172.21.15.115:0/330868296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1048153e90 msgr2=0x7f1048159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:17.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f1047e00640 1 --2- 172.21.15.115:0/330868296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1048153e90 0x7f1048159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f1047e00640 1 -- 172.21.15.115:0/330868296 >> v1:172.21.15.115:6789/0 conn(0x7f1048071a30 legacy=0x7f10480cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f1047e00640 1 -- 172.21.15.115:0/330868296 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10480ca170 con 0x7f10480cbba0 2024-05-12T10:50:17.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.217+0000 7f1046000640 1 -- 172.21.15.115:0/330868296 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641174479 0 0) 0x7f10480cb3e0 con 0x7f1048071a30 2024-05-12T10:50:17.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f1047e00640 1 --2- 172.21.15.115:0/330868296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10480cbba0 0x7f1048164350 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10400097c0 tx=0x7f104001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0fc6d22f4f9bf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:17.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f1046000640 1 -- 172.21.15.115:0/330868296 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10400b1070 con 0x7f10480cbba0 2024-05-12T10:50:17.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f1046000640 1 -- 172.21.15.115:0/330868296 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10400ac410 con 0x7f10480cbba0 2024-05-12T10:50:17.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f1046000640 1 -- 172.21.15.115:0/330868296 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10400ac7e0 con 0x7f10480cbba0 2024-05-12T10:50:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f104e400640 1 -- 172.21.15.115:0/330868296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10480cbba0 msgr2=0x7f1048164350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f104e400640 1 --2- 172.21.15.115:0/330868296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10480cbba0 0x7f1048164350 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10400097c0 tx=0x7f104001c4a0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f104e400640 1 -- 172.21.15.115:0/330868296 shutdown_connections 2024-05-12T10:50:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f104e400640 1 --2- 172.21.15.115:0/330868296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10480cbba0 0x7f1048164350 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f104e400640 1 --2- 172.21.15.115:0/330868296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1048153e90 0x7f1048159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f104e400640 1 -- 172.21.15.115:0/330868296 >> 172.21.15.115:0/330868296 conn(0x7f1048072050 msgr2=0x7f1048072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f104e400640 1 -- 172.21.15.115:0/330868296 shutdown_connections 2024-05-12T10:50:17.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f104e400640 1 -- 172.21.15.115:0/330868296 wait complete. 2024-05-12T10:50:17.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f104e400640 1 Processor -- start 2024-05-12T10:50:17.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.221+0000 7f104e400640 1 -- start start 2024-05-12T10:50:17.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f104e400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1048071a30 0x7f1048151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f104e400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10480cbba0 0x7f10480b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f104e400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1048153e90 0x7f10481f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f104e400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1048167230 con 0x7f1048153e90 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f104e400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10481670b0 con 0x7f10480cbba0 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f104e400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f10481673b0 con 0x7f1048071a30 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f1047e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1048153e90 0x7f10481f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f1047e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1048153e90 0x7f10481f87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39546/0 (socket says 172.21.15.115:39546) 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f1047e00640 1 -- 172.21.15.115:0/1459257040 learned_addr learned my addr 172.21.15.115:0/1459257040 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f1046a00640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10480cbba0 0x7f10480b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f1047400640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1048071a30 0x7f1048151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f1047e00640 1 -- 172.21.15.115:0/1459257040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1048071a30 msgr2=0x7f1048151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f1047e00640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1048071a30 0x7f1048151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f1047e00640 1 -- 172.21.15.115:0/1459257040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10480cbba0 msgr2=0x7f10480b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f1047e00640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10480cbba0 0x7f10480b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f1047e00640 1 -- 172.21.15.115:0/1459257040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1048151ce0 con 0x7f1048153e90 2024-05-12T10:50:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f1047e00640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1048153e90 0x7f10481f87d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f104001a0d0 tx=0x7f1040019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f103f400640 1 -- 172.21.15.115:0/1459257040 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10400b1040 con 0x7f1048153e90 2024-05-12T10:50:17.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f103f400640 1 -- 172.21.15.115:0/1459257040 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10400bb070 con 0x7f1048153e90 2024-05-12T10:50:17.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f103f400640 1 -- 172.21.15.115:0/1459257040 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10400b5410 con 0x7f1048153e90 2024-05-12T10:50:17.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f104e400640 1 -- 172.21.15.115:0/1459257040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1048151a00 con 0x7f1048153e90 2024-05-12T10:50:17.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f104e400640 1 -- 172.21.15.115:0/1459257040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1048156a40 con 0x7f1048153e90 2024-05-12T10:50:17.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f104e400640 1 -- 172.21.15.115:0/1459257040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1048069730 con 0x7f1048153e90 2024-05-12T10:50:17.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.225+0000 7f103f400640 1 -- 172.21.15.115:0/1459257040 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f10400b55b0 con 0x7f1048153e90 2024-05-12T10:50:17.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.229+0000 7f103f400640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f102406f400 0x7f10240718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.229+0000 7f103f400640 1 -- 172.21.15.115:0/1459257040 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1040129110 con 0x7f1048153e90 2024-05-12T10:50:17.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.229+0000 7f1047400640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f102406f400 0x7f10240718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.229+0000 7f1047400640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f102406f400 0x7f10240718c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1038003fd0 tx=0x7f10380039a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:17.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.233+0000 7f103f400640 1 -- 172.21.15.115:0/1459257040 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1040016090 con 0x7f1048153e90 2024-05-12T10:50:17.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.421+0000 7f104e400640 1 -- 172.21.15.115:0/1459257040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f10480caf10 con 0x7f1048153e90 2024-05-12T10:50:17.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.705+0000 7f103f400640 1 -- 172.21.15.115:0/1459257040 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f10400f5cb0 con 0x7f1048153e90 2024-05-12T10:50:17.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 -- 172.21.15.115:0/1459257040 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f102406f400 msgr2=0x7f10240718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f102406f400 0x7f10240718c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1038003fd0 tx=0x7f10380039a0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 -- 172.21.15.115:0/1459257040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1048153e90 msgr2=0x7f10481f87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1048153e90 0x7f10481f87d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f104001a0d0 tx=0x7f1040019240 comp rx=0 tx=0).stop 2024-05-12T10:50:17.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 -- 172.21.15.115:0/1459257040 shutdown_connections 2024-05-12T10:50:17.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f102406f400 0x7f10240718c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1048153e90 0x7f10481f87d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10480cbba0 0x7f10480b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 --2- 172.21.15.115:0/1459257040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1048071a30 0x7f1048151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 -- 172.21.15.115:0/1459257040 >> 172.21.15.115:0/1459257040 conn(0x7f1048072050 msgr2=0x7f10481583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:17.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 -- 172.21.15.115:0/1459257040 shutdown_connections 2024-05-12T10:50:17.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.709+0000 7f104e400640 1 -- 172.21.15.115:0/1459257040 wait complete. 2024-05-12T10:50:17.724 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-05-12T10:50:17.724 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-05-12T10:50:17.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8fe00640 1 Processor -- start 2024-05-12T10:50:17.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8fe00640 1 -- start start 2024-05-12T10:50:17.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e88150310 0x7f0e880c4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8fe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e880c7780 0x7f0e881599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8fe00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e880c9370 con 0x7f0e881506f0 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8fe00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0e880c4ed0 con 0x7f0e880c7780 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8fe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0e880c9610 con 0x7f0e88150310 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8ca00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e880c7780 0x7f0e881599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8d400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e88150310 0x7f0e880c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8de00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0e881506f0 0x7f0e880c7e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:42378/0 (socket says 172.21.15.115:42378) 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8de00640 1 -- 172.21.15.115:0/2432852123 learned_addr learned my addr 172.21.15.115:0/2432852123 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8d400640 1 -- 172.21.15.115:0/2432852123 >> v2:172.21.15.134:3300/0 conn(0x7f0e880c7780 msgr2=0x7f0e881599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8d400640 1 --2- 172.21.15.115:0/2432852123 >> v2:172.21.15.134:3300/0 conn(0x7f0e880c7780 0x7f0e881599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8d400640 1 -- 172.21.15.115:0/2432852123 >> v1:172.21.15.134:6789/0 conn(0x7f0e881506f0 legacy=0x7f0e880c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.869+0000 7f0e8d400640 1 -- 172.21.15.115:0/2432852123 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e880c98d0 con 0x7f0e88150310 2024-05-12T10:50:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.873+0000 7f0e8ca00640 1 --2- 172.21.15.115:0/2432852123 >> v2:172.21.15.134:3300/0 conn(0x7f0e880c7780 0x7f0e881599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:17.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.873+0000 7f0e8d400640 1 --2- 172.21.15.115:0/2432852123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e88150310 0x7f0e880c4990 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0097c0 tx=0x7f0e7c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0669ad65ee6f594 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:17.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.873+0000 7f0e87e00640 1 -- 172.21.15.115:0/2432852123 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0a7070 con 0x7f0e88150310 2024-05-12T10:50:17.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.873+0000 7f0e87e00640 1 -- 172.21.15.115:0/2432852123 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e7c0b0070 con 0x7f0e88150310 2024-05-12T10:50:17.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.873+0000 7f0e87e00640 1 -- 172.21.15.115:0/2432852123 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0ab890 con 0x7f0e88150310 2024-05-12T10:50:17.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.873+0000 7f0e8fe00640 1 -- 172.21.15.115:0/2432852123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e88150310 msgr2=0x7f0e880c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.873+0000 7f0e8fe00640 1 --2- 172.21.15.115:0/2432852123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e88150310 0x7f0e880c4990 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0097c0 tx=0x7f0e7c01c470 comp rx=0 tx=0).stop 2024-05-12T10:50:17.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 -- 172.21.15.115:0/2432852123 shutdown_connections 2024-05-12T10:50:17.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 --2- 172.21.15.115:0/2432852123 >> v2:172.21.15.134:3300/0 conn(0x7f0e880c7780 0x7f0e881599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 --2- 172.21.15.115:0/2432852123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e88150310 0x7f0e880c4990 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 -- 172.21.15.115:0/2432852123 >> 172.21.15.115:0/2432852123 conn(0x7f0e88076830 msgr2=0x7f0e880681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:17.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 -- 172.21.15.115:0/2432852123 shutdown_connections 2024-05-12T10:50:17.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 -- 172.21.15.115:0/2432852123 wait complete. 2024-05-12T10:50:17.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 Processor -- start 2024-05-12T10:50:17.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 -- start start 2024-05-12T10:50:17.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e880c7780 0x7f0e88073690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e88150310 0x7f0e880ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e881506f0 0x7f0e88148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0e880c52a0 con 0x7f0e88150310 2024-05-12T10:50:17.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e880c5bb0 con 0x7f0e880c7780 2024-05-12T10:50:17.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8fe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0e880c60d0 con 0x7f0e881506f0 2024-05-12T10:50:17.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8ca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e88150310 0x7f0e880ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8ca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e88150310 0x7f0e880ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39550/0 (socket says 172.21.15.115:39550) 2024-05-12T10:50:17.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8ca00640 1 -- 172.21.15.115:0/1154286291 learned_addr learned my addr 172.21.15.115:0/1154286291 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:17.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8d400640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e880c7780 0x7f0e88073690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8de00640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e881506f0 0x7f0e88148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8ca00640 1 -- 172.21.15.115:0/1154286291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e881506f0 msgr2=0x7f0e88148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8ca00640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e881506f0 0x7f0e88148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8ca00640 1 -- 172.21.15.115:0/1154286291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e880c7780 msgr2=0x7f0e88073690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8ca00640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e880c7780 0x7f0e88073690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8ca00640 1 -- 172.21.15.115:0/1154286291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8814cde0 con 0x7f0e88150310 2024-05-12T10:50:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8d400640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e880c7780 0x7f0e88073690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e8ca00640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e88150310 0x7f0e880ccae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400ec10 tx=0x7f0e7400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.877+0000 7f0e85600640 1 -- 172.21.15.115:0/1154286291 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e74017070 con 0x7f0e88150310 2024-05-12T10:50:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.881+0000 7f0e85600640 1 -- 172.21.15.115:0/1154286291 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e7400cc30 con 0x7f0e88150310 2024-05-12T10:50:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.881+0000 7f0e85600640 1 -- 172.21.15.115:0/1154286291 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e74013470 con 0x7f0e88150310 2024-05-12T10:50:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.881+0000 7f0e8fe00640 1 -- 172.21.15.115:0/1154286291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e881f8c90 con 0x7f0e88150310 2024-05-12T10:50:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.881+0000 7f0e8fe00640 1 -- 172.21.15.115:0/1154286291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e88073340 con 0x7f0e88150310 2024-05-12T10:50:17.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.881+0000 7f0e8fe00640 1 -- 172.21.15.115:0/1154286291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e88069730 con 0x7f0e88150310 2024-05-12T10:50:17.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.881+0000 7f0e85600640 1 -- 172.21.15.115:0/1154286291 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0e7401a070 con 0x7f0e88150310 2024-05-12T10:50:17.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.881+0000 7f0e85600640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0e6806f400 0x7f0e680718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:17.879 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.881+0000 7f0e85600640 1 -- 172.21.15.115:0/1154286291 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0e7408f8a0 con 0x7f0e88150310 2024-05-12T10:50:17.879 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.881+0000 7f0e8d400640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0e6806f400 0x7f0e680718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:17.879 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.885+0000 7f0e8d400640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0e6806f400 0x7f0e680718c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0af000 tx=0x7f0e7c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:17.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:17.885+0000 7f0e85600640 1 -- 172.21.15.115:0/1154286291 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0e7405c4d0 con 0x7f0e88150310 2024-05-12T10:50:18.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.081+0000 7f0e8fe00640 1 -- 172.21.15.115:0/1154286291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f0e880c8940 con 0x7f0e88150310 2024-05-12T10:50:18.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.713+0000 7f0e85600640 1 -- 172.21.15.115:0/1154286291 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f0e7405bdd0 con 0x7f0e88150310 2024-05-12T10:50:18.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 -- 172.21.15.115:0/1154286291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0e6806f400 msgr2=0x7f0e680718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:18.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0e6806f400 0x7f0e680718c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0af000 tx=0x7f0e7c0a7000 comp rx=0 tx=0).stop 2024-05-12T10:50:18.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 -- 172.21.15.115:0/1154286291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e88150310 msgr2=0x7f0e880ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:18.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e88150310 0x7f0e880ccae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400ec10 tx=0x7f0e7400c520 comp rx=0 tx=0).stop 2024-05-12T10:50:18.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 -- 172.21.15.115:0/1154286291 shutdown_connections 2024-05-12T10:50:18.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0e6806f400 0x7f0e680718c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:18.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e881506f0 0x7f0e88148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:18.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e88150310 0x7f0e880ccae0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:18.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 --2- 172.21.15.115:0/1154286291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e880c7780 0x7f0e88073690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:18.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 -- 172.21.15.115:0/1154286291 >> 172.21.15.115:0/1154286291 conn(0x7f0e88076830 msgr2=0x7f0e8814de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:18.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 -- 172.21.15.115:0/1154286291 shutdown_connections 2024-05-12T10:50:18.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.717+0000 7f0e8fe00640 1 -- 172.21.15.115:0/1154286291 wait complete. 2024-05-12T10:50:18.734 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-12T10:50:18.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd61200640 1 Processor -- start 2024-05-12T10:50:18.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd61200640 1 -- start start 2024-05-12T10:50:18.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd61200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdd5c0b20a0 0x7fdd5c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:18.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd61200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd5c071a30 0x7fdd5c0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:18.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd61200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c0ca040 con 0x7fdd5c0cae10 2024-05-12T10:50:18.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd61200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdd5c0ca980 con 0x7fdd5c0b20a0 2024-05-12T10:50:18.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd61200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5c0cbde0 con 0x7fdd5c071a30 2024-05-12T10:50:18.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd59e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdd5c0b20a0 0x7fdd5c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:18.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd5a800640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fdd5c0cae10 0x7fdd5c15f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:42380/0 (socket says 172.21.15.115:42380) 2024-05-12T10:50:18.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd59400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd5c071a30 0x7fdd5c0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:18.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd5a800640 1 -- 172.21.15.115:0/1521109561 learned_addr learned my addr 172.21.15.115:0/1521109561 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:18.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd59400640 1 -- 172.21.15.115:0/1521109561 >> v2:172.21.15.134:3300/0 conn(0x7fdd5c0b20a0 msgr2=0x7fdd5c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:18.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd59400640 1 --2- 172.21.15.115:0/1521109561 >> v2:172.21.15.134:3300/0 conn(0x7fdd5c0b20a0 0x7fdd5c15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:18.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd59400640 1 -- 172.21.15.115:0/1521109561 >> v1:172.21.15.134:6789/0 conn(0x7fdd5c0cae10 legacy=0x7fdd5c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:18.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd59400640 1 -- 172.21.15.115:0/1521109561 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c071260 con 0x7fdd5c071a30 2024-05-12T10:50:18.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.877+0000 7fdd59e00640 1 --2- 172.21.15.115:0/1521109561 >> v2:172.21.15.134:3300/0 conn(0x7fdd5c0b20a0 0x7fdd5c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:18.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.881+0000 7fdd59400640 1 --2- 172.21.15.115:0/1521109561 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd5c071a30 0x7fdd5c0cc060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd480097c0 tx=0x7fdd4801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea2389d85dd36463 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:18.879 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.881+0000 7fdd58a00640 1 -- 172.21.15.115:0/1521109561 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480b5070 con 0x7fdd5c071a30 2024-05-12T10:50:18.879 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.881+0000 7fdd58a00640 1 -- 172.21.15.115:0/1521109561 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd480a8990 con 0x7fdd5c071a30 2024-05-12T10:50:18.879 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.881+0000 7fdd58a00640 1 -- 172.21.15.115:0/1521109561 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480a8d60 con 0x7fdd5c071a30 2024-05-12T10:50:18.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.881+0000 7fdd61200640 1 -- 172.21.15.115:0/1521109561 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd5c071a30 msgr2=0x7fdd5c0cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:18.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.881+0000 7fdd61200640 1 --2- 172.21.15.115:0/1521109561 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd5c071a30 0x7fdd5c0cc060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd480097c0 tx=0x7fdd4801ec90 comp rx=0 tx=0).stop 2024-05-12T10:50:18.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 -- 172.21.15.115:0/1521109561 shutdown_connections 2024-05-12T10:50:18.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 --2- 172.21.15.115:0/1521109561 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd5c071a30 0x7fdd5c0cc060 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:18.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 --2- 172.21.15.115:0/1521109561 >> v2:172.21.15.134:3300/0 conn(0x7fdd5c0b20a0 0x7fdd5c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:18.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 -- 172.21.15.115:0/1521109561 >> 172.21.15.115:0/1521109561 conn(0x7fdd5c072050 msgr2=0x7fdd5c072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:18.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 -- 172.21.15.115:0/1521109561 shutdown_connections 2024-05-12T10:50:18.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 -- 172.21.15.115:0/1521109561 wait complete. 2024-05-12T10:50:18.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 Processor -- start 2024-05-12T10:50:18.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 -- start start 2024-05-12T10:50:18.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd5c071a30 0x7fdd5c1f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:18.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5c0b20a0 0x7fdd5c0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:18.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd5c0cae10 0x7fdd5c0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:18.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c071540 con 0x7fdd5c0b20a0 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c0cbb00 con 0x7fdd5c071a30 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd61200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5c15c340 con 0x7fdd5c0cae10 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd59400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5c0b20a0 0x7fdd5c0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd59400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5c0b20a0 0x7fdd5c0c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39564/0 (socket says 172.21.15.115:39564) 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd59400640 1 -- 172.21.15.115:0/858389200 learned_addr learned my addr 172.21.15.115:0/858389200 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd59e00640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd5c071a30 0x7fdd5c1f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd5a800640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd5c0cae10 0x7fdd5c0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd59400640 1 -- 172.21.15.115:0/858389200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd5c0cae10 msgr2=0x7fdd5c0b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd59400640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd5c0cae10 0x7fdd5c0b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd59400640 1 -- 172.21.15.115:0/858389200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd5c071a30 msgr2=0x7fdd5c1f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd59400640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd5c071a30 0x7fdd5c1f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd59400640 1 -- 172.21.15.115:0/858389200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c1f5820 con 0x7fdd5c0b20a0 2024-05-12T10:50:18.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd59e00640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd5c071a30 0x7fdd5c1f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:18.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.885+0000 7fdd59400640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5c0b20a0 0x7fdd5c0c5f40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd480b3040 tx=0x7fdd4801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:18.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.889+0000 7fdd52000640 1 -- 172.21.15.115:0/858389200 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480bf070 con 0x7fdd5c0b20a0 2024-05-12T10:50:18.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.889+0000 7fdd52000640 1 -- 172.21.15.115:0/858389200 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd480b07a0 con 0x7fdd5c0b20a0 2024-05-12T10:50:18.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.889+0000 7fdd61200640 1 -- 172.21.15.115:0/858389200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5c1f5ab0 con 0x7fdd5c0b20a0 2024-05-12T10:50:18.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.889+0000 7fdd52000640 1 -- 172.21.15.115:0/858389200 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480b5040 con 0x7fdd5c0b20a0 2024-05-12T10:50:18.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.889+0000 7fdd61200640 1 -- 172.21.15.115:0/858389200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5c1f6070 con 0x7fdd5c0b20a0 2024-05-12T10:50:18.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.889+0000 7fdd61200640 1 -- 172.21.15.115:0/858389200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5c069730 con 0x7fdd5c0b20a0 2024-05-12T10:50:18.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.889+0000 7fdd52000640 1 -- 172.21.15.115:0/858389200 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdd480b0b90 con 0x7fdd5c0b20a0 2024-05-12T10:50:18.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.889+0000 7fdd52000640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdd3c06f400 0x7fdd3c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:18.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.889+0000 7fdd52000640 1 -- 172.21.15.115:0/858389200 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdd4812bf90 con 0x7fdd5c0b20a0 2024-05-12T10:50:18.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.889+0000 7fdd59e00640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdd3c06f400 0x7fdd3c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:18.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.889+0000 7fdd59e00640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdd3c06f400 0x7fdd3c0718c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009bc0 tx=0x7fdd4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:18.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:18.893+0000 7fdd52000640 1 -- 172.21.15.115:0/858389200 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fdd480187f0 con 0x7fdd5c0b20a0 2024-05-12T10:50:19.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.085+0000 7fdd61200640 1 -- 172.21.15.115:0/858389200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fdd5c071810 con 0x7fdd5c0b20a0 2024-05-12T10:50:19.083 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:50:19.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:50:19.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.725+0000 7fdd52000640 1 -- 172.21.15.115:0/858389200 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fdd480f8460 con 0x7fdd5c0b20a0 2024-05-12T10:50:19.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 -- 172.21.15.115:0/858389200 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdd3c06f400 msgr2=0x7fdd3c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:19.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdd3c06f400 0x7fdd3c0718c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009bc0 tx=0x7fdd4c008040 comp rx=0 tx=0).stop 2024-05-12T10:50:19.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 -- 172.21.15.115:0/858389200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5c0b20a0 msgr2=0x7fdd5c0c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:19.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5c0b20a0 0x7fdd5c0c5f40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd480b3040 tx=0x7fdd4801ba30 comp rx=0 tx=0).stop 2024-05-12T10:50:19.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 -- 172.21.15.115:0/858389200 shutdown_connections 2024-05-12T10:50:19.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdd3c06f400 0x7fdd3c0718c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:19.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd5c0cae10 0x7fdd5c0b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:19.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd5c0b20a0 0x7fdd5c0c5f40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:19.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 --2- 172.21.15.115:0/858389200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd5c071a30 0x7fdd5c1f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:19.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 -- 172.21.15.115:0/858389200 >> 172.21.15.115:0/858389200 conn(0x7fdd5c072050 msgr2=0x7fdd5c15a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:19.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 -- 172.21.15.115:0/858389200 shutdown_connections 2024-05-12T10:50:19.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.729+0000 7fdd61200640 1 -- 172.21.15.115:0/858389200 wait complete. 2024-05-12T10:50:19.745 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-12T10:50:19.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd2c400640 1 Processor -- start 2024-05-12T10:50:19.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd2c400640 1 -- start start 2024-05-12T10:50:19.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd2c400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcd24152a10 0x7fcd24159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:19.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd2c400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd2415be20 con 0x7fcd24073820 2024-05-12T10:50:19.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd2c400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd24072cf0 con 0x7fcd24152df0 2024-05-12T10:50:19.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd2c400640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fcd24072fd0 con 0x7fcd24152a10 2024-05-12T10:50:19.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd2a400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcd24073820 0x7fcd2415c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51288/0 (socket says 172.21.15.115:51288) 2024-05-12T10:50:19.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd29a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcd24152a10 0x7fcd24159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:19.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd2a400640 1 -- 172.21.15.115:0/1439317140 learned_addr learned my addr 172.21.15.115:0/1439317140 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:19.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd29a00640 1 -- 172.21.15.115:0/1439317140 >> v1:172.21.15.134:6789/0 conn(0x7fcd24152df0 legacy=0x7fcd24073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:19.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd29a00640 1 -- 172.21.15.115:0/1439317140 >> v1:172.21.15.115:6789/0 conn(0x7fcd24073820 legacy=0x7fcd2415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:19.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd29a00640 1 -- 172.21.15.115:0/1439317140 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd240c4990 con 0x7fcd24152a10 2024-05-12T10:50:19.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.889+0000 7fcd23e00640 1 -- 172.21.15.115:0/1439317140 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556479210 0 0) 0x7fcd2415be20 con 0x7fcd24073820 2024-05-12T10:50:19.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.893+0000 7fcd29a00640 1 --2- 172.21.15.115:0/1439317140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd24152a10 0x7fcd24159310 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcd180097c0 tx=0x7fcd1801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f037b4aff3daf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:19.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.893+0000 7fcd23e00640 1 -- 172.21.15.115:0/1439317140 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd180b5070 con 0x7fcd24152a10 2024-05-12T10:50:19.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.893+0000 7fcd23e00640 1 -- 172.21.15.115:0/1439317140 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd180a8990 con 0x7fcd24152a10 2024-05-12T10:50:19.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.893+0000 7fcd23e00640 1 -- 172.21.15.115:0/1439317140 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd180a8d60 con 0x7fcd24152a10 2024-05-12T10:50:19.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.893+0000 7fcd2c400640 1 -- 172.21.15.115:0/1439317140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd24152a10 msgr2=0x7fcd24159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:19.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.893+0000 7fcd2c400640 1 --2- 172.21.15.115:0/1439317140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd24152a10 0x7fcd24159310 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcd180097c0 tx=0x7fcd1801ec90 comp rx=0 tx=0).stop 2024-05-12T10:50:19.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.893+0000 7fcd2c400640 1 -- 172.21.15.115:0/1439317140 shutdown_connections 2024-05-12T10:50:19.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.893+0000 7fcd2c400640 1 --2- 172.21.15.115:0/1439317140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd24152a10 0x7fcd24159310 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:19.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.893+0000 7fcd2c400640 1 -- 172.21.15.115:0/1439317140 >> 172.21.15.115:0/1439317140 conn(0x7fcd24076830 msgr2=0x7fcd240681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:19.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.893+0000 7fcd2c400640 1 -- 172.21.15.115:0/1439317140 shutdown_connections 2024-05-12T10:50:19.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.893+0000 7fcd2c400640 1 -- 172.21.15.115:0/1439317140 wait complete. 2024-05-12T10:50:19.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2c400640 1 Processor -- start 2024-05-12T10:50:19.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2c400640 1 -- start start 2024-05-12T10:50:19.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2c400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd24073820 0x7fcd24157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:19.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2c400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd24152a10 0x7fcd24153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:19.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2c400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd24152df0 0x7fcd2414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:19.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2c400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcd24073460 con 0x7fcd24152a10 2024-05-12T10:50:19.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2c400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcd240c4f50 con 0x7fcd24152df0 2024-05-12T10:50:19.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2c400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcd240735e0 con 0x7fcd24073820 2024-05-12T10:50:19.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd29000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd24152a10 0x7fcd24153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd29000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd24152a10 0x7fcd24153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39572/0 (socket says 172.21.15.115:39572) 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd29000640 1 -- 172.21.15.115:0/1047251673 learned_addr learned my addr 172.21.15.115:0/1047251673 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2a400640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd24152df0 0x7fcd2414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd29a00640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd24073820 0x7fcd24157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd29000640 1 -- 172.21.15.115:0/1047251673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd24073820 msgr2=0x7fcd24157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd29000640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd24073820 0x7fcd24157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd29000640 1 -- 172.21.15.115:0/1047251673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd24152df0 msgr2=0x7fcd2414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd29000640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd24152df0 0x7fcd2414e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd29000640 1 -- 172.21.15.115:0/1047251673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd24070d50 con 0x7fcd24152a10 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2a400640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd24152df0 0x7fcd2414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd29a00640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd24073820 0x7fcd24157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd29000640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd24152a10 0x7fcd24153200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000c460 tx=0x7fcd1000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd21600640 1 -- 172.21.15.115:0/1047251673 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd100052d0 con 0x7fcd24152a10 2024-05-12T10:50:19.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd21600640 1 -- 172.21.15.115:0/1047251673 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd10005470 con 0x7fcd24152a10 2024-05-12T10:50:19.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd21600640 1 -- 172.21.15.115:0/1047251673 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10012870 con 0x7fcd24152a10 2024-05-12T10:50:19.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2c400640 1 -- 172.21.15.115:0/1047251673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2414ce40 con 0x7fcd24152a10 2024-05-12T10:50:19.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2c400640 1 -- 172.21.15.115:0/1047251673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd24155850 con 0x7fcd24152a10 2024-05-12T10:50:19.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.897+0000 7fcd2c400640 1 -- 172.21.15.115:0/1047251673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd24069730 con 0x7fcd24152a10 2024-05-12T10:50:19.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.901+0000 7fcd21600640 1 -- 172.21.15.115:0/1047251673 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcd10012a10 con 0x7fcd24152a10 2024-05-12T10:50:19.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.901+0000 7fcd21600640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcd0406f400 0x7fcd040718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:19.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.901+0000 7fcd21600640 1 -- 172.21.15.115:0/1047251673 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcd1008f220 con 0x7fcd24152a10 2024-05-12T10:50:19.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.901+0000 7fcd29a00640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcd0406f400 0x7fcd040718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:19.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.901+0000 7fcd29a00640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcd0406f400 0x7fcd040718c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd180b2000 tx=0x7fcd18008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:19.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:19.905+0000 7fcd21600640 1 -- 172.21.15.115:0/1047251673 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcd1005bd30 con 0x7fcd24152a10 2024-05-12T10:50:20.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.097+0000 7fcd2c400640 1 -- 172.21.15.115:0/1047251673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fcd240c52f0 con 0x7fcd24152a10 2024-05-12T10:50:20.728 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.733+0000 7fcd21600640 1 -- 172.21.15.115:0/1047251673 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7fcd1005b630 con 0x7fcd24152a10 2024-05-12T10:50:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.733+0000 7fcd2c400640 1 -- 172.21.15.115:0/1047251673 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcd0406f400 msgr2=0x7fcd040718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.733+0000 7fcd2c400640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcd0406f400 0x7fcd040718c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd180b2000 tx=0x7fcd18008040 comp rx=0 tx=0).stop 2024-05-12T10:50:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.733+0000 7fcd2c400640 1 -- 172.21.15.115:0/1047251673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd24152a10 msgr2=0x7fcd24153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.733+0000 7fcd2c400640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd24152a10 0x7fcd24153200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000c460 tx=0x7fcd1000c920 comp rx=0 tx=0).stop 2024-05-12T10:50:20.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.737+0000 7fcd2c400640 1 -- 172.21.15.115:0/1047251673 shutdown_connections 2024-05-12T10:50:20.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.737+0000 7fcd2c400640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcd0406f400 0x7fcd040718c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:20.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.737+0000 7fcd2c400640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd24152df0 0x7fcd2414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:20.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.737+0000 7fcd2c400640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd24152a10 0x7fcd24153200 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:20.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.737+0000 7fcd2c400640 1 --2- 172.21.15.115:0/1047251673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd24073820 0x7fcd24157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:20.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.737+0000 7fcd2c400640 1 -- 172.21.15.115:0/1047251673 >> 172.21.15.115:0/1047251673 conn(0x7fcd24076830 msgr2=0x7fcd240ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:20.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.737+0000 7fcd2c400640 1 -- 172.21.15.115:0/1047251673 shutdown_connections 2024-05-12T10:50:20.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.737+0000 7fcd2c400640 1 -- 172.21.15.115:0/1047251673 wait complete. 2024-05-12T10:50:20.753 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-12T10:50:20.754 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:50:20.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22b6a00640 1 Processor -- start 2024-05-12T10:50:20.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22b6a00640 1 -- start start 2024-05-12T10:50:20.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22b6a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22b0159430 0x7f22b00cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:20.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22b6a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f22b00c9fd0 0x7f22b00cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:20.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22b6a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22b00c5050 con 0x7f22b00c45f0 2024-05-12T10:50:20.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22b6a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f22b00c5c20 con 0x7f22b0159430 2024-05-12T10:50:20.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22b6a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f22b00c52f0 con 0x7f22b00c9fd0 2024-05-12T10:50:20.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22afe00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22b0159430 0x7f22b00cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:20.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22b4a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f22b00c45f0 0x7f22b015f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51292/0 (socket says 172.21.15.115:51292) 2024-05-12T10:50:20.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22b4a00640 1 -- 172.21.15.115:0/79714428 learned_addr learned my addr 172.21.15.115:0/79714428 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:20.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22a7400640 1 --2- 172.21.15.115:0/79714428 >> v2:172.21.15.134:3300/0 conn(0x7f22b00c9fd0 0x7f22b00cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:20.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22afe00640 1 -- 172.21.15.115:0/79714428 >> v2:172.21.15.134:3300/0 conn(0x7f22b00c9fd0 msgr2=0x7f22b00cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:20.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22afe00640 1 --2- 172.21.15.115:0/79714428 >> v2:172.21.15.134:3300/0 conn(0x7f22b00c9fd0 0x7f22b00cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:20.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22afe00640 1 -- 172.21.15.115:0/79714428 >> v1:172.21.15.115:6789/0 conn(0x7f22b00c45f0 legacy=0x7f22b015f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:20.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22afe00640 1 -- 172.21.15.115:0/79714428 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b00c55d0 con 0x7f22b0159430 2024-05-12T10:50:20.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.897+0000 7f22af400640 1 -- 172.21.15.115:0/79714428 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065723269 0 0) 0x7f22b00c5050 con 0x7f22b00c45f0 2024-05-12T10:50:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22afe00640 1 --2- 172.21.15.115:0/79714428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b0159430 0x7f22b00cf560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22b00c6480 tx=0x7f22a001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be543fe62114155 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22af400640 1 -- 172.21.15.115:0/79714428 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a00b5070 con 0x7f22b0159430 2024-05-12T10:50:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22af400640 1 -- 172.21.15.115:0/79714428 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a00a8970 con 0x7f22b0159430 2024-05-12T10:50:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22af400640 1 -- 172.21.15.115:0/79714428 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a00a8d40 con 0x7f22b0159430 2024-05-12T10:50:20.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22b6a00640 1 -- 172.21.15.115:0/79714428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b0159430 msgr2=0x7f22b00cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:20.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22b6a00640 1 --2- 172.21.15.115:0/79714428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b0159430 0x7f22b00cf560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22b00c6480 tx=0x7f22a001ec70 comp rx=0 tx=0).stop 2024-05-12T10:50:20.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22b6a00640 1 -- 172.21.15.115:0/79714428 shutdown_connections 2024-05-12T10:50:20.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22b6a00640 1 --2- 172.21.15.115:0/79714428 >> v2:172.21.15.134:3300/0 conn(0x7f22b00c9fd0 0x7f22b00cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:20.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22b6a00640 1 --2- 172.21.15.115:0/79714428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b0159430 0x7f22b00cf560 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:20.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22b6a00640 1 -- 172.21.15.115:0/79714428 >> 172.21.15.115:0/79714428 conn(0x7f22b006c440 msgr2=0x7f22b006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:20.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22b6a00640 1 -- 172.21.15.115:0/79714428 shutdown_connections 2024-05-12T10:50:20.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.901+0000 7f22b6a00640 1 -- 172.21.15.115:0/79714428 wait complete. 2024-05-12T10:50:20.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b6a00640 1 Processor -- start 2024-05-12T10:50:20.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b6a00640 1 -- start start 2024-05-12T10:50:20.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b6a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b00c45f0 0x7f22b01f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:20.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b6a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b00c9fd0 0x7f22b00b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:20.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b6a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b0159430 0x7f22b015e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:20.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b6a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f22b006d180 con 0x7f22b00c45f0 2024-05-12T10:50:20.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b6a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22b00ca580 con 0x7f22b00c9fd0 2024-05-12T10:50:20.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b6a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f22b00cbcc0 con 0x7f22b0159430 2024-05-12T10:50:20.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22afe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b00c45f0 0x7f22b01f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:20.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22afe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b00c45f0 0x7f22b01f26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39582/0 (socket says 172.21.15.115:39582) 2024-05-12T10:50:20.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22afe00640 1 -- 172.21.15.115:0/1420511448 learned_addr learned my addr 172.21.15.115:0/1420511448 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:20.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22a7400640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b00c9fd0 0x7f22b00b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:20.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b4a00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b0159430 0x7f22b015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22afe00640 1 -- 172.21.15.115:0/1420511448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b0159430 msgr2=0x7f22b015e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22afe00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b0159430 0x7f22b015e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22afe00640 1 -- 172.21.15.115:0/1420511448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b00c9fd0 msgr2=0x7f22b00b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22afe00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b00c9fd0 0x7f22b00b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22afe00640 1 -- 172.21.15.115:0/1420511448 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b01f2bf0 con 0x7f22b00c45f0 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b4a00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b0159430 0x7f22b015e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22afe00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b00c45f0 0x7f22b01f26b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22a001c8a0 tx=0x7f22a001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22acc00640 1 -- 172.21.15.115:0/1420511448 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a00bf070 con 0x7f22b00c45f0 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22acc00640 1 -- 172.21.15.115:0/1420511448 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a00b07a0 con 0x7f22b00c45f0 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b6a00640 1 -- 172.21.15.115:0/1420511448 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b00b1850 con 0x7f22b00c45f0 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22acc00640 1 -- 172.21.15.115:0/1420511448 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a00b5040 con 0x7f22b00c45f0 2024-05-12T10:50:20.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b6a00640 1 -- 172.21.15.115:0/1420511448 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b00c87f0 con 0x7f22b00c45f0 2024-05-12T10:50:20.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.905+0000 7f22b6a00640 1 -- 172.21.15.115:0/1420511448 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b0069730 con 0x7f22b00c45f0 2024-05-12T10:50:20.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.909+0000 7f22acc00640 1 -- 172.21.15.115:0/1420511448 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f22a00c2070 con 0x7f22b00c45f0 2024-05-12T10:50:20.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.909+0000 7f22acc00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f228c06f400 0x7f228c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:20.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.909+0000 7f22acc00640 1 -- 172.21.15.115:0/1420511448 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f22a012be30 con 0x7f22b00c45f0 2024-05-12T10:50:20.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.909+0000 7f22a7400640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f228c06f400 0x7f228c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:20.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.909+0000 7f22a7400640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f228c06f400 0x7f228c0718c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f22b006f3f0 tx=0x7f2298008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:20.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:20.913+0000 7f22acc00640 1 -- 172.21.15.115:0/1420511448 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f22a00187d0 con 0x7f22b00c45f0 2024-05-12T10:50:21.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.101+0000 7f22b6a00640 1 -- 172.21.15.115:0/1420511448 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22b0074a40 con 0x7f22b00c45f0 2024-05-12T10:50:21.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.101+0000 7f22acc00640 1 -- 172.21.15.115:0/1420511448 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6862 (secure 0 0 0) 0x7f22a00f8950 con 0x7f22b00c45f0 2024-05-12T10:50:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:21.099 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:20.103005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4321,"mds_1":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4321]},"id":1}]} 2024-05-12T10:50:21.099 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 11 2024-05-12T10:50:21.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 -- 172.21.15.115:0/1420511448 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f228c06f400 msgr2=0x7f228c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f228c06f400 0x7f228c0718c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f22b006f3f0 tx=0x7f2298008040 comp rx=0 tx=0).stop 2024-05-12T10:50:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 -- 172.21.15.115:0/1420511448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b00c45f0 msgr2=0x7f22b01f26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b00c45f0 0x7f22b01f26b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22a001c8a0 tx=0x7f22a001ba10 comp rx=0 tx=0).stop 2024-05-12T10:50:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 -- 172.21.15.115:0/1420511448 shutdown_connections 2024-05-12T10:50:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f228c06f400 0x7f228c0718c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b0159430 0x7f22b015e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b00c9fd0 0x7f22b00b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 --2- 172.21.15.115:0/1420511448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b00c45f0 0x7f22b01f26b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 -- 172.21.15.115:0/1420511448 >> 172.21.15.115:0/1420511448 conn(0x7f22b006c440 msgr2=0x7f22b00cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 -- 172.21.15.115:0/1420511448 shutdown_connections 2024-05-12T10:50:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.105+0000 7f22b6a00640 1 -- 172.21.15.115:0/1420511448 wait complete. 2024-05-12T10:50:21.120 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:50:21.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.257+0000 7fbb23000640 1 Processor -- start 2024-05-12T10:50:21.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.257+0000 7fbb23000640 1 -- start start 2024-05-12T10:50:21.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb23000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbb1c15cb30 0x7fbb1c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb23000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb1c0c6560 0x7fbb1c0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb23000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c0ca850 con 0x7fbb1c152a90 2024-05-12T10:50:21.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb23000640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1c0c4f80 con 0x7fbb1c15cb30 2024-05-12T10:50:21.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb23000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbb1c0cae10 con 0x7fbb1c0c6560 2024-05-12T10:50:21.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb1b400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbb1c15cb30 0x7fbb1c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb1b400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbb1c15cb30 0x7fbb1c0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39598/0 (socket says 172.21.15.115:39598) 2024-05-12T10:50:21.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb1b400640 1 -- 172.21.15.115:0/3117913062 learned_addr learned my addr 172.21.15.115:0/3117913062 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:21.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb21000640 1 --2- 172.21.15.115:0/3117913062 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb1c0c6560 0x7fbb1c0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb1b400640 1 -- 172.21.15.115:0/3117913062 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb1c0c6560 msgr2=0x7fbb1c0c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:21.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb1b400640 1 --2- 172.21.15.115:0/3117913062 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb1c0c6560 0x7fbb1c0c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb1b400640 1 -- 172.21.15.115:0/3117913062 >> v1:172.21.15.134:6789/0 conn(0x7fbb1c152a90 legacy=0x7fbb1c1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:21.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.261+0000 7fbb1b400640 1 -- 172.21.15.115:0/3117913062 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c0cab30 con 0x7fbb1c15cb30 2024-05-12T10:50:21.259 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb1b400640 1 --2- 172.21.15.115:0/3117913062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb1c15cb30 0x7fbb1c0c4920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009870 tx=0x7fbb0801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da75defb77771e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:21.259 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb1aa00640 1 -- 172.21.15.115:0/3117913062 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb080b0070 con 0x7fbb1c15cb30 2024-05-12T10:50:21.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb1aa00640 1 -- 172.21.15.115:0/3117913062 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb080ab600 con 0x7fbb1c15cb30 2024-05-12T10:50:21.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb1aa00640 1 -- 172.21.15.115:0/3117913062 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb080ab9d0 con 0x7fbb1c15cb30 2024-05-12T10:50:21.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 -- 172.21.15.115:0/3117913062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb1c15cb30 msgr2=0x7fbb1c0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 --2- 172.21.15.115:0/3117913062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb1c15cb30 0x7fbb1c0c4920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009870 tx=0x7fbb0801c500 comp rx=0 tx=0).stop 2024-05-12T10:50:21.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 -- 172.21.15.115:0/3117913062 shutdown_connections 2024-05-12T10:50:21.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 --2- 172.21.15.115:0/3117913062 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb1c0c6560 0x7fbb1c0c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 --2- 172.21.15.115:0/3117913062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb1c15cb30 0x7fbb1c0c4920 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 -- 172.21.15.115:0/3117913062 >> 172.21.15.115:0/3117913062 conn(0x7fbb1c0681c0 msgr2=0x7fbb1c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:21.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 -- 172.21.15.115:0/3117913062 shutdown_connections 2024-05-12T10:50:21.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 -- 172.21.15.115:0/3117913062 wait complete. 2024-05-12T10:50:21.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 Processor -- start 2024-05-12T10:50:21.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 -- start start 2024-05-12T10:50:21.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb1c0c6560 0x7fbb1c0cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb1c152a90 0x7fbb1c1f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb1c15cb30 0x7fbb1c1f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c152ff0 con 0x7fbb1c0c6560 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c152e70 con 0x7fbb1c152a90 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb23000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbb1c165ad0 con 0x7fbb1c15cb30 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb1be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb1c0c6560 0x7fbb1c0cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb1be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb1c0c6560 0x7fbb1c0cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39600/0 (socket says 172.21.15.115:39600) 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.265+0000 7fbb1be00640 1 -- 172.21.15.115:0/1645383348 learned_addr learned my addr 172.21.15.115:0/1645383348 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb21000640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb1c15cb30 0x7fbb1c1f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb1b400640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb1c152a90 0x7fbb1c1f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb1be00640 1 -- 172.21.15.115:0/1645383348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb1c15cb30 msgr2=0x7fbb1c1f6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb1be00640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb1c15cb30 0x7fbb1c1f6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb1be00640 1 -- 172.21.15.115:0/1645383348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb1c152a90 msgr2=0x7fbb1c1f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb1be00640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb1c152a90 0x7fbb1c1f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb1be00640 1 -- 172.21.15.115:0/1645383348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c1f84b0 con 0x7fbb1c0c6560 2024-05-12T10:50:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb1b400640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb1c152a90 0x7fbb1c1f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:21.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb21000640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb1c15cb30 0x7fbb1c1f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:21.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb1be00640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb1c0c6560 0x7fbb1c0cbdf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00c7c0 tx=0x7fbb0c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb13e00640 1 -- 172.21.15.115:0/1645383348 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c016020 con 0x7fbb1c0c6560 2024-05-12T10:50:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb13e00640 1 -- 172.21.15.115:0/1645383348 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0c00aa50 con 0x7fbb1c0c6560 2024-05-12T10:50:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb13e00640 1 -- 172.21.15.115:0/1645383348 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00ae40 con 0x7fbb1c0c6560 2024-05-12T10:50:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb23000640 1 -- 172.21.15.115:0/1645383348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c1f8790 con 0x7fbb1c0c6560 2024-05-12T10:50:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb23000640 1 -- 172.21.15.115:0/1645383348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1c1f8d50 con 0x7fbb1c0c6560 2024-05-12T10:50:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb23000640 1 -- 172.21.15.115:0/1645383348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1c069730 con 0x7fbb1c0c6560 2024-05-12T10:50:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.269+0000 7fbb13e00640 1 -- 172.21.15.115:0/1645383348 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbb0c019020 con 0x7fbb1c0c6560 2024-05-12T10:50:21.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.273+0000 7fbb13e00640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbafc06f400 0x7fbafc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.273+0000 7fbb13e00640 1 -- 172.21.15.115:0/1645383348 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbb0c08f740 con 0x7fbb1c0c6560 2024-05-12T10:50:21.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.273+0000 7fbb1b400640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbafc06f400 0x7fbafc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.273+0000 7fbb1b400640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbafc06f400 0x7fbafc0718c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb080ad000 tx=0x7fbb08008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:21.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.277+0000 7fbb13e00640 1 -- 172.21.15.115:0/1645383348 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbb0c020030 con 0x7fbb1c0c6560 2024-05-12T10:50:21.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.433+0000 7fbb23000640 1 -- 172.21.15.115:0/1645383348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb1c072f40 con 0x7fbb1c0c6560 2024-05-12T10:50:21.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb13e00640 1 -- 172.21.15.115:0/1645383348 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7fbb0c05c250 con 0x7fbb1c0c6560 2024-05-12T10:50:21.431 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:21.432 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:01.648279+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:50:21.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 -- 172.21.15.115:0/1645383348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbafc06f400 msgr2=0x7fbafc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbafc06f400 0x7fbafc0718c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb080ad000 tx=0x7fbb08008040 comp rx=0 tx=0).stop 2024-05-12T10:50:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 -- 172.21.15.115:0/1645383348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb1c0c6560 msgr2=0x7fbb1c0cbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb1c0c6560 0x7fbb1c0cbdf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00c7c0 tx=0x7fbb0c00cc80 comp rx=0 tx=0).stop 2024-05-12T10:50:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 -- 172.21.15.115:0/1645383348 shutdown_connections 2024-05-12T10:50:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbafc06f400 0x7fbafc0718c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb1c15cb30 0x7fbb1c1f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb1c152a90 0x7fbb1c1f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 --2- 172.21.15.115:0/1645383348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb1c0c6560 0x7fbb1c0cbdf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 -- 172.21.15.115:0/1645383348 >> 172.21.15.115:0/1645383348 conn(0x7fbb1c0681c0 msgr2=0x7fbb1c155230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 -- 172.21.15.115:0/1645383348 shutdown_connections 2024-05-12T10:50:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.437+0000 7fbb23000640 1 -- 172.21.15.115:0/1645383348 wait complete. 2024-05-12T10:50:21.452 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-12T10:50:21.453 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:50:21.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff4a1800640 1 Processor -- start 2024-05-12T10:50:21.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff4a1800640 1 -- start start 2024-05-12T10:50:21.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff4a1800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49c153c50 0x7ff49c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff4a1800640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff49c0c94c0 con 0x7ff49c06cbd0 2024-05-12T10:50:21.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff4a1800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff49c070e40 con 0x7ff49c154030 2024-05-12T10:50:21.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff4a1800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff49c071120 con 0x7ff49c153c50 2024-05-12T10:50:21.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff49b400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff49c06cbd0 0x7ff49c15d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51296/0 (socket says 172.21.15.115:51296) 2024-05-12T10:50:21.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff49b400640 1 -- 172.21.15.115:0/1709304034 learned_addr learned my addr 172.21.15.115:0/1709304034 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:21.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff49aa00640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49c153c50 0x7ff49c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381012763 0 0) 0x7ff49c0c94c0 con 0x7ff49c06cbd0 2024-05-12T10:50:21.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff480003530 con 0x7ff49c06cbd0 2024-05-12T10:50:21.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3559220382 0 0) 0x7ff49c070e40 con 0x7ff49c154030 2024-05-12T10:50:21.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff49c0c94c0 con 0x7ff49c154030 2024-05-12T10:50:21.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 808718859 0 0) 0x7ff480003530 con 0x7ff49c06cbd0 2024-05-12T10:50:21.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49c153c50 msgr2=0x7ff49c0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:21.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49c153c50 0x7ff49c0c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 >> v1:172.21.15.134:6789/0 conn(0x7ff49c154030 legacy=0x7ff49c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c071400 con 0x7ff49c06cbd0 2024-05-12T10:50:21.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7ff494001a80 con 0x7ff49c06cbd0 2024-05-12T10:50:21.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 >> v1:172.21.15.115:6789/0 conn(0x7ff49c06cbd0 legacy=0x7ff49c15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49c153c50 0x7ff480003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4800041d0 0x7ff480004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff480004d50 0x7ff4800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c071120 con 0x7ff480004d50 2024-05-12T10:50:21.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff48000bb90 con 0x7ff4800041d0 2024-05-12T10:50:21.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff48000bd90 con 0x7ff49c153c50 2024-05-12T10:50:21.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff49a000640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4800041d0 0x7ff480004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff49b400640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff480004d50 0x7ff4800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.593+0000 7ff49aa00640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49c153c50 0x7ff480003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff49b400640 1 -- 172.21.15.115:0/1709304034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49c153c50 msgr2=0x7ff480003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:21.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff49b400640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49c153c50 0x7ff480003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff49b400640 1 -- 172.21.15.115:0/1709304034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4800041d0 msgr2=0x7ff480004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:21.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff49b400640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4800041d0 0x7ff480004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff49b400640 1 -- 172.21.15.115:0/1709304034 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff480003530 con 0x7ff480004d50 2024-05-12T10:50:21.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff49b400640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff480004d50 0x7ff4800051d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff49c06a360 tx=0x7ff49401d1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a0d3d1a0e1c8f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:21.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49400a3f0 con 0x7ff480004d50 2024-05-12T10:50:21.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4940ad630 con 0x7ff480004d50 2024-05-12T10:50:21.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff499600640 1 -- 172.21.15.115:0/1709304034 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4940a5e60 con 0x7ff480004d50 2024-05-12T10:50:21.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff4a1800640 1 -- 172.21.15.115:0/1709304034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff480004d50 msgr2=0x7ff4800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff4a1800640 1 --2- 172.21.15.115:0/1709304034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff480004d50 0x7ff4800051d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff49c06a360 tx=0x7ff49401d1e0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff49b400640 1 -- 172.21.15.115:0/1709304034 reap_dead start 2024-05-12T10:50:21.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff4a1800640 1 -- 172.21.15.115:0/1709304034 shutdown_connections 2024-05-12T10:50:21.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff4a1800640 1 -- 172.21.15.115:0/1709304034 >> 172.21.15.115:0/1709304034 conn(0x7ff49c076890 msgr2=0x7ff49c0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:21.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff4a1800640 1 -- 172.21.15.115:0/1709304034 shutdown_connections 2024-05-12T10:50:21.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.597+0000 7ff4a1800640 1 -- 172.21.15.115:0/1709304034 wait complete. 2024-05-12T10:50:21.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff4a1800640 1 Processor -- start 2024-05-12T10:50:21.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff4a1800640 1 -- start start 2024-05-12T10:50:21.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff4a1800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff480004d50 0x7ff49c1f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff4a1800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff49c0cf040 0x7ff49c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff4a1800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff49c151a00 0x7ff49c0cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff4a1800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c0c82c0 con 0x7ff49c0cf040 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff4a1800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c074930 con 0x7ff49c151a00 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff4a1800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff49c0c8440 con 0x7ff480004d50 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49a000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff49c0cf040 0x7ff49c1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49a000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff49c0cf040 0x7ff49c1514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39604/0 (socket says 172.21.15.115:39604) 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49a000640 1 -- 172.21.15.115:0/1158335789 learned_addr learned my addr 172.21.15.115:0/1158335789 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49aa00640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff480004d50 0x7ff49c1f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49b400640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff49c151a00 0x7ff49c0cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49a000640 1 -- 172.21.15.115:0/1158335789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff480004d50 msgr2=0x7ff49c1f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49a000640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff480004d50 0x7ff49c1f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49a000640 1 -- 172.21.15.115:0/1158335789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff49c151a00 msgr2=0x7ff49c0cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49a000640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff49c151a00 0x7ff49c0cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49a000640 1 -- 172.21.15.115:0/1158335789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c1f51e0 con 0x7ff49c0cf040 2024-05-12T10:50:21.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49aa00640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff480004d50 0x7ff49c1f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:21.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff49a000640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff49c0cf040 0x7ff49c1514c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff488000c10 tx=0x7ff48800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:21.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff492a00640 1 -- 172.21.15.115:0/1158335789 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48800fe50 con 0x7ff49c0cf040 2024-05-12T10:50:21.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff492a00640 1 -- 172.21.15.115:0/1158335789 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff488018070 con 0x7ff49c0cf040 2024-05-12T10:50:21.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff4a1800640 1 -- 172.21.15.115:0/1158335789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff49c1e3ce0 con 0x7ff49c0cf040 2024-05-12T10:50:21.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff492a00640 1 -- 172.21.15.115:0/1158335789 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48800d6d0 con 0x7ff49c0cf040 2024-05-12T10:50:21.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.601+0000 7ff4a1800640 1 -- 172.21.15.115:0/1158335789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49c0cc2a0 con 0x7ff49c0cf040 2024-05-12T10:50:21.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.605+0000 7ff4a1800640 1 -- 172.21.15.115:0/1158335789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff49c069730 con 0x7ff49c0cf040 2024-05-12T10:50:21.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.605+0000 7ff492a00640 1 -- 172.21.15.115:0/1158335789 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff48800d870 con 0x7ff49c0cf040 2024-05-12T10:50:21.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.605+0000 7ff492a00640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff47c06f430 0x7ff47c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.605+0000 7ff492a00640 1 -- 172.21.15.115:0/1158335789 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff48808f530 con 0x7ff49c0cf040 2024-05-12T10:50:21.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.605+0000 7ff49aa00640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff47c06f430 0x7ff47c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.605+0000 7ff49aa00640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff47c06f430 0x7ff47c0718f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009be0 tx=0x7ff48c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:21.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.609+0000 7ff492a00640 1 -- 172.21.15.115:0/1158335789 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff48805c0e0 con 0x7ff49c0cf040 2024-05-12T10:50:21.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.769+0000 7ff4a1800640 1 -- 172.21.15.115:0/1158335789 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff49c06d200 con 0x7ff47c06f430 2024-05-12T10:50:21.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.777+0000 7ff492a00640 1 -- 172.21.15.115:0/1158335789 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7ff49c06d200 con 0x7ff47c06f430 2024-05-12T10:50:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:21.779 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:50:21.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 -- 172.21.15.115:0/1158335789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff47c06f430 msgr2=0x7ff47c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff47c06f430 0x7ff47c0718f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009be0 tx=0x7ff48c008040 comp rx=0 tx=0).stop 2024-05-12T10:50:21.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 -- 172.21.15.115:0/1158335789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff49c0cf040 msgr2=0x7ff49c1514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff49c0cf040 0x7ff49c1514c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff488000c10 tx=0x7ff48800fc00 comp rx=0 tx=0).stop 2024-05-12T10:50:21.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 -- 172.21.15.115:0/1158335789 shutdown_connections 2024-05-12T10:50:21.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff47c06f430 0x7ff47c0718f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff49c151a00 0x7ff49c0cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff49c0cf040 0x7ff49c1514c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 --2- 172.21.15.115:0/1158335789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff480004d50 0x7ff49c1f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 -- 172.21.15.115:0/1158335789 >> 172.21.15.115:0/1158335789 conn(0x7ff49c076890 msgr2=0x7ff49c0caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:21.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 -- 172.21.15.115:0/1158335789 shutdown_connections 2024-05-12T10:50:21.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.781+0000 7ff4a1800640 1 -- 172.21.15.115:0/1158335789 wait complete. 2024-05-12T10:50:21.796 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-05-12T10:50:21.755780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219524,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755196,"statfs":{"total":773094113280,"available":772869320704,"internally_reserved":0,"allocated":3448832,"data_stored":2075584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003120"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838171+0000","last_change":"2024-05-12T10:49:54.640093+0000","last_active":"2024-05-12T10:50:02.838171+0000","last_peered":"2024-05-12T10:50:02.838171+0000","last_clean":"2024-05-12T10:50:02.838171+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:50:02.838171+0000","last_undegraded":"2024-05-12T10:50:02.838171+0000","last_fullsized":"2024-05-12T10:50:02.838171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:07:41.639104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653116+0000","last_change":"2024-05-12T10:49:55.635928+0000","last_active":"2024-05-12T10:50:01.653116+0000","last_peered":"2024-05-12T10:50:01.653116+0000","last_clean":"2024-05-12T10:50:01.653116+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:50:01.653116+0000","last_undegraded":"2024-05-12T10:50:01.653116+0000","last_fullsized":"2024-05-12T10:50:01.653116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:41:30.909036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652376+0000","last_change":"2024-05-12T10:50:00.396417+0000","last_active":"2024-05-12T10:50:01.652376+0000","last_peered":"2024-05-12T10:50:01.652376+0000","last_clean":"2024-05-12T10:50:01.652376+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:50:01.652376+0000","last_undegraded":"2024-05-12T10:50:01.652376+0000","last_fullsized":"2024-05-12T10:50:01.652376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:27.287617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653306+0000","last_change":"2024-05-12T10:49:54.619268+0000","last_active":"2024-05-12T10:50:01.653306+0000","last_peered":"2024-05-12T10:50:01.653306+0000","last_clean":"2024-05-12T10:50:01.653306+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:50:01.653306+0000","last_undegraded":"2024-05-12T10:50:01.653306+0000","last_fullsized":"2024-05-12T10:50:01.653306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:50:34.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837930+0000","last_change":"2024-05-12T10:49:55.624986+0000","last_active":"2024-05-12T10:50:02.837930+0000","last_peered":"2024-05-12T10:50:02.837930+0000","last_clean":"2024-05-12T10:50:02.837930+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:50:02.837930+0000","last_undegraded":"2024-05-12T10:50:02.837930+0000","last_fullsized":"2024-05-12T10:50:02.837930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:03:47.220979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657155+0000","last_change":"2024-05-12T10:49:59.676139+0000","last_active":"2024-05-12T10:50:01.657155+0000","last_peered":"2024-05-12T10:50:01.657155+0000","last_clean":"2024-05-12T10:50:01.657155+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:50:01.657155+0000","last_undegraded":"2024-05-12T10:50:01.657155+0000","last_fullsized":"2024-05-12T10:50:01.657155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:24:15.396258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.918980+0000","last_change":"2024-05-12T10:49:54.645331+0000","last_active":"2024-05-12T10:50:02.918980+0000","last_peered":"2024-05-12T10:50:02.918980+0000","last_clean":"2024-05-12T10:50:02.918980+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:50:02.918980+0000","last_undegraded":"2024-05-12T10:50:02.918980+0000","last_fullsized":"2024-05-12T10:50:02.918980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:38:29.023589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658144+0000","last_change":"2024-05-12T10:49:55.642386+0000","last_active":"2024-05-12T10:50:01.658144+0000","last_peered":"2024-05-12T10:50:01.658144+0000","last_clean":"2024-05-12T10:50:01.658144+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:50:01.658144+0000","last_undegraded":"2024-05-12T10:50:01.658144+0000","last_fullsized":"2024-05-12T10:50:01.658144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:54:40.153070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657964+0000","last_change":"2024-05-12T10:49:59.679887+0000","last_active":"2024-05-12T10:50:01.657964+0000","last_peered":"2024-05-12T10:50:01.657964+0000","last_clean":"2024-05-12T10:50:01.657964+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:50:01.657964+0000","last_undegraded":"2024-05-12T10:50:01.657964+0000","last_fullsized":"2024-05-12T10:50:01.657964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:25:43.004918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919021+0000","last_change":"2024-05-12T10:49:54.659229+0000","last_active":"2024-05-12T10:50:02.919021+0000","last_peered":"2024-05-12T10:50:02.919021+0000","last_clean":"2024-05-12T10:50:02.919021+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:50:02.919021+0000","last_undegraded":"2024-05-12T10:50:02.919021+0000","last_fullsized":"2024-05-12T10:50:02.919021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:54:54.658165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660005+0000","last_change":"2024-05-12T10:49:55.642157+0000","last_active":"2024-05-12T10:50:01.660005+0000","last_peered":"2024-05-12T10:50:01.660005+0000","last_clean":"2024-05-12T10:50:01.660005+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:50:01.660005+0000","last_undegraded":"2024-05-12T10:50:01.660005+0000","last_fullsized":"2024-05-12T10:50:01.660005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:16.232731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658776+0000","last_change":"2024-05-12T10:49:59.663411+0000","last_active":"2024-05-12T10:50:01.658776+0000","last_peered":"2024-05-12T10:50:01.658776+0000","last_clean":"2024-05-12T10:50:01.658776+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:50:01.658776+0000","last_undegraded":"2024-05-12T10:50:01.658776+0000","last_fullsized":"2024-05-12T10:50:01.658776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:59.136704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075711+0000","last_change":"2024-05-12T10:49:55.646019+0000","last_active":"2024-05-12T10:50:02.075711+0000","last_peered":"2024-05-12T10:50:02.075711+0000","last_clean":"2024-05-12T10:50:02.075711+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:50:02.075711+0000","last_undegraded":"2024-05-12T10:50:02.075711+0000","last_fullsized":"2024-05-12T10:50:02.075711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:07.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919034+0000","last_change":"2024-05-12T10:49:54.642039+0000","last_active":"2024-05-12T10:50:02.919034+0000","last_peered":"2024-05-12T10:50:02.919034+0000","last_clean":"2024-05-12T10:50:02.919034+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:50:02.919034+0000","last_undegraded":"2024-05-12T10:50:02.919034+0000","last_fullsized":"2024-05-12T10:50:02.919034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:01.155569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660588+0000","last_change":"2024-05-12T10:49:59.660274+0000","last_active":"2024-05-12T10:50:01.660588+0000","last_peered":"2024-05-12T10:50:01.660588+0000","last_clean":"2024-05-12T10:50:01.660588+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:50:01.660588+0000","last_undegraded":"2024-05-12T10:50:01.660588+0000","last_fullsized":"2024-05-12T10:50:01.660588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:55:12.579645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652722+0000","last_change":"2024-05-12T10:49:55.618128+0000","last_active":"2024-05-12T10:50:01.652722+0000","last_peered":"2024-05-12T10:50:01.652722+0000","last_clean":"2024-05-12T10:50:01.652722+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:50:01.652722+0000","last_undegraded":"2024-05-12T10:50:01.652722+0000","last_fullsized":"2024-05-12T10:50:01.652722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:45.205117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915833+0000","last_change":"2024-05-12T10:49:54.619967+0000","last_active":"2024-05-12T10:50:02.915833+0000","last_peered":"2024-05-12T10:50:02.915833+0000","last_clean":"2024-05-12T10:50:02.915833+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:50:02.915833+0000","last_undegraded":"2024-05-12T10:50:02.915833+0000","last_fullsized":"2024-05-12T10:50:02.915833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:37:10.799631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659650+0000","last_change":"2024-05-12T10:49:59.681931+0000","last_active":"2024-05-12T10:50:01.659650+0000","last_peered":"2024-05-12T10:50:01.659650+0000","last_clean":"2024-05-12T10:50:01.659650+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:50:01.659650+0000","last_undegraded":"2024-05-12T10:50:01.659650+0000","last_fullsized":"2024-05-12T10:50:01.659650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:45:01.542628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652721+0000","last_change":"2024-05-12T10:49:55.615095+0000","last_active":"2024-05-12T10:50:01.652721+0000","last_peered":"2024-05-12T10:50:01.652721+0000","last_clean":"2024-05-12T10:50:01.652721+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:50:01.652721+0000","last_undegraded":"2024-05-12T10:50:01.652721+0000","last_fullsized":"2024-05-12T10:50:01.652721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:51:19.659941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916206+0000","last_change":"2024-05-12T10:49:54.639976+0000","last_active":"2024-05-12T10:50:02.916206+0000","last_peered":"2024-05-12T10:50:02.916206+0000","last_clean":"2024-05-12T10:50:02.916206+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:50:02.916206+0000","last_undegraded":"2024-05-12T10:50:02.916206+0000","last_fullsized":"2024-05-12T10:50:02.916206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:28:37.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916755+0000","last_change":"2024-05-12T10:50:00.390786+0000","last_active":"2024-05-12T10:50:02.916755+0000","last_peered":"2024-05-12T10:50:02.916755+0000","last_clean":"2024-05-12T10:50:02.916755+0000","last_became_active":"2024-05-12T10:50:00.390378+0000","last_became_peered":"2024-05-12T10:50:00.390378+0000","last_unstale":"2024-05-12T10:50:02.916755+0000","last_undegraded":"2024-05-12T10:50:02.916755+0000","last_fullsized":"2024-05-12T10:50:02.916755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:27:57.945259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658891+0000","last_change":"2024-05-12T10:49:55.622729+0000","last_active":"2024-05-12T10:50:01.658891+0000","last_peered":"2024-05-12T10:50:01.658891+0000","last_clean":"2024-05-12T10:50:01.658891+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:50:01.658891+0000","last_undegraded":"2024-05-12T10:50:01.658891+0000","last_fullsized":"2024-05-12T10:50:01.658891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:08:29.460684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919516+0000","last_change":"2024-05-12T10:49:54.639564+0000","last_active":"2024-05-12T10:50:02.919516+0000","last_peered":"2024-05-12T10:50:02.919516+0000","last_clean":"2024-05-12T10:50:02.919516+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:50:02.919516+0000","last_undegraded":"2024-05-12T10:50:02.919516+0000","last_fullsized":"2024-05-12T10:50:02.919516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:54:48.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.661417+0000","last_change":"2024-05-12T10:49:59.676220+0000","last_active":"2024-05-12T10:50:01.661417+0000","last_peered":"2024-05-12T10:50:01.661417+0000","last_clean":"2024-05-12T10:50:01.661417+0000","last_became_active":"2024-05-12T10:49:59.674835+0000","last_became_peered":"2024-05-12T10:49:59.674835+0000","last_unstale":"2024-05-12T10:50:01.661417+0000","last_undegraded":"2024-05-12T10:50:01.661417+0000","last_fullsized":"2024-05-12T10:50:01.661417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:55:03.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838015+0000","last_change":"2024-05-12T10:49:55.612744+0000","last_active":"2024-05-12T10:50:02.838015+0000","last_peered":"2024-05-12T10:50:02.838015+0000","last_clean":"2024-05-12T10:50:02.838015+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:50:02.838015+0000","last_undegraded":"2024-05-12T10:50:02.838015+0000","last_fullsized":"2024-05-12T10:50:02.838015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:05:06.274277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.077180+0000","last_change":"2024-05-12T10:49:54.643375+0000","last_active":"2024-05-12T10:50:02.077180+0000","last_peered":"2024-05-12T10:50:02.077180+0000","last_clean":"2024-05-12T10:50:02.077180+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:50:02.077180+0000","last_undegraded":"2024-05-12T10:50:02.077180+0000","last_fullsized":"2024-05-12T10:50:02.077180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:56:43.086871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658181+0000","last_change":"2024-05-12T10:50:00.393325+0000","last_active":"2024-05-12T10:50:01.658181+0000","last_peered":"2024-05-12T10:50:01.658181+0000","last_clean":"2024-05-12T10:50:01.658181+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:50:01.658181+0000","last_undegraded":"2024-05-12T10:50:01.658181+0000","last_fullsized":"2024-05-12T10:50:01.658181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:55.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653561+0000","last_change":"2024-05-12T10:49:55.629693+0000","last_active":"2024-05-12T10:50:01.653561+0000","last_peered":"2024-05-12T10:50:01.653561+0000","last_clean":"2024-05-12T10:50:01.653561+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:50:01.653561+0000","last_undegraded":"2024-05-12T10:50:01.653561+0000","last_fullsized":"2024-05-12T10:50:01.653561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:04:13.325079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915903+0000","last_change":"2024-05-12T10:49:54.629227+0000","last_active":"2024-05-12T10:50:02.915903+0000","last_peered":"2024-05-12T10:50:02.915903+0000","last_clean":"2024-05-12T10:50:02.915903+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:50:02.915903+0000","last_undegraded":"2024-05-12T10:50:02.915903+0000","last_fullsized":"2024-05-12T10:50:02.915903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:03.097527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652367+0000","last_change":"2024-05-12T10:50:00.396371+0000","last_active":"2024-05-12T10:50:01.652367+0000","last_peered":"2024-05-12T10:50:01.652367+0000","last_clean":"2024-05-12T10:50:01.652367+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:50:01.652367+0000","last_undegraded":"2024-05-12T10:50:01.652367+0000","last_fullsized":"2024-05-12T10:50:01.652367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:41:09.157859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916505+0000","last_change":"2024-05-12T10:49:55.612069+0000","last_active":"2024-05-12T10:50:02.916505+0000","last_peered":"2024-05-12T10:50:02.916505+0000","last_clean":"2024-05-12T10:50:02.916505+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:50:02.916505+0000","last_undegraded":"2024-05-12T10:50:02.916505+0000","last_fullsized":"2024-05-12T10:50:02.916505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:38.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921005+0000","last_change":"2024-05-12T10:49:54.639928+0000","last_active":"2024-05-12T10:50:02.921005+0000","last_peered":"2024-05-12T10:50:02.921005+0000","last_clean":"2024-05-12T10:50:02.921005+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:50:02.921005+0000","last_undegraded":"2024-05-12T10:50:02.921005+0000","last_fullsized":"2024-05-12T10:50:02.921005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:59.215089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837562+0000","last_change":"2024-05-12T10:50:00.383605+0000","last_active":"2024-05-12T10:50:02.837562+0000","last_peered":"2024-05-12T10:50:02.837562+0000","last_clean":"2024-05-12T10:50:02.837562+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:50:02.837562+0000","last_undegraded":"2024-05-12T10:50:02.837562+0000","last_fullsized":"2024-05-12T10:50:02.837562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:28.619988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660251+0000","last_change":"2024-05-12T10:49:55.621201+0000","last_active":"2024-05-12T10:50:01.660251+0000","last_peered":"2024-05-12T10:50:01.660251+0000","last_clean":"2024-05-12T10:50:01.660251+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:50:01.660251+0000","last_undegraded":"2024-05-12T10:50:01.660251+0000","last_fullsized":"2024-05-12T10:50:01.660251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:19:39.117790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916601+0000","last_change":"2024-05-12T10:49:54.620329+0000","last_active":"2024-05-12T10:50:02.916601+0000","last_peered":"2024-05-12T10:50:02.916601+0000","last_clean":"2024-05-12T10:50:02.916601+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:50:02.916601+0000","last_undegraded":"2024-05-12T10:50:02.916601+0000","last_fullsized":"2024-05-12T10:50:02.916601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:21:10.386830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916162+0000","last_change":"2024-05-12T10:49:59.655432+0000","last_active":"2024-05-12T10:50:02.916162+0000","last_peered":"2024-05-12T10:50:02.916162+0000","last_clean":"2024-05-12T10:50:02.916162+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:50:02.916162+0000","last_undegraded":"2024-05-12T10:50:02.916162+0000","last_fullsized":"2024-05-12T10:50:02.916162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:27:34.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658413+0000","last_change":"2024-05-12T10:49:55.628221+0000","last_active":"2024-05-12T10:50:01.658413+0000","last_peered":"2024-05-12T10:50:01.658413+0000","last_clean":"2024-05-12T10:50:01.658413+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:50:01.658413+0000","last_undegraded":"2024-05-12T10:50:01.658413+0000","last_fullsized":"2024-05-12T10:50:01.658413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:54.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659836+0000","last_change":"2024-05-12T10:49:54.652499+0000","last_active":"2024-05-12T10:50:01.659836+0000","last_peered":"2024-05-12T10:50:01.659836+0000","last_clean":"2024-05-12T10:50:01.659836+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:50:01.659836+0000","last_undegraded":"2024-05-12T10:50:01.659836+0000","last_fullsized":"2024-05-12T10:50:01.659836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:14:35.180779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916502+0000","last_change":"2024-05-12T10:49:59.676676+0000","last_active":"2024-05-12T10:50:02.916502+0000","last_peered":"2024-05-12T10:50:02.916502+0000","last_clean":"2024-05-12T10:50:02.916502+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:50:02.916502+0000","last_undegraded":"2024-05-12T10:50:02.916502+0000","last_fullsized":"2024-05-12T10:50:02.916502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:03:13.485130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916164+0000","last_change":"2024-05-12T10:49:55.610830+0000","last_active":"2024-05-12T10:50:02.916164+0000","last_peered":"2024-05-12T10:50:02.916164+0000","last_clean":"2024-05-12T10:50:02.916164+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:50:02.916164+0000","last_undegraded":"2024-05-12T10:50:02.916164+0000","last_fullsized":"2024-05-12T10:50:02.916164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:15.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101999+0000","last_change":"2024-05-12T10:49:54.609239+0000","last_active":"2024-05-12T10:50:02.101999+0000","last_peered":"2024-05-12T10:50:02.101999+0000","last_clean":"2024-05-12T10:50:02.101999+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:50:02.101999+0000","last_undegraded":"2024-05-12T10:50:02.101999+0000","last_fullsized":"2024-05-12T10:50:02.101999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:12:54.169428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916817+0000","last_change":"2024-05-12T10:49:59.656739+0000","last_active":"2024-05-12T10:50:02.916817+0000","last_peered":"2024-05-12T10:50:02.916817+0000","last_clean":"2024-05-12T10:50:02.916817+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:50:02.916817+0000","last_undegraded":"2024-05-12T10:50:02.916817+0000","last_fullsized":"2024-05-12T10:50:02.916817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:05.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837232+0000","last_change":"2024-05-12T10:49:55.626312+0000","last_active":"2024-05-12T10:50:02.837232+0000","last_peered":"2024-05-12T10:50:02.837232+0000","last_clean":"2024-05-12T10:50:02.837232+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:50:02.837232+0000","last_undegraded":"2024-05-12T10:50:02.837232+0000","last_fullsized":"2024-05-12T10:50:02.837232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:36.639971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919870+0000","last_change":"2024-05-12T10:49:54.640819+0000","last_active":"2024-05-12T10:50:02.919870+0000","last_peered":"2024-05-12T10:50:02.919870+0000","last_clean":"2024-05-12T10:50:02.919870+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:50:02.919870+0000","last_undegraded":"2024-05-12T10:50:02.919870+0000","last_fullsized":"2024-05-12T10:50:02.919870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:01.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837983+0000","last_change":"2024-05-12T10:50:00.384347+0000","last_active":"2024-05-12T10:50:02.837983+0000","last_peered":"2024-05-12T10:50:02.837983+0000","last_clean":"2024-05-12T10:50:02.837983+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:50:02.837983+0000","last_undegraded":"2024-05-12T10:50:02.837983+0000","last_fullsized":"2024-05-12T10:50:02.837983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:30.794704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652533+0000","last_change":"2024-05-12T10:49:55.627340+0000","last_active":"2024-05-12T10:50:01.652533+0000","last_peered":"2024-05-12T10:50:01.652533+0000","last_clean":"2024-05-12T10:50:01.652533+0000","last_became_active":"2024-05-12T10:49:55.627065+0000","last_became_peered":"2024-05-12T10:49:55.627065+0000","last_unstale":"2024-05-12T10:50:01.652533+0000","last_undegraded":"2024-05-12T10:50:01.652533+0000","last_fullsized":"2024-05-12T10:50:01.652533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:57:50.849518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658936+0000","last_change":"2024-05-12T10:49:54.648333+0000","last_active":"2024-05-12T10:50:01.658936+0000","last_peered":"2024-05-12T10:50:01.658936+0000","last_clean":"2024-05-12T10:50:01.658936+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:50:01.658936+0000","last_undegraded":"2024-05-12T10:50:01.658936+0000","last_fullsized":"2024-05-12T10:50:01.658936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:29.355444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920043+0000","last_change":"2024-05-12T10:49:45.547469+0000","last_active":"2024-05-12T10:50:02.920043+0000","last_peered":"2024-05-12T10:50:02.920043+0000","last_clean":"2024-05-12T10:50:02.920043+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:50:02.920043+0000","last_undegraded":"2024-05-12T10:50:02.920043+0000","last_fullsized":"2024-05-12T10:50:02.920043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_clean_scrub_stamp":"2024-05-12T10:49:43.953472+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:44:15.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076721+0000","last_change":"2024-05-12T10:50:00.399288+0000","last_active":"2024-05-12T10:50:02.076721+0000","last_peered":"2024-05-12T10:50:02.076721+0000","last_clean":"2024-05-12T10:50:02.076721+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:50:02.076721+0000","last_undegraded":"2024-05-12T10:50:02.076721+0000","last_fullsized":"2024-05-12T10:50:02.076721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:26.959086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920561+0000","last_change":"2024-05-12T10:49:55.639605+0000","last_active":"2024-05-12T10:50:02.920561+0000","last_peered":"2024-05-12T10:50:02.920561+0000","last_clean":"2024-05-12T10:50:02.920561+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:50:02.920561+0000","last_undegraded":"2024-05-12T10:50:02.920561+0000","last_fullsized":"2024-05-12T10:50:02.920561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:46:26.585195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102261+0000","last_change":"2024-05-12T10:49:54.654999+0000","last_active":"2024-05-12T10:50:02.102261+0000","last_peered":"2024-05-12T10:50:02.102261+0000","last_clean":"2024-05-12T10:50:02.102261+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:50:02.102261+0000","last_undegraded":"2024-05-12T10:50:02.102261+0000","last_fullsized":"2024-05-12T10:50:02.102261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:00:20.115739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076118+0000","last_change":"2024-05-12T10:50:00.393017+0000","last_active":"2024-05-12T10:50:02.076118+0000","last_peered":"2024-05-12T10:50:02.076118+0000","last_clean":"2024-05-12T10:50:02.076118+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:50:02.076118+0000","last_undegraded":"2024-05-12T10:50:02.076118+0000","last_fullsized":"2024-05-12T10:50:02.076118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:01:02.394572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658363+0000","last_change":"2024-05-12T10:49:55.623665+0000","last_active":"2024-05-12T10:50:01.658363+0000","last_peered":"2024-05-12T10:50:01.658363+0000","last_clean":"2024-05-12T10:50:01.658363+0000","last_became_active":"2024-05-12T10:49:55.623403+0000","last_became_peered":"2024-05-12T10:49:55.623403+0000","last_unstale":"2024-05-12T10:50:01.658363+0000","last_undegraded":"2024-05-12T10:50:01.658363+0000","last_fullsized":"2024-05-12T10:50:01.658363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:18:25.399664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915873+0000","last_change":"2024-05-12T10:49:54.628492+0000","last_active":"2024-05-12T10:50:02.915873+0000","last_peered":"2024-05-12T10:50:02.915873+0000","last_clean":"2024-05-12T10:50:02.915873+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:50:02.915873+0000","last_undegraded":"2024-05-12T10:50:02.915873+0000","last_fullsized":"2024-05-12T10:50:02.915873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:35:38.949401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837763+0000","last_change":"2024-05-12T10:49:59.657783+0000","last_active":"2024-05-12T10:50:02.837763+0000","last_peered":"2024-05-12T10:50:02.837763+0000","last_clean":"2024-05-12T10:50:02.837763+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:50:02.837763+0000","last_undegraded":"2024-05-12T10:50:02.837763+0000","last_fullsized":"2024-05-12T10:50:02.837763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:51:21.103458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921189+0000","last_change":"2024-05-12T10:49:55.646246+0000","last_active":"2024-05-12T10:50:02.921189+0000","last_peered":"2024-05-12T10:50:02.921189+0000","last_clean":"2024-05-12T10:50:02.921189+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:50:02.921189+0000","last_undegraded":"2024-05-12T10:50:02.921189+0000","last_fullsized":"2024-05-12T10:50:02.921189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:32.142128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102403+0000","last_change":"2024-05-12T10:49:54.610076+0000","last_active":"2024-05-12T10:50:02.102403+0000","last_peered":"2024-05-12T10:50:02.102403+0000","last_clean":"2024-05-12T10:50:02.102403+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:50:02.102403+0000","last_undegraded":"2024-05-12T10:50:02.102403+0000","last_fullsized":"2024-05-12T10:50:02.102403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:12:04.400894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657078+0000","last_change":"2024-05-12T10:50:00.386172+0000","last_active":"2024-05-12T10:50:01.657078+0000","last_peered":"2024-05-12T10:50:01.657078+0000","last_clean":"2024-05-12T10:50:01.657078+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:50:01.657078+0000","last_undegraded":"2024-05-12T10:50:01.657078+0000","last_fullsized":"2024-05-12T10:50:01.657078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:06:17.550197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920926+0000","last_change":"2024-05-12T10:49:55.646249+0000","last_active":"2024-05-12T10:50:02.920926+0000","last_peered":"2024-05-12T10:50:02.920926+0000","last_clean":"2024-05-12T10:50:02.920926+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:50:02.920926+0000","last_undegraded":"2024-05-12T10:50:02.920926+0000","last_fullsized":"2024-05-12T10:50:02.920926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:15.036675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660898+0000","last_change":"2024-05-12T10:49:54.621293+0000","last_active":"2024-05-12T10:50:01.660898+0000","last_peered":"2024-05-12T10:50:01.660898+0000","last_clean":"2024-05-12T10:50:01.660898+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:50:01.660898+0000","last_undegraded":"2024-05-12T10:50:01.660898+0000","last_fullsized":"2024-05-12T10:50:01.660898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:45:33.341215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657581+0000","last_change":"2024-05-12T10:49:59.673656+0000","last_active":"2024-05-12T10:50:01.657581+0000","last_peered":"2024-05-12T10:50:01.657581+0000","last_clean":"2024-05-12T10:50:01.657581+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:50:01.657581+0000","last_undegraded":"2024-05-12T10:50:01.657581+0000","last_fullsized":"2024-05-12T10:50:01.657581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:38.364434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919917+0000","last_change":"2024-05-12T10:49:55.646526+0000","last_active":"2024-05-12T10:50:02.919917+0000","last_peered":"2024-05-12T10:50:02.919917+0000","last_clean":"2024-05-12T10:50:02.919917+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:50:02.919917+0000","last_undegraded":"2024-05-12T10:50:02.919917+0000","last_fullsized":"2024-05-12T10:50:02.919917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:56:52.102442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101889+0000","last_change":"2024-05-12T10:49:54.617906+0000","last_active":"2024-05-12T10:50:02.101889+0000","last_peered":"2024-05-12T10:50:02.101889+0000","last_clean":"2024-05-12T10:50:02.101889+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:50:02.101889+0000","last_undegraded":"2024-05-12T10:50:02.101889+0000","last_fullsized":"2024-05-12T10:50:02.101889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:26:35.150963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837853+0000","last_change":"2024-05-12T10:49:59.671791+0000","last_active":"2024-05-12T10:50:02.837853+0000","last_peered":"2024-05-12T10:50:02.837853+0000","last_clean":"2024-05-12T10:50:02.837853+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:50:02.837853+0000","last_undegraded":"2024-05-12T10:50:02.837853+0000","last_fullsized":"2024-05-12T10:50:02.837853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:27.425708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076017+0000","last_change":"2024-05-12T10:49:55.637810+0000","last_active":"2024-05-12T10:50:02.076017+0000","last_peered":"2024-05-12T10:50:02.076017+0000","last_clean":"2024-05-12T10:50:02.076017+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:50:02.076017+0000","last_undegraded":"2024-05-12T10:50:02.076017+0000","last_fullsized":"2024-05-12T10:50:02.076017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:52.001497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076035+0000","last_change":"2024-05-12T10:49:54.637728+0000","last_active":"2024-05-12T10:50:02.076035+0000","last_peered":"2024-05-12T10:50:02.076035+0000","last_clean":"2024-05-12T10:50:02.076035+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:50:02.076035+0000","last_undegraded":"2024-05-12T10:50:02.076035+0000","last_fullsized":"2024-05-12T10:50:02.076035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:39.996419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653563+0000","last_change":"2024-05-12T10:50:00.383444+0000","last_active":"2024-05-12T10:50:01.653563+0000","last_peered":"2024-05-12T10:50:01.653563+0000","last_clean":"2024-05-12T10:50:01.653563+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:50:01.653563+0000","last_undegraded":"2024-05-12T10:50:01.653563+0000","last_fullsized":"2024-05-12T10:50:01.653563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:55:04.226848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920128+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:50:02.920128+0000","last_peered":"2024-05-12T10:50:02.920128+0000","last_clean":"2024-05-12T10:50:02.920128+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:50:02.920128+0000","last_undegraded":"2024-05-12T10:50:02.920128+0000","last_fullsized":"2024-05-12T10:50:02.920128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:15:58.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660087+0000","last_change":"2024-05-12T10:49:54.656814+0000","last_active":"2024-05-12T10:50:01.660087+0000","last_peered":"2024-05-12T10:50:01.660087+0000","last_clean":"2024-05-12T10:50:01.660087+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:50:01.660087+0000","last_undegraded":"2024-05-12T10:50:01.660087+0000","last_fullsized":"2024-05-12T10:50:01.660087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:26.660043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653232+0000","last_change":"2024-05-12T10:50:00.390308+0000","last_active":"2024-05-12T10:50:01.653232+0000","last_peered":"2024-05-12T10:50:01.653232+0000","last_clean":"2024-05-12T10:50:01.653232+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:50:01.653232+0000","last_undegraded":"2024-05-12T10:50:01.653232+0000","last_fullsized":"2024-05-12T10:50:01.653232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:43.650956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837442+0000","last_change":"2024-05-12T10:49:55.628907+0000","last_active":"2024-05-12T10:50:02.837442+0000","last_peered":"2024-05-12T10:50:02.837442+0000","last_clean":"2024-05-12T10:50:02.837442+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:50:02.837442+0000","last_undegraded":"2024-05-12T10:50:02.837442+0000","last_fullsized":"2024-05-12T10:50:02.837442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:13:50.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837019+0000","last_change":"2024-05-12T10:49:54.626002+0000","last_active":"2024-05-12T10:50:02.837019+0000","last_peered":"2024-05-12T10:50:02.837019+0000","last_clean":"2024-05-12T10:50:02.837019+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:50:02.837019+0000","last_undegraded":"2024-05-12T10:50:02.837019+0000","last_fullsized":"2024-05-12T10:50:02.837019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:19:19.976387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659867+0000","last_change":"2024-05-12T10:50:00.387192+0000","last_active":"2024-05-12T10:50:01.659867+0000","last_peered":"2024-05-12T10:50:01.659867+0000","last_clean":"2024-05-12T10:50:01.659867+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:50:01.659867+0000","last_undegraded":"2024-05-12T10:50:01.659867+0000","last_fullsized":"2024-05-12T10:50:01.659867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:15:23.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920487+0000","last_change":"2024-05-12T10:49:55.634551+0000","last_active":"2024-05-12T10:50:02.920487+0000","last_peered":"2024-05-12T10:50:02.920487+0000","last_clean":"2024-05-12T10:50:02.920487+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:50:02.920487+0000","last_undegraded":"2024-05-12T10:50:02.920487+0000","last_fullsized":"2024-05-12T10:50:02.920487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:10:52.477145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:09.379163+0000","last_change":"2024-05-12T10:49:54.634748+0000","last_active":"2024-05-12T10:50:09.379163+0000","last_peered":"2024-05-12T10:50:09.379163+0000","last_clean":"2024-05-12T10:50:09.379163+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:50:09.379163+0000","last_undegraded":"2024-05-12T10:50:09.379163+0000","last_fullsized":"2024-05-12T10:50:09.379163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:39:16.646133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916160+0000","last_change":"2024-05-12T10:49:59.671405+0000","last_active":"2024-05-12T10:50:02.916160+0000","last_peered":"2024-05-12T10:50:02.916160+0000","last_clean":"2024-05-12T10:50:02.916160+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:50:02.916160+0000","last_undegraded":"2024-05-12T10:50:02.916160+0000","last_fullsized":"2024-05-12T10:50:02.916160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:06:34.170753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659820+0000","last_change":"2024-05-12T10:49:55.634686+0000","last_active":"2024-05-12T10:50:01.659820+0000","last_peered":"2024-05-12T10:50:01.659820+0000","last_clean":"2024-05-12T10:50:01.659820+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:50:01.659820+0000","last_undegraded":"2024-05-12T10:50:01.659820+0000","last_fullsized":"2024-05-12T10:50:01.659820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:25:04.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915889+0000","last_change":"2024-05-12T10:49:54.656012+0000","last_active":"2024-05-12T10:50:02.915889+0000","last_peered":"2024-05-12T10:50:02.915889+0000","last_clean":"2024-05-12T10:50:02.915889+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:50:02.915889+0000","last_undegraded":"2024-05-12T10:50:02.915889+0000","last_fullsized":"2024-05-12T10:50:02.915889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:29.253250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658272+0000","last_change":"2024-05-12T10:49:59.672820+0000","last_active":"2024-05-12T10:50:01.658272+0000","last_peered":"2024-05-12T10:50:01.658272+0000","last_clean":"2024-05-12T10:50:01.658272+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:50:01.658272+0000","last_undegraded":"2024-05-12T10:50:01.658272+0000","last_fullsized":"2024-05-12T10:50:01.658272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:49:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838093+0000","last_change":"2024-05-12T10:49:55.620541+0000","last_active":"2024-05-12T10:50:02.838093+0000","last_peered":"2024-05-12T10:50:02.838093+0000","last_clean":"2024-05-12T10:50:02.838093+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:50:02.838093+0000","last_undegraded":"2024-05-12T10:50:02.838093+0000","last_fullsized":"2024-05-12T10:50:02.838093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:11.742829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660247+0000","last_change":"2024-05-12T10:49:54.651289+0000","last_active":"2024-05-12T10:50:01.660247+0000","last_peered":"2024-05-12T10:50:01.660247+0000","last_clean":"2024-05-12T10:50:01.660247+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:50:01.660247+0000","last_undegraded":"2024-05-12T10:50:01.660247+0000","last_fullsized":"2024-05-12T10:50:01.660247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:33:24.087763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652523+0000","last_change":"2024-05-12T10:49:59.670973+0000","last_active":"2024-05-12T10:50:01.652523+0000","last_peered":"2024-05-12T10:50:01.652523+0000","last_clean":"2024-05-12T10:50:01.652523+0000","last_became_active":"2024-05-12T10:49:59.670656+0000","last_became_peered":"2024-05-12T10:49:59.670656+0000","last_unstale":"2024-05-12T10:50:01.652523+0000","last_undegraded":"2024-05-12T10:50:01.652523+0000","last_fullsized":"2024-05-12T10:50:01.652523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:16:58.665403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659979+0000","last_change":"2024-05-12T10:49:55.626645+0000","last_active":"2024-05-12T10:50:01.659979+0000","last_peered":"2024-05-12T10:50:01.659979+0000","last_clean":"2024-05-12T10:50:01.659979+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:50:01.659979+0000","last_undegraded":"2024-05-12T10:50:01.659979+0000","last_fullsized":"2024-05-12T10:50:01.659979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:41.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076937+0000","last_change":"2024-05-12T10:49:54.654822+0000","last_active":"2024-05-12T10:50:02.076937+0000","last_peered":"2024-05-12T10:50:02.076937+0000","last_clean":"2024-05-12T10:50:02.076937+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:50:02.076937+0000","last_undegraded":"2024-05-12T10:50:02.076937+0000","last_fullsized":"2024-05-12T10:50:02.076937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:52:07.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652430+0000","last_change":"2024-05-12T10:50:00.396453+0000","last_active":"2024-05-12T10:50:01.652430+0000","last_peered":"2024-05-12T10:50:01.652430+0000","last_clean":"2024-05-12T10:50:01.652430+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:50:01.652430+0000","last_undegraded":"2024-05-12T10:50:01.652430+0000","last_fullsized":"2024-05-12T10:50:01.652430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:40.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837810+0000","last_change":"2024-05-12T10:50:00.390477+0000","last_active":"2024-05-12T10:50:02.837810+0000","last_peered":"2024-05-12T10:50:02.837810+0000","last_clean":"2024-05-12T10:50:02.837810+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:50:02.837810+0000","last_undegraded":"2024-05-12T10:50:02.837810+0000","last_fullsized":"2024-05-12T10:50:02.837810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:20:19.551216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916112+0000","last_change":"2024-05-12T10:49:55.619984+0000","last_active":"2024-05-12T10:50:02.916112+0000","last_peered":"2024-05-12T10:50:02.916112+0000","last_clean":"2024-05-12T10:50:02.916112+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:50:02.916112+0000","last_undegraded":"2024-05-12T10:50:02.916112+0000","last_fullsized":"2024-05-12T10:50:02.916112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:21:34.136203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657970+0000","last_change":"2024-05-12T10:49:54.656580+0000","last_active":"2024-05-12T10:50:01.657970+0000","last_peered":"2024-05-12T10:50:01.657970+0000","last_clean":"2024-05-12T10:50:01.657970+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:50:01.657970+0000","last_undegraded":"2024-05-12T10:50:01.657970+0000","last_fullsized":"2024-05-12T10:50:01.657970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:43:32.603999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076883+0000","last_change":"2024-05-12T10:49:59.681648+0000","last_active":"2024-05-12T10:50:02.076883+0000","last_peered":"2024-05-12T10:50:02.076883+0000","last_clean":"2024-05-12T10:50:02.076883+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:50:02.076883+0000","last_undegraded":"2024-05-12T10:50:02.076883+0000","last_fullsized":"2024-05-12T10:50:02.076883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:54.912836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652618+0000","last_change":"2024-05-12T10:49:55.617393+0000","last_active":"2024-05-12T10:50:01.652618+0000","last_peered":"2024-05-12T10:50:01.652618+0000","last_clean":"2024-05-12T10:50:01.652618+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:50:01.652618+0000","last_undegraded":"2024-05-12T10:50:01.652618+0000","last_fullsized":"2024-05-12T10:50:01.652618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:51.584695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652565+0000","last_change":"2024-05-12T10:49:54.637393+0000","last_active":"2024-05-12T10:50:01.652565+0000","last_peered":"2024-05-12T10:50:01.652565+0000","last_clean":"2024-05-12T10:50:01.652565+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:50:01.652565+0000","last_undegraded":"2024-05-12T10:50:01.652565+0000","last_fullsized":"2024-05-12T10:50:01.652565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:44:00.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076344+0000","last_change":"2024-05-12T10:49:54.636945+0000","last_active":"2024-05-12T10:50:02.076344+0000","last_peered":"2024-05-12T10:50:02.076344+0000","last_clean":"2024-05-12T10:50:02.076344+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:50:02.076344+0000","last_undegraded":"2024-05-12T10:50:02.076344+0000","last_fullsized":"2024-05-12T10:50:02.076344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:34:25.927458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837878+0000","last_change":"2024-05-12T10:49:55.627105+0000","last_active":"2024-05-12T10:50:02.837878+0000","last_peered":"2024-05-12T10:50:02.837878+0000","last_clean":"2024-05-12T10:50:02.837878+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:50:02.837878+0000","last_undegraded":"2024-05-12T10:50:02.837878+0000","last_fullsized":"2024-05-12T10:50:02.837878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:00:09.334541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102212+0000","last_change":"2024-05-12T10:49:59.659142+0000","last_active":"2024-05-12T10:50:02.102212+0000","last_peered":"2024-05-12T10:50:02.102212+0000","last_clean":"2024-05-12T10:50:02.102212+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:50:02.102212+0000","last_undegraded":"2024-05-12T10:50:02.102212+0000","last_fullsized":"2024-05-12T10:50:02.102212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:40.443593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652797+0000","last_change":"2024-05-12T10:49:54.632224+0000","last_active":"2024-05-12T10:50:01.652797+0000","last_peered":"2024-05-12T10:50:01.652797+0000","last_clean":"2024-05-12T10:50:01.652797+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:50:01.652797+0000","last_undegraded":"2024-05-12T10:50:01.652797+0000","last_fullsized":"2024-05-12T10:50:01.652797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:27:39.637678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659206+0000","last_change":"2024-05-12T10:49:55.633243+0000","last_active":"2024-05-12T10:50:01.659206+0000","last_peered":"2024-05-12T10:50:01.659206+0000","last_clean":"2024-05-12T10:50:01.659206+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:50:01.659206+0000","last_undegraded":"2024-05-12T10:50:01.659206+0000","last_fullsized":"2024-05-12T10:50:01.659206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:14.239020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652874+0000","last_change":"2024-05-12T10:49:59.655807+0000","last_active":"2024-05-12T10:50:01.652874+0000","last_peered":"2024-05-12T10:50:01.652874+0000","last_clean":"2024-05-12T10:50:01.652874+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:50:01.652874+0000","last_undegraded":"2024-05-12T10:50:01.652874+0000","last_fullsized":"2024-05-12T10:50:01.652874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:12.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075680+0000","last_change":"2024-05-12T10:49:55.637106+0000","last_active":"2024-05-12T10:50:02.075680+0000","last_peered":"2024-05-12T10:50:02.075680+0000","last_clean":"2024-05-12T10:50:02.075680+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:50:02.075680+0000","last_undegraded":"2024-05-12T10:50:02.075680+0000","last_fullsized":"2024-05-12T10:50:02.075680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:22:07.477677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101967+0000","last_change":"2024-05-12T10:49:55.618952+0000","last_active":"2024-05-12T10:50:02.101967+0000","last_peered":"2024-05-12T10:50:02.101967+0000","last_clean":"2024-05-12T10:50:02.101967+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:50:02.101967+0000","last_undegraded":"2024-05-12T10:50:02.101967+0000","last_fullsized":"2024-05-12T10:50:02.101967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:38:10.693066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659549+0000","last_change":"2024-05-12T10:49:55.623916+0000","last_active":"2024-05-12T10:50:01.659549+0000","last_peered":"2024-05-12T10:50:01.659549+0000","last_clean":"2024-05-12T10:50:01.659549+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:50:01.659549+0000","last_undegraded":"2024-05-12T10:50:01.659549+0000","last_fullsized":"2024-05-12T10:50:01.659549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:06:14.434631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837761+0000","last_change":"2024-05-12T10:49:55.620278+0000","last_active":"2024-05-12T10:50:02.837761+0000","last_peered":"2024-05-12T10:50:02.837761+0000","last_clean":"2024-05-12T10:50:02.837761+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:50:02.837761+0000","last_undegraded":"2024-05-12T10:50:02.837761+0000","last_fullsized":"2024-05-12T10:50:02.837761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:59.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653439+0000","last_change":"2024-05-12T10:49:55.626216+0000","last_active":"2024-05-12T10:50:01.653439+0000","last_peered":"2024-05-12T10:50:01.653439+0000","last_clean":"2024-05-12T10:50:01.653439+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:50:01.653439+0000","last_undegraded":"2024-05-12T10:50:01.653439+0000","last_fullsized":"2024-05-12T10:50:01.653439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:52:14.438331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916463+0000","last_change":"2024-05-12T10:49:55.622085+0000","last_active":"2024-05-12T10:50:02.916463+0000","last_peered":"2024-05-12T10:50:02.916463+0000","last_clean":"2024-05-12T10:50:02.916463+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:50:02.916463+0000","last_undegraded":"2024-05-12T10:50:02.916463+0000","last_fullsized":"2024-05-12T10:50:02.916463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:41:42.558506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076984+0000","last_change":"2024-05-12T10:49:55.635592+0000","last_active":"2024-05-12T10:50:02.076984+0000","last_peered":"2024-05-12T10:50:02.076984+0000","last_clean":"2024-05-12T10:50:02.076984+0000","last_became_active":"2024-05-12T10:49:55.635298+0000","last_became_peered":"2024-05-12T10:49:55.635298+0000","last_unstale":"2024-05-12T10:50:02.076984+0000","last_undegraded":"2024-05-12T10:50:02.076984+0000","last_fullsized":"2024-05-12T10:50:02.076984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:43:14.781372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653476+0000","last_change":"2024-05-12T10:49:55.626353+0000","last_active":"2024-05-12T10:50:01.653476+0000","last_peered":"2024-05-12T10:50:01.653476+0000","last_clean":"2024-05-12T10:50:01.653476+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:50:01.653476+0000","last_undegraded":"2024-05-12T10:50:01.653476+0000","last_fullsized":"2024-05-12T10:50:01.653476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:58.905284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657725+0000","last_change":"2024-05-12T10:49:55.621110+0000","last_active":"2024-05-12T10:50:01.657725+0000","last_peered":"2024-05-12T10:50:01.657725+0000","last_clean":"2024-05-12T10:50:01.657725+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:50:01.657725+0000","last_undegraded":"2024-05-12T10:50:01.657725+0000","last_fullsized":"2024-05-12T10:50:01.657725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:12:36.369923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652483+0000","last_change":"2024-05-12T10:49:55.626913+0000","last_active":"2024-05-12T10:50:01.652483+0000","last_peered":"2024-05-12T10:50:01.652483+0000","last_clean":"2024-05-12T10:50:01.652483+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:50:01.652483+0000","last_undegraded":"2024-05-12T10:50:01.652483+0000","last_fullsized":"2024-05-12T10:50:01.652483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:27:08.492294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659499+0000","last_change":"2024-05-12T10:49:55.629992+0000","last_active":"2024-05-12T10:50:01.659499+0000","last_peered":"2024-05-12T10:50:01.659499+0000","last_clean":"2024-05-12T10:50:01.659499+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:50:01.659499+0000","last_undegraded":"2024-05-12T10:50:01.659499+0000","last_fullsized":"2024-05-12T10:50:01.659499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:31.454363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837524+0000","last_change":"2024-05-12T10:49:55.620821+0000","last_active":"2024-05-12T10:50:02.837524+0000","last_peered":"2024-05-12T10:50:02.837524+0000","last_clean":"2024-05-12T10:50:02.837524+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:50:02.837524+0000","last_undegraded":"2024-05-12T10:50:02.837524+0000","last_fullsized":"2024-05-12T10:50:02.837524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:53.597215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076297+0000","last_change":"2024-05-12T10:49:55.646368+0000","last_active":"2024-05-12T10:50:02.076297+0000","last_peered":"2024-05-12T10:50:02.076297+0000","last_clean":"2024-05-12T10:50:02.076297+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:50:02.076297+0000","last_undegraded":"2024-05-12T10:50:02.076297+0000","last_fullsized":"2024-05-12T10:50:02.076297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:21:04.313921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920866+0000","last_change":"2024-05-12T10:49:55.633122+0000","last_active":"2024-05-12T10:50:02.920866+0000","last_peered":"2024-05-12T10:50:02.920866+0000","last_clean":"2024-05-12T10:50:02.920866+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:50:02.920866+0000","last_undegraded":"2024-05-12T10:50:02.920866+0000","last_fullsized":"2024-05-12T10:50:02.920866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:25:19.563648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102362+0000","last_change":"2024-05-12T10:49:55.635394+0000","last_active":"2024-05-12T10:50:02.102362+0000","last_peered":"2024-05-12T10:50:02.102362+0000","last_clean":"2024-05-12T10:50:02.102362+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:50:02.102362+0000","last_undegraded":"2024-05-12T10:50:02.102362+0000","last_fullsized":"2024-05-12T10:50:02.102362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:41:58.478292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660761+0000","last_change":"2024-05-12T10:49:55.626485+0000","last_active":"2024-05-12T10:50:01.660761+0000","last_peered":"2024-05-12T10:50:01.660761+0000","last_clean":"2024-05-12T10:50:01.660761+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:50:01.660761+0000","last_undegraded":"2024-05-12T10:50:01.660761+0000","last_fullsized":"2024-05-12T10:50:01.660761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:17.942339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657391+0000","last_change":"2024-05-12T10:49:55.618820+0000","last_active":"2024-05-12T10:50:01.657391+0000","last_peered":"2024-05-12T10:50:01.657391+0000","last_clean":"2024-05-12T10:50:01.657391+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:50:01.657391+0000","last_undegraded":"2024-05-12T10:50:01.657391+0000","last_fullsized":"2024-05-12T10:50:01.657391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:23:00.474438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916163+0000","last_change":"2024-05-12T10:49:55.626429+0000","last_active":"2024-05-12T10:50:02.916163+0000","last_peered":"2024-05-12T10:50:02.916163+0000","last_clean":"2024-05-12T10:50:02.916163+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:50:02.916163+0000","last_undegraded":"2024-05-12T10:50:02.916163+0000","last_fullsized":"2024-05-12T10:50:02.916163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:40:02.709729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837421+0000","last_change":"2024-05-12T10:49:55.612139+0000","last_active":"2024-05-12T10:50:02.837421+0000","last_peered":"2024-05-12T10:50:02.837421+0000","last_clean":"2024-05-12T10:50:02.837421+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:50:02.837421+0000","last_undegraded":"2024-05-12T10:50:02.837421+0000","last_fullsized":"2024-05-12T10:50:02.837421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:57:34.138392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652690+0000","last_change":"2024-05-12T10:49:55.631137+0000","last_active":"2024-05-12T10:50:01.652690+0000","last_peered":"2024-05-12T10:50:01.652690+0000","last_clean":"2024-05-12T10:50:01.652690+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:50:01.652690+0000","last_undegraded":"2024-05-12T10:50:01.652690+0000","last_fullsized":"2024-05-12T10:50:01.652690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:04.390314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659797+0000","last_change":"2024-05-12T10:49:55.643416+0000","last_active":"2024-05-12T10:50:01.659797+0000","last_peered":"2024-05-12T10:50:01.659797+0000","last_clean":"2024-05-12T10:50:01.659797+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:50:01.659797+0000","last_undegraded":"2024-05-12T10:50:01.659797+0000","last_fullsized":"2024-05-12T10:50:01.659797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:58.632966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076802+0000","last_change":"2024-05-12T10:49:55.635847+0000","last_active":"2024-05-12T10:50:02.076802+0000","last_peered":"2024-05-12T10:50:02.076802+0000","last_clean":"2024-05-12T10:50:02.076802+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:50:02.076802+0000","last_undegraded":"2024-05-12T10:50:02.076802+0000","last_fullsized":"2024-05-12T10:50:02.076802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:57:51.222099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076561+0000","last_change":"2024-05-12T10:49:55.641921+0000","last_active":"2024-05-12T10:50:02.076561+0000","last_peered":"2024-05-12T10:50:02.076561+0000","last_clean":"2024-05-12T10:50:02.076561+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:50:02.076561+0000","last_undegraded":"2024-05-12T10:50:02.076561+0000","last_fullsized":"2024-05-12T10:50:02.076561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:44:57.787358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921179+0000","last_change":"2024-05-12T10:49:55.635853+0000","last_active":"2024-05-12T10:50:02.921179+0000","last_peered":"2024-05-12T10:50:02.921179+0000","last_clean":"2024-05-12T10:50:02.921179+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:50:02.921179+0000","last_undegraded":"2024-05-12T10:50:02.921179+0000","last_fullsized":"2024-05-12T10:50:02.921179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:04:39.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652297+0000","last_change":"2024-05-12T10:49:55.620107+0000","last_active":"2024-05-12T10:50:01.652297+0000","last_peered":"2024-05-12T10:50:01.652297+0000","last_clean":"2024-05-12T10:50:01.652297+0000","last_became_active":"2024-05-12T10:49:55.619802+0000","last_became_peered":"2024-05-12T10:49:55.619802+0000","last_unstale":"2024-05-12T10:50:01.652297+0000","last_undegraded":"2024-05-12T10:50:01.652297+0000","last_fullsized":"2024-05-12T10:50:01.652297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:52:39.033778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920076+0000","last_change":"2024-05-12T10:49:55.629001+0000","last_active":"2024-05-12T10:50:02.920076+0000","last_peered":"2024-05-12T10:50:02.920076+0000","last_clean":"2024-05-12T10:50:02.920076+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:50:02.920076+0000","last_undegraded":"2024-05-12T10:50:02.920076+0000","last_fullsized":"2024-05-12T10:50:02.920076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:42:39.042271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659136+0000","last_change":"2024-05-12T10:49:55.625540+0000","last_active":"2024-05-12T10:50:01.659136+0000","last_peered":"2024-05-12T10:50:01.659136+0000","last_clean":"2024-05-12T10:50:01.659136+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:50:01.659136+0000","last_undegraded":"2024-05-12T10:50:01.659136+0000","last_fullsized":"2024-05-12T10:50:01.659136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:35.621918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919665+0000","last_change":"2024-05-12T10:49:55.633576+0000","last_active":"2024-05-12T10:50:02.919665+0000","last_peered":"2024-05-12T10:50:02.919665+0000","last_clean":"2024-05-12T10:50:02.919665+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:50:02.919665+0000","last_undegraded":"2024-05-12T10:50:02.919665+0000","last_fullsized":"2024-05-12T10:50:02.919665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:06:16.255147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657885+0000","last_change":"2024-05-12T10:49:55.624205+0000","last_active":"2024-05-12T10:50:01.657885+0000","last_peered":"2024-05-12T10:50:01.657885+0000","last_clean":"2024-05-12T10:50:01.657885+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:50:01.657885+0000","last_undegraded":"2024-05-12T10:50:01.657885+0000","last_fullsized":"2024-05-12T10:50:01.657885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:21.895269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837757+0000","last_change":"2024-05-12T10:49:55.610461+0000","last_active":"2024-05-12T10:50:02.837757+0000","last_peered":"2024-05-12T10:50:02.837757+0000","last_clean":"2024-05-12T10:50:02.837757+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:50:02.837757+0000","last_undegraded":"2024-05-12T10:50:02.837757+0000","last_fullsized":"2024-05-12T10:50:02.837757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:44.511895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916628+0000","last_change":"2024-05-12T10:49:55.608434+0000","last_active":"2024-05-12T10:50:02.916628+0000","last_peered":"2024-05-12T10:50:02.916628+0000","last_clean":"2024-05-12T10:50:02.916628+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:50:02.916628+0000","last_undegraded":"2024-05-12T10:50:02.916628+0000","last_fullsized":"2024-05-12T10:50:02.916628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:17.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920943+0000","last_change":"2024-05-12T10:49:55.639296+0000","last_active":"2024-05-12T10:50:02.920943+0000","last_peered":"2024-05-12T10:50:02.920943+0000","last_clean":"2024-05-12T10:50:02.920943+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:50:02.920943+0000","last_undegraded":"2024-05-12T10:50:02.920943+0000","last_fullsized":"2024-05-12T10:50:02.920943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:47:15.862328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":701646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":110786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:50:21.802 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:50:21.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.981+0000 7f42b4400640 1 Processor -- start 2024-05-12T10:50:21.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.981+0000 7f42b4400640 1 -- start start 2024-05-12T10:50:21.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.981+0000 7f42b4400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42ac159430 0x7f42ac0cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.981+0000 7f42b4400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42ac0c9fd0 0x7f42ac0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.981+0000 7f42b4400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ac0c5050 con 0x7f42ac0c45f0 2024-05-12T10:50:21.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.981+0000 7f42b4400640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f42ac0c5c20 con 0x7f42ac159430 2024-05-12T10:50:21.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.981+0000 7f42b4400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac0c52f0 con 0x7f42ac0c9fd0 2024-05-12T10:50:21.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42b1a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42ac159430 0x7f42ac0cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42b1a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42ac159430 0x7f42ac0cf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39614/0 (socket says 172.21.15.115:39614) 2024-05-12T10:50:21.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42b1a00640 1 -- 172.21.15.115:0/3613449957 learned_addr learned my addr 172.21.15.115:0/3613449957 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:21.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42b1000640 1 --2- 172.21.15.115:0/3613449957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42ac0c9fd0 0x7f42ac0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42b1a00640 1 -- 172.21.15.115:0/3613449957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42ac0c9fd0 msgr2=0x7f42ac0cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:21.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42b1a00640 1 --2- 172.21.15.115:0/3613449957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42ac0c9fd0 0x7f42ac0cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42b1a00640 1 -- 172.21.15.115:0/3613449957 >> v1:172.21.15.134:6789/0 conn(0x7f42ac0c45f0 legacy=0x7f42ac15f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42b1a00640 1 -- 172.21.15.115:0/3613449957 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac0c55d0 con 0x7f42ac159430 2024-05-12T10:50:21.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42b1a00640 1 --2- 172.21.15.115:0/3613449957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac159430 0x7f42ac0cf560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009e50 tx=0x7f42a001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba81c1624f8d57 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:21.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42abe00640 1 -- 172.21.15.115:0/3613449957 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a00b4070 con 0x7f42ac159430 2024-05-12T10:50:21.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42abe00640 1 -- 172.21.15.115:0/3613449957 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a00af400 con 0x7f42ac159430 2024-05-12T10:50:21.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.985+0000 7f42abe00640 1 -- 172.21.15.115:0/3613449957 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a00af7d0 con 0x7f42ac159430 2024-05-12T10:50:21.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 -- 172.21.15.115:0/3613449957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac159430 msgr2=0x7f42ac0cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 --2- 172.21.15.115:0/3613449957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac159430 0x7f42ac0cf560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009e50 tx=0x7f42a001f210 comp rx=0 tx=0).stop 2024-05-12T10:50:21.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 -- 172.21.15.115:0/3613449957 shutdown_connections 2024-05-12T10:50:21.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 --2- 172.21.15.115:0/3613449957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42ac0c9fd0 0x7f42ac0cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 --2- 172.21.15.115:0/3613449957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac159430 0x7f42ac0cf560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 -- 172.21.15.115:0/3613449957 >> 172.21.15.115:0/3613449957 conn(0x7f42ac06c440 msgr2=0x7f42ac06c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:21.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 -- 172.21.15.115:0/3613449957 shutdown_connections 2024-05-12T10:50:21.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 -- 172.21.15.115:0/3613449957 wait complete. 2024-05-12T10:50:21.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 Processor -- start 2024-05-12T10:50:21.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 -- start start 2024-05-12T10:50:21.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ac0c45f0 0x7f42ac1559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42ac0c9fd0 0x7f42ac1e7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac159430 0x7f42ac0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac06d180 con 0x7f42ac159430 2024-05-12T10:50:21.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac0ca580 con 0x7f42ac0c45f0 2024-05-12T10:50:21.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b4400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac0cbcc0 con 0x7f42ac0c9fd0 2024-05-12T10:50:21.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b2400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac159430 0x7f42ac0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b2400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac159430 0x7f42ac0af8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39628/0 (socket says 172.21.15.115:39628) 2024-05-12T10:50:21.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b2400640 1 -- 172.21.15.115:0/1466635594 learned_addr learned my addr 172.21.15.115:0/1466635594 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:21.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b1000640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42ac0c9fd0 0x7f42ac1e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b1a00640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ac0c45f0 0x7f42ac1559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b2400640 1 -- 172.21.15.115:0/1466635594 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42ac0c9fd0 msgr2=0x7f42ac1e7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b2400640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42ac0c9fd0 0x7f42ac1e7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b2400640 1 -- 172.21.15.115:0/1466635594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ac0c45f0 msgr2=0x7f42ac1559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:21.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b2400640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ac0c45f0 0x7f42ac1559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:21.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b2400640 1 -- 172.21.15.115:0/1466635594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac155f10 con 0x7f42ac159430 2024-05-12T10:50:21.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.989+0000 7f42b2400640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac159430 0x7f42ac0af8d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f42a400c3c0 tx=0x7f42a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:21.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.993+0000 7f42a9600640 1 -- 172.21.15.115:0/1466635594 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4017070 con 0x7f42ac159430 2024-05-12T10:50:21.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.993+0000 7f42a9600640 1 -- 172.21.15.115:0/1466635594 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a40052d0 con 0x7f42ac159430 2024-05-12T10:50:21.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.993+0000 7f42a9600640 1 -- 172.21.15.115:0/1466635594 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4003800 con 0x7f42ac159430 2024-05-12T10:50:21.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.993+0000 7f42b4400640 1 -- 172.21.15.115:0/1466635594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac0b15d0 con 0x7f42ac159430 2024-05-12T10:50:21.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.993+0000 7f42b4400640 1 -- 172.21.15.115:0/1466635594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac1f29c0 con 0x7f42ac159430 2024-05-12T10:50:21.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.993+0000 7f42b4400640 1 -- 172.21.15.115:0/1466635594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ac069730 con 0x7f42ac159430 2024-05-12T10:50:21.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.993+0000 7f42a9600640 1 -- 172.21.15.115:0/1466635594 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f42a401a070 con 0x7f42ac159430 2024-05-12T10:50:21.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.993+0000 7f42a9600640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f428c06f430 0x7f428c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:21.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.993+0000 7f42a9600640 1 -- 172.21.15.115:0/1466635594 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f42a408e790 con 0x7f42ac159430 2024-05-12T10:50:21.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.993+0000 7f42b1a00640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f428c06f430 0x7f428c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:21.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.997+0000 7f42b1a00640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f428c06f430 0x7f428c0718f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f42a00b1000 tx=0x7f42a00aa000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:21.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:21.997+0000 7f42a9600640 1 -- 172.21.15.115:0/1466635594 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f42a4005480 con 0x7f42ac159430 2024-05-12T10:50:22.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.153+0000 7f42b4400640 1 -- 172.21.15.115:0/1466635594 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42ac0cb1a0 con 0x7f428c06f430 2024-05-12T10:50:22.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.161+0000 7f42a9600640 1 -- 172.21.15.115:0/1466635594 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f42ac0cb1a0 con 0x7f428c06f430 2024-05-12T10:50:22.158 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:22.161 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:50:22.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 -- 172.21.15.115:0/1466635594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f428c06f430 msgr2=0x7f428c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f428c06f430 0x7f428c0718f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f42a00b1000 tx=0x7f42a00aa000 comp rx=0 tx=0).stop 2024-05-12T10:50:22.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 -- 172.21.15.115:0/1466635594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac159430 msgr2=0x7f42ac0af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac159430 0x7f42ac0af8d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f42a400c3c0 tx=0x7f42a400c880 comp rx=0 tx=0).stop 2024-05-12T10:50:22.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 -- 172.21.15.115:0/1466635594 shutdown_connections 2024-05-12T10:50:22.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f428c06f430 0x7f428c0718f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac159430 0x7f42ac0af8d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42ac0c9fd0 0x7f42ac1e7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 --2- 172.21.15.115:0/1466635594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42ac0c45f0 0x7f42ac1559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 -- 172.21.15.115:0/1466635594 >> 172.21.15.115:0/1466635594 conn(0x7f42ac06c440 msgr2=0x7f42ac0cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:22.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 -- 172.21.15.115:0/1466635594 shutdown_connections 2024-05-12T10:50:22.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.165+0000 7f42b4400640 1 -- 172.21.15.115:0/1466635594 wait complete. 2024-05-12T10:50:22.179 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-05-12T10:50:21.755780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219524,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755196,"statfs":{"total":773094113280,"available":772869320704,"internally_reserved":0,"allocated":3448832,"data_stored":2075584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003120"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838171+0000","last_change":"2024-05-12T10:49:54.640093+0000","last_active":"2024-05-12T10:50:02.838171+0000","last_peered":"2024-05-12T10:50:02.838171+0000","last_clean":"2024-05-12T10:50:02.838171+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:50:02.838171+0000","last_undegraded":"2024-05-12T10:50:02.838171+0000","last_fullsized":"2024-05-12T10:50:02.838171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:07:41.639104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653116+0000","last_change":"2024-05-12T10:49:55.635928+0000","last_active":"2024-05-12T10:50:01.653116+0000","last_peered":"2024-05-12T10:50:01.653116+0000","last_clean":"2024-05-12T10:50:01.653116+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:50:01.653116+0000","last_undegraded":"2024-05-12T10:50:01.653116+0000","last_fullsized":"2024-05-12T10:50:01.653116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:41:30.909036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652376+0000","last_change":"2024-05-12T10:50:00.396417+0000","last_active":"2024-05-12T10:50:01.652376+0000","last_peered":"2024-05-12T10:50:01.652376+0000","last_clean":"2024-05-12T10:50:01.652376+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:50:01.652376+0000","last_undegraded":"2024-05-12T10:50:01.652376+0000","last_fullsized":"2024-05-12T10:50:01.652376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:27.287617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653306+0000","last_change":"2024-05-12T10:49:54.619268+0000","last_active":"2024-05-12T10:50:01.653306+0000","last_peered":"2024-05-12T10:50:01.653306+0000","last_clean":"2024-05-12T10:50:01.653306+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:50:01.653306+0000","last_undegraded":"2024-05-12T10:50:01.653306+0000","last_fullsized":"2024-05-12T10:50:01.653306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:50:34.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837930+0000","last_change":"2024-05-12T10:49:55.624986+0000","last_active":"2024-05-12T10:50:02.837930+0000","last_peered":"2024-05-12T10:50:02.837930+0000","last_clean":"2024-05-12T10:50:02.837930+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:50:02.837930+0000","last_undegraded":"2024-05-12T10:50:02.837930+0000","last_fullsized":"2024-05-12T10:50:02.837930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:03:47.220979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657155+0000","last_change":"2024-05-12T10:49:59.676139+0000","last_active":"2024-05-12T10:50:01.657155+0000","last_peered":"2024-05-12T10:50:01.657155+0000","last_clean":"2024-05-12T10:50:01.657155+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:50:01.657155+0000","last_undegraded":"2024-05-12T10:50:01.657155+0000","last_fullsized":"2024-05-12T10:50:01.657155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:24:15.396258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.918980+0000","last_change":"2024-05-12T10:49:54.645331+0000","last_active":"2024-05-12T10:50:02.918980+0000","last_peered":"2024-05-12T10:50:02.918980+0000","last_clean":"2024-05-12T10:50:02.918980+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:50:02.918980+0000","last_undegraded":"2024-05-12T10:50:02.918980+0000","last_fullsized":"2024-05-12T10:50:02.918980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:38:29.023589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658144+0000","last_change":"2024-05-12T10:49:55.642386+0000","last_active":"2024-05-12T10:50:01.658144+0000","last_peered":"2024-05-12T10:50:01.658144+0000","last_clean":"2024-05-12T10:50:01.658144+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:50:01.658144+0000","last_undegraded":"2024-05-12T10:50:01.658144+0000","last_fullsized":"2024-05-12T10:50:01.658144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:54:40.153070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657964+0000","last_change":"2024-05-12T10:49:59.679887+0000","last_active":"2024-05-12T10:50:01.657964+0000","last_peered":"2024-05-12T10:50:01.657964+0000","last_clean":"2024-05-12T10:50:01.657964+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:50:01.657964+0000","last_undegraded":"2024-05-12T10:50:01.657964+0000","last_fullsized":"2024-05-12T10:50:01.657964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:25:43.004918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919021+0000","last_change":"2024-05-12T10:49:54.659229+0000","last_active":"2024-05-12T10:50:02.919021+0000","last_peered":"2024-05-12T10:50:02.919021+0000","last_clean":"2024-05-12T10:50:02.919021+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:50:02.919021+0000","last_undegraded":"2024-05-12T10:50:02.919021+0000","last_fullsized":"2024-05-12T10:50:02.919021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:54:54.658165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660005+0000","last_change":"2024-05-12T10:49:55.642157+0000","last_active":"2024-05-12T10:50:01.660005+0000","last_peered":"2024-05-12T10:50:01.660005+0000","last_clean":"2024-05-12T10:50:01.660005+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:50:01.660005+0000","last_undegraded":"2024-05-12T10:50:01.660005+0000","last_fullsized":"2024-05-12T10:50:01.660005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:16.232731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658776+0000","last_change":"2024-05-12T10:49:59.663411+0000","last_active":"2024-05-12T10:50:01.658776+0000","last_peered":"2024-05-12T10:50:01.658776+0000","last_clean":"2024-05-12T10:50:01.658776+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:50:01.658776+0000","last_undegraded":"2024-05-12T10:50:01.658776+0000","last_fullsized":"2024-05-12T10:50:01.658776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:59.136704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075711+0000","last_change":"2024-05-12T10:49:55.646019+0000","last_active":"2024-05-12T10:50:02.075711+0000","last_peered":"2024-05-12T10:50:02.075711+0000","last_clean":"2024-05-12T10:50:02.075711+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:50:02.075711+0000","last_undegraded":"2024-05-12T10:50:02.075711+0000","last_fullsized":"2024-05-12T10:50:02.075711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:07.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919034+0000","last_change":"2024-05-12T10:49:54.642039+0000","last_active":"2024-05-12T10:50:02.919034+0000","last_peered":"2024-05-12T10:50:02.919034+0000","last_clean":"2024-05-12T10:50:02.919034+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:50:02.919034+0000","last_undegraded":"2024-05-12T10:50:02.919034+0000","last_fullsized":"2024-05-12T10:50:02.919034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:01.155569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660588+0000","last_change":"2024-05-12T10:49:59.660274+0000","last_active":"2024-05-12T10:50:01.660588+0000","last_peered":"2024-05-12T10:50:01.660588+0000","last_clean":"2024-05-12T10:50:01.660588+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:50:01.660588+0000","last_undegraded":"2024-05-12T10:50:01.660588+0000","last_fullsized":"2024-05-12T10:50:01.660588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:55:12.579645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652722+0000","last_change":"2024-05-12T10:49:55.618128+0000","last_active":"2024-05-12T10:50:01.652722+0000","last_peered":"2024-05-12T10:50:01.652722+0000","last_clean":"2024-05-12T10:50:01.652722+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:50:01.652722+0000","last_undegraded":"2024-05-12T10:50:01.652722+0000","last_fullsized":"2024-05-12T10:50:01.652722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:45.205117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915833+0000","last_change":"2024-05-12T10:49:54.619967+0000","last_active":"2024-05-12T10:50:02.915833+0000","last_peered":"2024-05-12T10:50:02.915833+0000","last_clean":"2024-05-12T10:50:02.915833+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:50:02.915833+0000","last_undegraded":"2024-05-12T10:50:02.915833+0000","last_fullsized":"2024-05-12T10:50:02.915833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:37:10.799631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659650+0000","last_change":"2024-05-12T10:49:59.681931+0000","last_active":"2024-05-12T10:50:01.659650+0000","last_peered":"2024-05-12T10:50:01.659650+0000","last_clean":"2024-05-12T10:50:01.659650+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:50:01.659650+0000","last_undegraded":"2024-05-12T10:50:01.659650+0000","last_fullsized":"2024-05-12T10:50:01.659650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:45:01.542628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652721+0000","last_change":"2024-05-12T10:49:55.615095+0000","last_active":"2024-05-12T10:50:01.652721+0000","last_peered":"2024-05-12T10:50:01.652721+0000","last_clean":"2024-05-12T10:50:01.652721+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:50:01.652721+0000","last_undegraded":"2024-05-12T10:50:01.652721+0000","last_fullsized":"2024-05-12T10:50:01.652721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:51:19.659941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916206+0000","last_change":"2024-05-12T10:49:54.639976+0000","last_active":"2024-05-12T10:50:02.916206+0000","last_peered":"2024-05-12T10:50:02.916206+0000","last_clean":"2024-05-12T10:50:02.916206+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:50:02.916206+0000","last_undegraded":"2024-05-12T10:50:02.916206+0000","last_fullsized":"2024-05-12T10:50:02.916206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:28:37.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916755+0000","last_change":"2024-05-12T10:50:00.390786+0000","last_active":"2024-05-12T10:50:02.916755+0000","last_peered":"2024-05-12T10:50:02.916755+0000","last_clean":"2024-05-12T10:50:02.916755+0000","last_became_active":"2024-05-12T10:50:00.390378+0000","last_became_peered":"2024-05-12T10:50:00.390378+0000","last_unstale":"2024-05-12T10:50:02.916755+0000","last_undegraded":"2024-05-12T10:50:02.916755+0000","last_fullsized":"2024-05-12T10:50:02.916755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:27:57.945259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658891+0000","last_change":"2024-05-12T10:49:55.622729+0000","last_active":"2024-05-12T10:50:01.658891+0000","last_peered":"2024-05-12T10:50:01.658891+0000","last_clean":"2024-05-12T10:50:01.658891+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:50:01.658891+0000","last_undegraded":"2024-05-12T10:50:01.658891+0000","last_fullsized":"2024-05-12T10:50:01.658891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:08:29.460684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919516+0000","last_change":"2024-05-12T10:49:54.639564+0000","last_active":"2024-05-12T10:50:02.919516+0000","last_peered":"2024-05-12T10:50:02.919516+0000","last_clean":"2024-05-12T10:50:02.919516+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:50:02.919516+0000","last_undegraded":"2024-05-12T10:50:02.919516+0000","last_fullsized":"2024-05-12T10:50:02.919516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:54:48.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.661417+0000","last_change":"2024-05-12T10:49:59.676220+0000","last_active":"2024-05-12T10:50:01.661417+0000","last_peered":"2024-05-12T10:50:01.661417+0000","last_clean":"2024-05-12T10:50:01.661417+0000","last_became_active":"2024-05-12T10:49:59.674835+0000","last_became_peered":"2024-05-12T10:49:59.674835+0000","last_unstale":"2024-05-12T10:50:01.661417+0000","last_undegraded":"2024-05-12T10:50:01.661417+0000","last_fullsized":"2024-05-12T10:50:01.661417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:55:03.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838015+0000","last_change":"2024-05-12T10:49:55.612744+0000","last_active":"2024-05-12T10:50:02.838015+0000","last_peered":"2024-05-12T10:50:02.838015+0000","last_clean":"2024-05-12T10:50:02.838015+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:50:02.838015+0000","last_undegraded":"2024-05-12T10:50:02.838015+0000","last_fullsized":"2024-05-12T10:50:02.838015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:05:06.274277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.077180+0000","last_change":"2024-05-12T10:49:54.643375+0000","last_active":"2024-05-12T10:50:02.077180+0000","last_peered":"2024-05-12T10:50:02.077180+0000","last_clean":"2024-05-12T10:50:02.077180+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:50:02.077180+0000","last_undegraded":"2024-05-12T10:50:02.077180+0000","last_fullsized":"2024-05-12T10:50:02.077180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:56:43.086871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658181+0000","last_change":"2024-05-12T10:50:00.393325+0000","last_active":"2024-05-12T10:50:01.658181+0000","last_peered":"2024-05-12T10:50:01.658181+0000","last_clean":"2024-05-12T10:50:01.658181+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:50:01.658181+0000","last_undegraded":"2024-05-12T10:50:01.658181+0000","last_fullsized":"2024-05-12T10:50:01.658181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:55.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653561+0000","last_change":"2024-05-12T10:49:55.629693+0000","last_active":"2024-05-12T10:50:01.653561+0000","last_peered":"2024-05-12T10:50:01.653561+0000","last_clean":"2024-05-12T10:50:01.653561+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:50:01.653561+0000","last_undegraded":"2024-05-12T10:50:01.653561+0000","last_fullsized":"2024-05-12T10:50:01.653561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:04:13.325079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915903+0000","last_change":"2024-05-12T10:49:54.629227+0000","last_active":"2024-05-12T10:50:02.915903+0000","last_peered":"2024-05-12T10:50:02.915903+0000","last_clean":"2024-05-12T10:50:02.915903+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:50:02.915903+0000","last_undegraded":"2024-05-12T10:50:02.915903+0000","last_fullsized":"2024-05-12T10:50:02.915903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:03.097527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652367+0000","last_change":"2024-05-12T10:50:00.396371+0000","last_active":"2024-05-12T10:50:01.652367+0000","last_peered":"2024-05-12T10:50:01.652367+0000","last_clean":"2024-05-12T10:50:01.652367+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:50:01.652367+0000","last_undegraded":"2024-05-12T10:50:01.652367+0000","last_fullsized":"2024-05-12T10:50:01.652367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:41:09.157859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916505+0000","last_change":"2024-05-12T10:49:55.612069+0000","last_active":"2024-05-12T10:50:02.916505+0000","last_peered":"2024-05-12T10:50:02.916505+0000","last_clean":"2024-05-12T10:50:02.916505+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:50:02.916505+0000","last_undegraded":"2024-05-12T10:50:02.916505+0000","last_fullsized":"2024-05-12T10:50:02.916505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:38.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921005+0000","last_change":"2024-05-12T10:49:54.639928+0000","last_active":"2024-05-12T10:50:02.921005+0000","last_peered":"2024-05-12T10:50:02.921005+0000","last_clean":"2024-05-12T10:50:02.921005+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:50:02.921005+0000","last_undegraded":"2024-05-12T10:50:02.921005+0000","last_fullsized":"2024-05-12T10:50:02.921005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:59.215089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837562+0000","last_change":"2024-05-12T10:50:00.383605+0000","last_active":"2024-05-12T10:50:02.837562+0000","last_peered":"2024-05-12T10:50:02.837562+0000","last_clean":"2024-05-12T10:50:02.837562+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:50:02.837562+0000","last_undegraded":"2024-05-12T10:50:02.837562+0000","last_fullsized":"2024-05-12T10:50:02.837562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:28.619988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660251+0000","last_change":"2024-05-12T10:49:55.621201+0000","last_active":"2024-05-12T10:50:01.660251+0000","last_peered":"2024-05-12T10:50:01.660251+0000","last_clean":"2024-05-12T10:50:01.660251+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:50:01.660251+0000","last_undegraded":"2024-05-12T10:50:01.660251+0000","last_fullsized":"2024-05-12T10:50:01.660251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:19:39.117790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916601+0000","last_change":"2024-05-12T10:49:54.620329+0000","last_active":"2024-05-12T10:50:02.916601+0000","last_peered":"2024-05-12T10:50:02.916601+0000","last_clean":"2024-05-12T10:50:02.916601+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:50:02.916601+0000","last_undegraded":"2024-05-12T10:50:02.916601+0000","last_fullsized":"2024-05-12T10:50:02.916601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:21:10.386830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916162+0000","last_change":"2024-05-12T10:49:59.655432+0000","last_active":"2024-05-12T10:50:02.916162+0000","last_peered":"2024-05-12T10:50:02.916162+0000","last_clean":"2024-05-12T10:50:02.916162+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:50:02.916162+0000","last_undegraded":"2024-05-12T10:50:02.916162+0000","last_fullsized":"2024-05-12T10:50:02.916162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:27:34.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658413+0000","last_change":"2024-05-12T10:49:55.628221+0000","last_active":"2024-05-12T10:50:01.658413+0000","last_peered":"2024-05-12T10:50:01.658413+0000","last_clean":"2024-05-12T10:50:01.658413+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:50:01.658413+0000","last_undegraded":"2024-05-12T10:50:01.658413+0000","last_fullsized":"2024-05-12T10:50:01.658413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:54.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659836+0000","last_change":"2024-05-12T10:49:54.652499+0000","last_active":"2024-05-12T10:50:01.659836+0000","last_peered":"2024-05-12T10:50:01.659836+0000","last_clean":"2024-05-12T10:50:01.659836+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:50:01.659836+0000","last_undegraded":"2024-05-12T10:50:01.659836+0000","last_fullsized":"2024-05-12T10:50:01.659836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:14:35.180779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916502+0000","last_change":"2024-05-12T10:49:59.676676+0000","last_active":"2024-05-12T10:50:02.916502+0000","last_peered":"2024-05-12T10:50:02.916502+0000","last_clean":"2024-05-12T10:50:02.916502+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:50:02.916502+0000","last_undegraded":"2024-05-12T10:50:02.916502+0000","last_fullsized":"2024-05-12T10:50:02.916502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:03:13.485130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916164+0000","last_change":"2024-05-12T10:49:55.610830+0000","last_active":"2024-05-12T10:50:02.916164+0000","last_peered":"2024-05-12T10:50:02.916164+0000","last_clean":"2024-05-12T10:50:02.916164+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:50:02.916164+0000","last_undegraded":"2024-05-12T10:50:02.916164+0000","last_fullsized":"2024-05-12T10:50:02.916164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:15.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101999+0000","last_change":"2024-05-12T10:49:54.609239+0000","last_active":"2024-05-12T10:50:02.101999+0000","last_peered":"2024-05-12T10:50:02.101999+0000","last_clean":"2024-05-12T10:50:02.101999+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:50:02.101999+0000","last_undegraded":"2024-05-12T10:50:02.101999+0000","last_fullsized":"2024-05-12T10:50:02.101999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:12:54.169428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916817+0000","last_change":"2024-05-12T10:49:59.656739+0000","last_active":"2024-05-12T10:50:02.916817+0000","last_peered":"2024-05-12T10:50:02.916817+0000","last_clean":"2024-05-12T10:50:02.916817+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:50:02.916817+0000","last_undegraded":"2024-05-12T10:50:02.916817+0000","last_fullsized":"2024-05-12T10:50:02.916817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:05.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837232+0000","last_change":"2024-05-12T10:49:55.626312+0000","last_active":"2024-05-12T10:50:02.837232+0000","last_peered":"2024-05-12T10:50:02.837232+0000","last_clean":"2024-05-12T10:50:02.837232+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:50:02.837232+0000","last_undegraded":"2024-05-12T10:50:02.837232+0000","last_fullsized":"2024-05-12T10:50:02.837232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:36.639971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919870+0000","last_change":"2024-05-12T10:49:54.640819+0000","last_active":"2024-05-12T10:50:02.919870+0000","last_peered":"2024-05-12T10:50:02.919870+0000","last_clean":"2024-05-12T10:50:02.919870+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:50:02.919870+0000","last_undegraded":"2024-05-12T10:50:02.919870+0000","last_fullsized":"2024-05-12T10:50:02.919870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:01.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837983+0000","last_change":"2024-05-12T10:50:00.384347+0000","last_active":"2024-05-12T10:50:02.837983+0000","last_peered":"2024-05-12T10:50:02.837983+0000","last_clean":"2024-05-12T10:50:02.837983+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:50:02.837983+0000","last_undegraded":"2024-05-12T10:50:02.837983+0000","last_fullsized":"2024-05-12T10:50:02.837983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:30.794704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652533+0000","last_change":"2024-05-12T10:49:55.627340+0000","last_active":"2024-05-12T10:50:01.652533+0000","last_peered":"2024-05-12T10:50:01.652533+0000","last_clean":"2024-05-12T10:50:01.652533+0000","last_became_active":"2024-05-12T10:49:55.627065+0000","last_became_peered":"2024-05-12T10:49:55.627065+0000","last_unstale":"2024-05-12T10:50:01.652533+0000","last_undegraded":"2024-05-12T10:50:01.652533+0000","last_fullsized":"2024-05-12T10:50:01.652533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:57:50.849518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658936+0000","last_change":"2024-05-12T10:49:54.648333+0000","last_active":"2024-05-12T10:50:01.658936+0000","last_peered":"2024-05-12T10:50:01.658936+0000","last_clean":"2024-05-12T10:50:01.658936+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:50:01.658936+0000","last_undegraded":"2024-05-12T10:50:01.658936+0000","last_fullsized":"2024-05-12T10:50:01.658936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:29.355444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920043+0000","last_change":"2024-05-12T10:49:45.547469+0000","last_active":"2024-05-12T10:50:02.920043+0000","last_peered":"2024-05-12T10:50:02.920043+0000","last_clean":"2024-05-12T10:50:02.920043+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:50:02.920043+0000","last_undegraded":"2024-05-12T10:50:02.920043+0000","last_fullsized":"2024-05-12T10:50:02.920043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_clean_scrub_stamp":"2024-05-12T10:49:43.953472+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:44:15.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076721+0000","last_change":"2024-05-12T10:50:00.399288+0000","last_active":"2024-05-12T10:50:02.076721+0000","last_peered":"2024-05-12T10:50:02.076721+0000","last_clean":"2024-05-12T10:50:02.076721+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:50:02.076721+0000","last_undegraded":"2024-05-12T10:50:02.076721+0000","last_fullsized":"2024-05-12T10:50:02.076721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:26.959086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920561+0000","last_change":"2024-05-12T10:49:55.639605+0000","last_active":"2024-05-12T10:50:02.920561+0000","last_peered":"2024-05-12T10:50:02.920561+0000","last_clean":"2024-05-12T10:50:02.920561+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:50:02.920561+0000","last_undegraded":"2024-05-12T10:50:02.920561+0000","last_fullsized":"2024-05-12T10:50:02.920561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:46:26.585195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102261+0000","last_change":"2024-05-12T10:49:54.654999+0000","last_active":"2024-05-12T10:50:02.102261+0000","last_peered":"2024-05-12T10:50:02.102261+0000","last_clean":"2024-05-12T10:50:02.102261+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:50:02.102261+0000","last_undegraded":"2024-05-12T10:50:02.102261+0000","last_fullsized":"2024-05-12T10:50:02.102261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:00:20.115739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076118+0000","last_change":"2024-05-12T10:50:00.393017+0000","last_active":"2024-05-12T10:50:02.076118+0000","last_peered":"2024-05-12T10:50:02.076118+0000","last_clean":"2024-05-12T10:50:02.076118+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:50:02.076118+0000","last_undegraded":"2024-05-12T10:50:02.076118+0000","last_fullsized":"2024-05-12T10:50:02.076118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:01:02.394572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658363+0000","last_change":"2024-05-12T10:49:55.623665+0000","last_active":"2024-05-12T10:50:01.658363+0000","last_peered":"2024-05-12T10:50:01.658363+0000","last_clean":"2024-05-12T10:50:01.658363+0000","last_became_active":"2024-05-12T10:49:55.623403+0000","last_became_peered":"2024-05-12T10:49:55.623403+0000","last_unstale":"2024-05-12T10:50:01.658363+0000","last_undegraded":"2024-05-12T10:50:01.658363+0000","last_fullsized":"2024-05-12T10:50:01.658363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:18:25.399664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915873+0000","last_change":"2024-05-12T10:49:54.628492+0000","last_active":"2024-05-12T10:50:02.915873+0000","last_peered":"2024-05-12T10:50:02.915873+0000","last_clean":"2024-05-12T10:50:02.915873+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:50:02.915873+0000","last_undegraded":"2024-05-12T10:50:02.915873+0000","last_fullsized":"2024-05-12T10:50:02.915873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:35:38.949401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837763+0000","last_change":"2024-05-12T10:49:59.657783+0000","last_active":"2024-05-12T10:50:02.837763+0000","last_peered":"2024-05-12T10:50:02.837763+0000","last_clean":"2024-05-12T10:50:02.837763+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:50:02.837763+0000","last_undegraded":"2024-05-12T10:50:02.837763+0000","last_fullsized":"2024-05-12T10:50:02.837763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:51:21.103458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921189+0000","last_change":"2024-05-12T10:49:55.646246+0000","last_active":"2024-05-12T10:50:02.921189+0000","last_peered":"2024-05-12T10:50:02.921189+0000","last_clean":"2024-05-12T10:50:02.921189+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:50:02.921189+0000","last_undegraded":"2024-05-12T10:50:02.921189+0000","last_fullsized":"2024-05-12T10:50:02.921189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:32.142128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102403+0000","last_change":"2024-05-12T10:49:54.610076+0000","last_active":"2024-05-12T10:50:02.102403+0000","last_peered":"2024-05-12T10:50:02.102403+0000","last_clean":"2024-05-12T10:50:02.102403+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:50:02.102403+0000","last_undegraded":"2024-05-12T10:50:02.102403+0000","last_fullsized":"2024-05-12T10:50:02.102403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:12:04.400894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657078+0000","last_change":"2024-05-12T10:50:00.386172+0000","last_active":"2024-05-12T10:50:01.657078+0000","last_peered":"2024-05-12T10:50:01.657078+0000","last_clean":"2024-05-12T10:50:01.657078+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:50:01.657078+0000","last_undegraded":"2024-05-12T10:50:01.657078+0000","last_fullsized":"2024-05-12T10:50:01.657078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:06:17.550197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920926+0000","last_change":"2024-05-12T10:49:55.646249+0000","last_active":"2024-05-12T10:50:02.920926+0000","last_peered":"2024-05-12T10:50:02.920926+0000","last_clean":"2024-05-12T10:50:02.920926+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:50:02.920926+0000","last_undegraded":"2024-05-12T10:50:02.920926+0000","last_fullsized":"2024-05-12T10:50:02.920926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:15.036675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660898+0000","last_change":"2024-05-12T10:49:54.621293+0000","last_active":"2024-05-12T10:50:01.660898+0000","last_peered":"2024-05-12T10:50:01.660898+0000","last_clean":"2024-05-12T10:50:01.660898+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:50:01.660898+0000","last_undegraded":"2024-05-12T10:50:01.660898+0000","last_fullsized":"2024-05-12T10:50:01.660898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:45:33.341215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657581+0000","last_change":"2024-05-12T10:49:59.673656+0000","last_active":"2024-05-12T10:50:01.657581+0000","last_peered":"2024-05-12T10:50:01.657581+0000","last_clean":"2024-05-12T10:50:01.657581+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:50:01.657581+0000","last_undegraded":"2024-05-12T10:50:01.657581+0000","last_fullsized":"2024-05-12T10:50:01.657581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:38.364434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919917+0000","last_change":"2024-05-12T10:49:55.646526+0000","last_active":"2024-05-12T10:50:02.919917+0000","last_peered":"2024-05-12T10:50:02.919917+0000","last_clean":"2024-05-12T10:50:02.919917+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:50:02.919917+0000","last_undegraded":"2024-05-12T10:50:02.919917+0000","last_fullsized":"2024-05-12T10:50:02.919917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:56:52.102442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101889+0000","last_change":"2024-05-12T10:49:54.617906+0000","last_active":"2024-05-12T10:50:02.101889+0000","last_peered":"2024-05-12T10:50:02.101889+0000","last_clean":"2024-05-12T10:50:02.101889+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:50:02.101889+0000","last_undegraded":"2024-05-12T10:50:02.101889+0000","last_fullsized":"2024-05-12T10:50:02.101889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:26:35.150963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837853+0000","last_change":"2024-05-12T10:49:59.671791+0000","last_active":"2024-05-12T10:50:02.837853+0000","last_peered":"2024-05-12T10:50:02.837853+0000","last_clean":"2024-05-12T10:50:02.837853+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:50:02.837853+0000","last_undegraded":"2024-05-12T10:50:02.837853+0000","last_fullsized":"2024-05-12T10:50:02.837853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:27.425708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076017+0000","last_change":"2024-05-12T10:49:55.637810+0000","last_active":"2024-05-12T10:50:02.076017+0000","last_peered":"2024-05-12T10:50:02.076017+0000","last_clean":"2024-05-12T10:50:02.076017+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:50:02.076017+0000","last_undegraded":"2024-05-12T10:50:02.076017+0000","last_fullsized":"2024-05-12T10:50:02.076017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:52.001497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076035+0000","last_change":"2024-05-12T10:49:54.637728+0000","last_active":"2024-05-12T10:50:02.076035+0000","last_peered":"2024-05-12T10:50:02.076035+0000","last_clean":"2024-05-12T10:50:02.076035+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:50:02.076035+0000","last_undegraded":"2024-05-12T10:50:02.076035+0000","last_fullsized":"2024-05-12T10:50:02.076035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:39.996419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653563+0000","last_change":"2024-05-12T10:50:00.383444+0000","last_active":"2024-05-12T10:50:01.653563+0000","last_peered":"2024-05-12T10:50:01.653563+0000","last_clean":"2024-05-12T10:50:01.653563+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:50:01.653563+0000","last_undegraded":"2024-05-12T10:50:01.653563+0000","last_fullsized":"2024-05-12T10:50:01.653563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:55:04.226848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920128+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:50:02.920128+0000","last_peered":"2024-05-12T10:50:02.920128+0000","last_clean":"2024-05-12T10:50:02.920128+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:50:02.920128+0000","last_undegraded":"2024-05-12T10:50:02.920128+0000","last_fullsized":"2024-05-12T10:50:02.920128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:15:58.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660087+0000","last_change":"2024-05-12T10:49:54.656814+0000","last_active":"2024-05-12T10:50:01.660087+0000","last_peered":"2024-05-12T10:50:01.660087+0000","last_clean":"2024-05-12T10:50:01.660087+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:50:01.660087+0000","last_undegraded":"2024-05-12T10:50:01.660087+0000","last_fullsized":"2024-05-12T10:50:01.660087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:26.660043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653232+0000","last_change":"2024-05-12T10:50:00.390308+0000","last_active":"2024-05-12T10:50:01.653232+0000","last_peered":"2024-05-12T10:50:01.653232+0000","last_clean":"2024-05-12T10:50:01.653232+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:50:01.653232+0000","last_undegraded":"2024-05-12T10:50:01.653232+0000","last_fullsized":"2024-05-12T10:50:01.653232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:43.650956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837442+0000","last_change":"2024-05-12T10:49:55.628907+0000","last_active":"2024-05-12T10:50:02.837442+0000","last_peered":"2024-05-12T10:50:02.837442+0000","last_clean":"2024-05-12T10:50:02.837442+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:50:02.837442+0000","last_undegraded":"2024-05-12T10:50:02.837442+0000","last_fullsized":"2024-05-12T10:50:02.837442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:13:50.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837019+0000","last_change":"2024-05-12T10:49:54.626002+0000","last_active":"2024-05-12T10:50:02.837019+0000","last_peered":"2024-05-12T10:50:02.837019+0000","last_clean":"2024-05-12T10:50:02.837019+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:50:02.837019+0000","last_undegraded":"2024-05-12T10:50:02.837019+0000","last_fullsized":"2024-05-12T10:50:02.837019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:19:19.976387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659867+0000","last_change":"2024-05-12T10:50:00.387192+0000","last_active":"2024-05-12T10:50:01.659867+0000","last_peered":"2024-05-12T10:50:01.659867+0000","last_clean":"2024-05-12T10:50:01.659867+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:50:01.659867+0000","last_undegraded":"2024-05-12T10:50:01.659867+0000","last_fullsized":"2024-05-12T10:50:01.659867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:15:23.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920487+0000","last_change":"2024-05-12T10:49:55.634551+0000","last_active":"2024-05-12T10:50:02.920487+0000","last_peered":"2024-05-12T10:50:02.920487+0000","last_clean":"2024-05-12T10:50:02.920487+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:50:02.920487+0000","last_undegraded":"2024-05-12T10:50:02.920487+0000","last_fullsized":"2024-05-12T10:50:02.920487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:10:52.477145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:09.379163+0000","last_change":"2024-05-12T10:49:54.634748+0000","last_active":"2024-05-12T10:50:09.379163+0000","last_peered":"2024-05-12T10:50:09.379163+0000","last_clean":"2024-05-12T10:50:09.379163+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:50:09.379163+0000","last_undegraded":"2024-05-12T10:50:09.379163+0000","last_fullsized":"2024-05-12T10:50:09.379163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:39:16.646133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916160+0000","last_change":"2024-05-12T10:49:59.671405+0000","last_active":"2024-05-12T10:50:02.916160+0000","last_peered":"2024-05-12T10:50:02.916160+0000","last_clean":"2024-05-12T10:50:02.916160+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:50:02.916160+0000","last_undegraded":"2024-05-12T10:50:02.916160+0000","last_fullsized":"2024-05-12T10:50:02.916160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:06:34.170753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659820+0000","last_change":"2024-05-12T10:49:55.634686+0000","last_active":"2024-05-12T10:50:01.659820+0000","last_peered":"2024-05-12T10:50:01.659820+0000","last_clean":"2024-05-12T10:50:01.659820+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:50:01.659820+0000","last_undegraded":"2024-05-12T10:50:01.659820+0000","last_fullsized":"2024-05-12T10:50:01.659820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:25:04.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915889+0000","last_change":"2024-05-12T10:49:54.656012+0000","last_active":"2024-05-12T10:50:02.915889+0000","last_peered":"2024-05-12T10:50:02.915889+0000","last_clean":"2024-05-12T10:50:02.915889+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:50:02.915889+0000","last_undegraded":"2024-05-12T10:50:02.915889+0000","last_fullsized":"2024-05-12T10:50:02.915889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:29.253250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658272+0000","last_change":"2024-05-12T10:49:59.672820+0000","last_active":"2024-05-12T10:50:01.658272+0000","last_peered":"2024-05-12T10:50:01.658272+0000","last_clean":"2024-05-12T10:50:01.658272+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:50:01.658272+0000","last_undegraded":"2024-05-12T10:50:01.658272+0000","last_fullsized":"2024-05-12T10:50:01.658272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:49:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838093+0000","last_change":"2024-05-12T10:49:55.620541+0000","last_active":"2024-05-12T10:50:02.838093+0000","last_peered":"2024-05-12T10:50:02.838093+0000","last_clean":"2024-05-12T10:50:02.838093+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:50:02.838093+0000","last_undegraded":"2024-05-12T10:50:02.838093+0000","last_fullsized":"2024-05-12T10:50:02.838093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:11.742829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660247+0000","last_change":"2024-05-12T10:49:54.651289+0000","last_active":"2024-05-12T10:50:01.660247+0000","last_peered":"2024-05-12T10:50:01.660247+0000","last_clean":"2024-05-12T10:50:01.660247+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:50:01.660247+0000","last_undegraded":"2024-05-12T10:50:01.660247+0000","last_fullsized":"2024-05-12T10:50:01.660247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:33:24.087763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652523+0000","last_change":"2024-05-12T10:49:59.670973+0000","last_active":"2024-05-12T10:50:01.652523+0000","last_peered":"2024-05-12T10:50:01.652523+0000","last_clean":"2024-05-12T10:50:01.652523+0000","last_became_active":"2024-05-12T10:49:59.670656+0000","last_became_peered":"2024-05-12T10:49:59.670656+0000","last_unstale":"2024-05-12T10:50:01.652523+0000","last_undegraded":"2024-05-12T10:50:01.652523+0000","last_fullsized":"2024-05-12T10:50:01.652523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:16:58.665403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659979+0000","last_change":"2024-05-12T10:49:55.626645+0000","last_active":"2024-05-12T10:50:01.659979+0000","last_peered":"2024-05-12T10:50:01.659979+0000","last_clean":"2024-05-12T10:50:01.659979+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:50:01.659979+0000","last_undegraded":"2024-05-12T10:50:01.659979+0000","last_fullsized":"2024-05-12T10:50:01.659979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:41.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076937+0000","last_change":"2024-05-12T10:49:54.654822+0000","last_active":"2024-05-12T10:50:02.076937+0000","last_peered":"2024-05-12T10:50:02.076937+0000","last_clean":"2024-05-12T10:50:02.076937+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:50:02.076937+0000","last_undegraded":"2024-05-12T10:50:02.076937+0000","last_fullsized":"2024-05-12T10:50:02.076937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:52:07.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652430+0000","last_change":"2024-05-12T10:50:00.396453+0000","last_active":"2024-05-12T10:50:01.652430+0000","last_peered":"2024-05-12T10:50:01.652430+0000","last_clean":"2024-05-12T10:50:01.652430+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:50:01.652430+0000","last_undegraded":"2024-05-12T10:50:01.652430+0000","last_fullsized":"2024-05-12T10:50:01.652430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:40.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837810+0000","last_change":"2024-05-12T10:50:00.390477+0000","last_active":"2024-05-12T10:50:02.837810+0000","last_peered":"2024-05-12T10:50:02.837810+0000","last_clean":"2024-05-12T10:50:02.837810+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:50:02.837810+0000","last_undegraded":"2024-05-12T10:50:02.837810+0000","last_fullsized":"2024-05-12T10:50:02.837810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:20:19.551216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916112+0000","last_change":"2024-05-12T10:49:55.619984+0000","last_active":"2024-05-12T10:50:02.916112+0000","last_peered":"2024-05-12T10:50:02.916112+0000","last_clean":"2024-05-12T10:50:02.916112+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:50:02.916112+0000","last_undegraded":"2024-05-12T10:50:02.916112+0000","last_fullsized":"2024-05-12T10:50:02.916112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:21:34.136203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657970+0000","last_change":"2024-05-12T10:49:54.656580+0000","last_active":"2024-05-12T10:50:01.657970+0000","last_peered":"2024-05-12T10:50:01.657970+0000","last_clean":"2024-05-12T10:50:01.657970+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:50:01.657970+0000","last_undegraded":"2024-05-12T10:50:01.657970+0000","last_fullsized":"2024-05-12T10:50:01.657970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:43:32.603999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076883+0000","last_change":"2024-05-12T10:49:59.681648+0000","last_active":"2024-05-12T10:50:02.076883+0000","last_peered":"2024-05-12T10:50:02.076883+0000","last_clean":"2024-05-12T10:50:02.076883+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:50:02.076883+0000","last_undegraded":"2024-05-12T10:50:02.076883+0000","last_fullsized":"2024-05-12T10:50:02.076883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:54.912836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652618+0000","last_change":"2024-05-12T10:49:55.617393+0000","last_active":"2024-05-12T10:50:01.652618+0000","last_peered":"2024-05-12T10:50:01.652618+0000","last_clean":"2024-05-12T10:50:01.652618+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:50:01.652618+0000","last_undegraded":"2024-05-12T10:50:01.652618+0000","last_fullsized":"2024-05-12T10:50:01.652618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:51.584695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652565+0000","last_change":"2024-05-12T10:49:54.637393+0000","last_active":"2024-05-12T10:50:01.652565+0000","last_peered":"2024-05-12T10:50:01.652565+0000","last_clean":"2024-05-12T10:50:01.652565+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:50:01.652565+0000","last_undegraded":"2024-05-12T10:50:01.652565+0000","last_fullsized":"2024-05-12T10:50:01.652565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:44:00.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076344+0000","last_change":"2024-05-12T10:49:54.636945+0000","last_active":"2024-05-12T10:50:02.076344+0000","last_peered":"2024-05-12T10:50:02.076344+0000","last_clean":"2024-05-12T10:50:02.076344+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:50:02.076344+0000","last_undegraded":"2024-05-12T10:50:02.076344+0000","last_fullsized":"2024-05-12T10:50:02.076344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:34:25.927458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837878+0000","last_change":"2024-05-12T10:49:55.627105+0000","last_active":"2024-05-12T10:50:02.837878+0000","last_peered":"2024-05-12T10:50:02.837878+0000","last_clean":"2024-05-12T10:50:02.837878+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:50:02.837878+0000","last_undegraded":"2024-05-12T10:50:02.837878+0000","last_fullsized":"2024-05-12T10:50:02.837878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:00:09.334541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102212+0000","last_change":"2024-05-12T10:49:59.659142+0000","last_active":"2024-05-12T10:50:02.102212+0000","last_peered":"2024-05-12T10:50:02.102212+0000","last_clean":"2024-05-12T10:50:02.102212+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:50:02.102212+0000","last_undegraded":"2024-05-12T10:50:02.102212+0000","last_fullsized":"2024-05-12T10:50:02.102212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:40.443593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652797+0000","last_change":"2024-05-12T10:49:54.632224+0000","last_active":"2024-05-12T10:50:01.652797+0000","last_peered":"2024-05-12T10:50:01.652797+0000","last_clean":"2024-05-12T10:50:01.652797+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:50:01.652797+0000","last_undegraded":"2024-05-12T10:50:01.652797+0000","last_fullsized":"2024-05-12T10:50:01.652797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:27:39.637678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659206+0000","last_change":"2024-05-12T10:49:55.633243+0000","last_active":"2024-05-12T10:50:01.659206+0000","last_peered":"2024-05-12T10:50:01.659206+0000","last_clean":"2024-05-12T10:50:01.659206+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:50:01.659206+0000","last_undegraded":"2024-05-12T10:50:01.659206+0000","last_fullsized":"2024-05-12T10:50:01.659206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:14.239020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652874+0000","last_change":"2024-05-12T10:49:59.655807+0000","last_active":"2024-05-12T10:50:01.652874+0000","last_peered":"2024-05-12T10:50:01.652874+0000","last_clean":"2024-05-12T10:50:01.652874+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:50:01.652874+0000","last_undegraded":"2024-05-12T10:50:01.652874+0000","last_fullsized":"2024-05-12T10:50:01.652874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:12.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075680+0000","last_change":"2024-05-12T10:49:55.637106+0000","last_active":"2024-05-12T10:50:02.075680+0000","last_peered":"2024-05-12T10:50:02.075680+0000","last_clean":"2024-05-12T10:50:02.075680+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:50:02.075680+0000","last_undegraded":"2024-05-12T10:50:02.075680+0000","last_fullsized":"2024-05-12T10:50:02.075680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:22:07.477677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101967+0000","last_change":"2024-05-12T10:49:55.618952+0000","last_active":"2024-05-12T10:50:02.101967+0000","last_peered":"2024-05-12T10:50:02.101967+0000","last_clean":"2024-05-12T10:50:02.101967+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:50:02.101967+0000","last_undegraded":"2024-05-12T10:50:02.101967+0000","last_fullsized":"2024-05-12T10:50:02.101967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:38:10.693066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659549+0000","last_change":"2024-05-12T10:49:55.623916+0000","last_active":"2024-05-12T10:50:01.659549+0000","last_peered":"2024-05-12T10:50:01.659549+0000","last_clean":"2024-05-12T10:50:01.659549+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:50:01.659549+0000","last_undegraded":"2024-05-12T10:50:01.659549+0000","last_fullsized":"2024-05-12T10:50:01.659549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:06:14.434631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837761+0000","last_change":"2024-05-12T10:49:55.620278+0000","last_active":"2024-05-12T10:50:02.837761+0000","last_peered":"2024-05-12T10:50:02.837761+0000","last_clean":"2024-05-12T10:50:02.837761+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:50:02.837761+0000","last_undegraded":"2024-05-12T10:50:02.837761+0000","last_fullsized":"2024-05-12T10:50:02.837761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:59.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653439+0000","last_change":"2024-05-12T10:49:55.626216+0000","last_active":"2024-05-12T10:50:01.653439+0000","last_peered":"2024-05-12T10:50:01.653439+0000","last_clean":"2024-05-12T10:50:01.653439+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:50:01.653439+0000","last_undegraded":"2024-05-12T10:50:01.653439+0000","last_fullsized":"2024-05-12T10:50:01.653439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:52:14.438331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916463+0000","last_change":"2024-05-12T10:49:55.622085+0000","last_active":"2024-05-12T10:50:02.916463+0000","last_peered":"2024-05-12T10:50:02.916463+0000","last_clean":"2024-05-12T10:50:02.916463+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:50:02.916463+0000","last_undegraded":"2024-05-12T10:50:02.916463+0000","last_fullsized":"2024-05-12T10:50:02.916463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:41:42.558506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076984+0000","last_change":"2024-05-12T10:49:55.635592+0000","last_active":"2024-05-12T10:50:02.076984+0000","last_peered":"2024-05-12T10:50:02.076984+0000","last_clean":"2024-05-12T10:50:02.076984+0000","last_became_active":"2024-05-12T10:49:55.635298+0000","last_became_peered":"2024-05-12T10:49:55.635298+0000","last_unstale":"2024-05-12T10:50:02.076984+0000","last_undegraded":"2024-05-12T10:50:02.076984+0000","last_fullsized":"2024-05-12T10:50:02.076984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:43:14.781372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653476+0000","last_change":"2024-05-12T10:49:55.626353+0000","last_active":"2024-05-12T10:50:01.653476+0000","last_peered":"2024-05-12T10:50:01.653476+0000","last_clean":"2024-05-12T10:50:01.653476+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:50:01.653476+0000","last_undegraded":"2024-05-12T10:50:01.653476+0000","last_fullsized":"2024-05-12T10:50:01.653476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:58.905284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657725+0000","last_change":"2024-05-12T10:49:55.621110+0000","last_active":"2024-05-12T10:50:01.657725+0000","last_peered":"2024-05-12T10:50:01.657725+0000","last_clean":"2024-05-12T10:50:01.657725+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:50:01.657725+0000","last_undegraded":"2024-05-12T10:50:01.657725+0000","last_fullsized":"2024-05-12T10:50:01.657725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:12:36.369923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652483+0000","last_change":"2024-05-12T10:49:55.626913+0000","last_active":"2024-05-12T10:50:01.652483+0000","last_peered":"2024-05-12T10:50:01.652483+0000","last_clean":"2024-05-12T10:50:01.652483+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:50:01.652483+0000","last_undegraded":"2024-05-12T10:50:01.652483+0000","last_fullsized":"2024-05-12T10:50:01.652483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:27:08.492294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659499+0000","last_change":"2024-05-12T10:49:55.629992+0000","last_active":"2024-05-12T10:50:01.659499+0000","last_peered":"2024-05-12T10:50:01.659499+0000","last_clean":"2024-05-12T10:50:01.659499+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:50:01.659499+0000","last_undegraded":"2024-05-12T10:50:01.659499+0000","last_fullsized":"2024-05-12T10:50:01.659499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:31.454363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837524+0000","last_change":"2024-05-12T10:49:55.620821+0000","last_active":"2024-05-12T10:50:02.837524+0000","last_peered":"2024-05-12T10:50:02.837524+0000","last_clean":"2024-05-12T10:50:02.837524+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:50:02.837524+0000","last_undegraded":"2024-05-12T10:50:02.837524+0000","last_fullsized":"2024-05-12T10:50:02.837524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:53.597215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076297+0000","last_change":"2024-05-12T10:49:55.646368+0000","last_active":"2024-05-12T10:50:02.076297+0000","last_peered":"2024-05-12T10:50:02.076297+0000","last_clean":"2024-05-12T10:50:02.076297+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:50:02.076297+0000","last_undegraded":"2024-05-12T10:50:02.076297+0000","last_fullsized":"2024-05-12T10:50:02.076297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:21:04.313921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920866+0000","last_change":"2024-05-12T10:49:55.633122+0000","last_active":"2024-05-12T10:50:02.920866+0000","last_peered":"2024-05-12T10:50:02.920866+0000","last_clean":"2024-05-12T10:50:02.920866+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:50:02.920866+0000","last_undegraded":"2024-05-12T10:50:02.920866+0000","last_fullsized":"2024-05-12T10:50:02.920866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:25:19.563648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102362+0000","last_change":"2024-05-12T10:49:55.635394+0000","last_active":"2024-05-12T10:50:02.102362+0000","last_peered":"2024-05-12T10:50:02.102362+0000","last_clean":"2024-05-12T10:50:02.102362+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:50:02.102362+0000","last_undegraded":"2024-05-12T10:50:02.102362+0000","last_fullsized":"2024-05-12T10:50:02.102362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:41:58.478292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660761+0000","last_change":"2024-05-12T10:49:55.626485+0000","last_active":"2024-05-12T10:50:01.660761+0000","last_peered":"2024-05-12T10:50:01.660761+0000","last_clean":"2024-05-12T10:50:01.660761+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:50:01.660761+0000","last_undegraded":"2024-05-12T10:50:01.660761+0000","last_fullsized":"2024-05-12T10:50:01.660761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:17.942339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657391+0000","last_change":"2024-05-12T10:49:55.618820+0000","last_active":"2024-05-12T10:50:01.657391+0000","last_peered":"2024-05-12T10:50:01.657391+0000","last_clean":"2024-05-12T10:50:01.657391+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:50:01.657391+0000","last_undegraded":"2024-05-12T10:50:01.657391+0000","last_fullsized":"2024-05-12T10:50:01.657391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:23:00.474438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916163+0000","last_change":"2024-05-12T10:49:55.626429+0000","last_active":"2024-05-12T10:50:02.916163+0000","last_peered":"2024-05-12T10:50:02.916163+0000","last_clean":"2024-05-12T10:50:02.916163+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:50:02.916163+0000","last_undegraded":"2024-05-12T10:50:02.916163+0000","last_fullsized":"2024-05-12T10:50:02.916163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:40:02.709729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837421+0000","last_change":"2024-05-12T10:49:55.612139+0000","last_active":"2024-05-12T10:50:02.837421+0000","last_peered":"2024-05-12T10:50:02.837421+0000","last_clean":"2024-05-12T10:50:02.837421+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:50:02.837421+0000","last_undegraded":"2024-05-12T10:50:02.837421+0000","last_fullsized":"2024-05-12T10:50:02.837421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:57:34.138392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652690+0000","last_change":"2024-05-12T10:49:55.631137+0000","last_active":"2024-05-12T10:50:01.652690+0000","last_peered":"2024-05-12T10:50:01.652690+0000","last_clean":"2024-05-12T10:50:01.652690+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:50:01.652690+0000","last_undegraded":"2024-05-12T10:50:01.652690+0000","last_fullsized":"2024-05-12T10:50:01.652690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:04.390314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659797+0000","last_change":"2024-05-12T10:49:55.643416+0000","last_active":"2024-05-12T10:50:01.659797+0000","last_peered":"2024-05-12T10:50:01.659797+0000","last_clean":"2024-05-12T10:50:01.659797+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:50:01.659797+0000","last_undegraded":"2024-05-12T10:50:01.659797+0000","last_fullsized":"2024-05-12T10:50:01.659797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:58.632966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076802+0000","last_change":"2024-05-12T10:49:55.635847+0000","last_active":"2024-05-12T10:50:02.076802+0000","last_peered":"2024-05-12T10:50:02.076802+0000","last_clean":"2024-05-12T10:50:02.076802+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:50:02.076802+0000","last_undegraded":"2024-05-12T10:50:02.076802+0000","last_fullsized":"2024-05-12T10:50:02.076802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:57:51.222099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076561+0000","last_change":"2024-05-12T10:49:55.641921+0000","last_active":"2024-05-12T10:50:02.076561+0000","last_peered":"2024-05-12T10:50:02.076561+0000","last_clean":"2024-05-12T10:50:02.076561+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:50:02.076561+0000","last_undegraded":"2024-05-12T10:50:02.076561+0000","last_fullsized":"2024-05-12T10:50:02.076561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:44:57.787358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921179+0000","last_change":"2024-05-12T10:49:55.635853+0000","last_active":"2024-05-12T10:50:02.921179+0000","last_peered":"2024-05-12T10:50:02.921179+0000","last_clean":"2024-05-12T10:50:02.921179+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:50:02.921179+0000","last_undegraded":"2024-05-12T10:50:02.921179+0000","last_fullsized":"2024-05-12T10:50:02.921179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:04:39.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652297+0000","last_change":"2024-05-12T10:49:55.620107+0000","last_active":"2024-05-12T10:50:01.652297+0000","last_peered":"2024-05-12T10:50:01.652297+0000","last_clean":"2024-05-12T10:50:01.652297+0000","last_became_active":"2024-05-12T10:49:55.619802+0000","last_became_peered":"2024-05-12T10:49:55.619802+0000","last_unstale":"2024-05-12T10:50:01.652297+0000","last_undegraded":"2024-05-12T10:50:01.652297+0000","last_fullsized":"2024-05-12T10:50:01.652297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:52:39.033778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920076+0000","last_change":"2024-05-12T10:49:55.629001+0000","last_active":"2024-05-12T10:50:02.920076+0000","last_peered":"2024-05-12T10:50:02.920076+0000","last_clean":"2024-05-12T10:50:02.920076+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:50:02.920076+0000","last_undegraded":"2024-05-12T10:50:02.920076+0000","last_fullsized":"2024-05-12T10:50:02.920076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:42:39.042271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659136+0000","last_change":"2024-05-12T10:49:55.625540+0000","last_active":"2024-05-12T10:50:01.659136+0000","last_peered":"2024-05-12T10:50:01.659136+0000","last_clean":"2024-05-12T10:50:01.659136+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:50:01.659136+0000","last_undegraded":"2024-05-12T10:50:01.659136+0000","last_fullsized":"2024-05-12T10:50:01.659136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:35.621918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919665+0000","last_change":"2024-05-12T10:49:55.633576+0000","last_active":"2024-05-12T10:50:02.919665+0000","last_peered":"2024-05-12T10:50:02.919665+0000","last_clean":"2024-05-12T10:50:02.919665+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:50:02.919665+0000","last_undegraded":"2024-05-12T10:50:02.919665+0000","last_fullsized":"2024-05-12T10:50:02.919665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:06:16.255147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657885+0000","last_change":"2024-05-12T10:49:55.624205+0000","last_active":"2024-05-12T10:50:01.657885+0000","last_peered":"2024-05-12T10:50:01.657885+0000","last_clean":"2024-05-12T10:50:01.657885+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:50:01.657885+0000","last_undegraded":"2024-05-12T10:50:01.657885+0000","last_fullsized":"2024-05-12T10:50:01.657885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:21.895269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837757+0000","last_change":"2024-05-12T10:49:55.610461+0000","last_active":"2024-05-12T10:50:02.837757+0000","last_peered":"2024-05-12T10:50:02.837757+0000","last_clean":"2024-05-12T10:50:02.837757+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:50:02.837757+0000","last_undegraded":"2024-05-12T10:50:02.837757+0000","last_fullsized":"2024-05-12T10:50:02.837757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:44.511895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916628+0000","last_change":"2024-05-12T10:49:55.608434+0000","last_active":"2024-05-12T10:50:02.916628+0000","last_peered":"2024-05-12T10:50:02.916628+0000","last_clean":"2024-05-12T10:50:02.916628+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:50:02.916628+0000","last_undegraded":"2024-05-12T10:50:02.916628+0000","last_fullsized":"2024-05-12T10:50:02.916628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:17.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920943+0000","last_change":"2024-05-12T10:49:55.639296+0000","last_active":"2024-05-12T10:50:02.920943+0000","last_peered":"2024-05-12T10:50:02.920943+0000","last_clean":"2024-05-12T10:50:02.920943+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:50:02.920943+0000","last_undegraded":"2024-05-12T10:50:02.920943+0000","last_fullsized":"2024-05-12T10:50:02.920943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:47:15.862328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":701646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":110786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:50:22.184 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-12T10:50:22.185 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-12T10:50:22.185 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-12T10:50:22.185 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-12T10:50:22.185 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-12T10:50:22.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.361+0000 7f522a800640 1 Processor -- start 2024-05-12T10:50:22.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.361+0000 7f522a800640 1 -- start start 2024-05-12T10:50:22.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.361+0000 7f522a800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52240c4920 0x7f52240c6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.361+0000 7f522a800640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52240ca850 con 0x7f522415cb30 2024-05-12T10:50:22.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.361+0000 7f522a800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52240cab30 con 0x7f5224152a90 2024-05-12T10:50:22.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.361+0000 7f522a800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f52240c4f80 con 0x7f52240c4920 2024-05-12T10:50:22.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.361+0000 7f521aa00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f522415cb30 0x7f52240c8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53044/0 (socket says 172.21.15.115:53044) 2024-05-12T10:50:22.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.361+0000 7f521aa00640 1 -- 172.21.15.115:0/2505623725 learned_addr learned my addr 172.21.15.115:0/2505623725 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:22.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5223e00640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52240c4920 0x7f52240c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578135933 0 0) 0x7f52240ca850 con 0x7f522415cb30 2024-05-12T10:50:22.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5208003530 con 0x7f522415cb30 2024-05-12T10:50:22.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730287852 0 0) 0x7f52240cab30 con 0x7f5224152a90 2024-05-12T10:50:22.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52240ca850 con 0x7f5224152a90 2024-05-12T10:50:22.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1422898506 0 0) 0x7f5208003530 con 0x7f522415cb30 2024-05-12T10:50:22.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52240c4920 msgr2=0x7f52240c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:22.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52240c4920 0x7f52240c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 >> v1:172.21.15.134:6789/0 conn(0x7f5224152a90 legacy=0x7f52241593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522415c050 con 0x7f522415cb30 2024-05-12T10:50:22.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f520c001700 con 0x7f522415cb30 2024-05-12T10:50:22.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 >> v1:172.21.15.115:6789/0 conn(0x7f522415cb30 legacy=0x7f52240c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52240c4920 0x7f5208003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52080041d0 0x7f5208004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5208004d50 0x7f52080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f520800dd70 con 0x7f52080041d0 2024-05-12T10:50:22.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f520800df20 con 0x7f5208004d50 2024-05-12T10:50:22.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f520800e120 con 0x7f52240c4920 2024-05-12T10:50:22.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f521aa00640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52080041d0 0x7f5208004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5223400640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52240c4920 0x7f5208003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f5223e00640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5208004d50 0x7f52080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f521aa00640 1 -- 172.21.15.115:0/2505623725 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52240c4920 msgr2=0x7f5208003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:22.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f521aa00640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52240c4920 0x7f5208003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f521aa00640 1 -- 172.21.15.115:0/2505623725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5208004d50 msgr2=0x7f52080051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:22.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f521aa00640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5208004d50 0x7f52080051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.365+0000 7f521aa00640 1 -- 172.21.15.115:0/2505623725 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5208003530 con 0x7f52080041d0 2024-05-12T10:50:22.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f521aa00640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52080041d0 0x7f5208004810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f520c00c190 tx=0x7f520c01cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9146e07dc35fbefc server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:22.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c007cb0 con 0x7f52080041d0 2024-05-12T10:50:22.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f520c0a9020 con 0x7f52080041d0 2024-05-12T10:50:22.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f5222a00640 1 -- 172.21.15.115:0/2505623725 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c005b00 con 0x7f52080041d0 2024-05-12T10:50:22.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 -- 172.21.15.115:0/2505623725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52080041d0 msgr2=0x7f5208004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 --2- 172.21.15.115:0/2505623725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52080041d0 0x7f5208004810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f520c00c190 tx=0x7f520c01cb40 comp rx=0 tx=0).stop 2024-05-12T10:50:22.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f5223e00640 1 -- 172.21.15.115:0/2505623725 reap_dead start 2024-05-12T10:50:22.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 -- 172.21.15.115:0/2505623725 shutdown_connections 2024-05-12T10:50:22.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 -- 172.21.15.115:0/2505623725 >> 172.21.15.115:0/2505623725 conn(0x7f52240681c0 msgr2=0x7f52240685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:22.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 -- 172.21.15.115:0/2505623725 shutdown_connections 2024-05-12T10:50:22.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 -- 172.21.15.115:0/2505623725 wait complete. 2024-05-12T10:50:22.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 Processor -- start 2024-05-12T10:50:22.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 -- start start 2024-05-12T10:50:22.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52080041d0 0x7f52241f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52240cd9b0 0x7f52240cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52240cde30 0x7f52240cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f522415c6a0 con 0x7f52240cd9b0 2024-05-12T10:50:22.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52240cae10 con 0x7f52240cde30 2024-05-12T10:50:22.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f522a800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f52240c4d30 con 0x7f52080041d0 2024-05-12T10:50:22.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f521aa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52240cd9b0 0x7f52240cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f521aa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52240cd9b0 0x7f52240cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52638/0 (socket says 172.21.15.115:52638) 2024-05-12T10:50:22.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.369+0000 7f521aa00640 1 -- 172.21.15.115:0/1490492174 learned_addr learned my addr 172.21.15.115:0/1490492174 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:22.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f5223e00640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52240cde30 0x7f52240cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f5223400640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52080041d0 0x7f52241f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521aa00640 1 -- 172.21.15.115:0/1490492174 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52080041d0 msgr2=0x7f52241f06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521aa00640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52080041d0 0x7f52241f06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521aa00640 1 -- 172.21.15.115:0/1490492174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52240cde30 msgr2=0x7f52240cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521aa00640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52240cde30 0x7f52240cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521aa00640 1 -- 172.21.15.115:0/1490492174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52241f1320 con 0x7f52240cd9b0 2024-05-12T10:50:22.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f5223e00640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52240cde30 0x7f52240cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:22.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521aa00640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52240cd9b0 0x7f52240cb6f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f520c0ab040 tx=0x7f5208005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:22.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521be00640 1 -- 172.21.15.115:0/1490492174 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c0a5cf0 con 0x7f52240cd9b0 2024-05-12T10:50:22.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521be00640 1 -- 172.21.15.115:0/1490492174 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f520c0b3070 con 0x7f52240cd9b0 2024-05-12T10:50:22.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f522a800640 1 -- 172.21.15.115:0/1490492174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52241f1040 con 0x7f52240cd9b0 2024-05-12T10:50:22.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521be00640 1 -- 172.21.15.115:0/1490492174 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c004a30 con 0x7f52240cd9b0 2024-05-12T10:50:22.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f522a800640 1 -- 172.21.15.115:0/1490492174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52240cd1b0 con 0x7f52240cd9b0 2024-05-12T10:50:22.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f522a800640 1 -- 172.21.15.115:0/1490492174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5224069730 con 0x7f52240cd9b0 2024-05-12T10:50:22.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521be00640 1 -- 172.21.15.115:0/1490492174 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f520c004bd0 con 0x7f52240cd9b0 2024-05-12T10:50:22.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521be00640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f520006f400 0x7f52000718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.373+0000 7f521be00640 1 -- 172.21.15.115:0/1490492174 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f520c1292e0 con 0x7f52240cd9b0 2024-05-12T10:50:22.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.377+0000 7f5223400640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f520006f400 0x7f52000718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.377+0000 7f5223400640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f520006f400 0x7f52000718c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5214005630 tx=0x7f5214009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:22.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.377+0000 7f521be00640 1 -- 172.21.15.115:0/1490492174 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f520c0168f0 con 0x7f52240cd9b0 2024-05-12T10:50:22.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.577+0000 7f522a800640 1 -- 172.21.15.115:0/1490492174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5224068640 con 0x7f52240cd9b0 2024-05-12T10:50:22.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.577+0000 7f521be00640 1 -- 172.21.15.115:0/1490492174 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+179551 (secure 0 0 0) 0x7f520c0f5f10 con 0x7f52240cd9b0 2024-05-12T10:50:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:22.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 -- 172.21.15.115:0/1490492174 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f520006f400 msgr2=0x7f52000718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f520006f400 0x7f52000718c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5214005630 tx=0x7f5214009040 comp rx=0 tx=0).stop 2024-05-12T10:50:22.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 -- 172.21.15.115:0/1490492174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52240cd9b0 msgr2=0x7f52240cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52240cd9b0 0x7f52240cb6f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f520c0ab040 tx=0x7f5208005840 comp rx=0 tx=0).stop 2024-05-12T10:50:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 -- 172.21.15.115:0/1490492174 shutdown_connections 2024-05-12T10:50:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f520006f400 0x7f52000718c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52240cde30 0x7f52240cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52240cd9b0 0x7f52240cb6f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 --2- 172.21.15.115:0/1490492174 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52080041d0 0x7f52241f06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 -- 172.21.15.115:0/1490492174 >> 172.21.15.115:0/1490492174 conn(0x7f52240681c0 msgr2=0x7f52240c8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 -- 172.21.15.115:0/1490492174 shutdown_connections 2024-05-12T10:50:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.581+0000 7f522a800640 1 -- 172.21.15.115:0/1490492174 wait complete. 2024-05-12T10:50:22.597 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":1265716555},{"type":"v1","addr":"172.21.15.115:6833","nonce":1265716555}]},"active_addr":"172.21.15.115:6833/1265716555","active_change":"2024-05-12T10:49:35.736951+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":3917036887}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":3489747802}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":3678241697}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":936939998}]}]} 2024-05-12T10:50:22.603 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-12T10:50:22.603 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-12T10:50:22.603 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:50:22.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.745+0000 7fc44ee00640 1 Processor -- start 2024-05-12T10:50:22.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.745+0000 7fc44ee00640 1 -- start start 2024-05-12T10:50:22.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.745+0000 7fc44ee00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc4480ca660 0x7fc4480c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.745+0000 7fc44ee00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44815da10 con 0x7fc448153b80 2024-05-12T10:50:22.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.745+0000 7fc44ee00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44815dcf0 con 0x7fc448153f60 2024-05-12T10:50:22.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.745+0000 7fc44ee00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc4480b2160 con 0x7fc4480ca660 2024-05-12T10:50:22.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.745+0000 7fc44da00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc448153b80 0x7fc448071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53056/0 (socket says 172.21.15.115:53056) 2024-05-12T10:50:22.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.745+0000 7fc44da00640 1 -- 172.21.15.115:0/3014544995 learned_addr learned my addr 172.21.15.115:0/3014544995 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:22.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc44e400640 1 --2- 172.21.15.115:0/3014544995 >> v2:172.21.15.134:3300/0 conn(0x7fc4480ca660 0x7fc4480c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 887279037 0 0) 0x7fc44815da10 con 0x7fc448153b80 2024-05-12T10:50:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc430003530 con 0x7fc448153b80 2024-05-12T10:50:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4188424040 0 0) 0x7fc430003530 con 0x7fc448153b80 2024-05-12T10:50:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 >> v2:172.21.15.134:3300/0 conn(0x7fc4480ca660 msgr2=0x7fc4480c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 --2- 172.21.15.115:0/3014544995 >> v2:172.21.15.134:3300/0 conn(0x7fc4480ca660 0x7fc4480c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 >> v1:172.21.15.134:6789/0 conn(0x7fc448153f60 legacy=0x7fc448159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4480c4760 con 0x7fc448153b80 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fc43c001700 con 0x7fc448153b80 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 >> v1:172.21.15.115:6789/0 conn(0x7fc448153b80 legacy=0x7fc448071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 --2- 172.21.15.115:0/3014544995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc430003a10 0x7fc430003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 --2- 172.21.15.115:0/3014544995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc430004810 0x7fc430004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 --2- 172.21.15.115:0/3014544995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4300051d0 0x7fc43000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc4480b2160 con 0x7fc4300051d0 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc43000bff0 con 0x7fc430003a10 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc43000c1f0 con 0x7fc430004810 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc44e400640 1 --2- 172.21.15.115:0/3014544995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4300051d0 0x7fc43000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc44da00640 1 --2- 172.21.15.115:0/3014544995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc430003a10 0x7fc430003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc44d000640 1 --2- 172.21.15.115:0/3014544995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc430004810 0x7fc430004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc44e400640 1 -- 172.21.15.115:0/3014544995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc430004810 msgr2=0x7fc430004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:22.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc44e400640 1 --2- 172.21.15.115:0/3014544995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc430004810 0x7fc430004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc44e400640 1 -- 172.21.15.115:0/3014544995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc430003a10 msgr2=0x7fc430003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:22.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc44e400640 1 --2- 172.21.15.115:0/3014544995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc430003a10 0x7fc430003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.749+0000 7fc44e400640 1 -- 172.21.15.115:0/3014544995 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc430003530 con 0x7fc4300051d0 2024-05-12T10:50:22.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44e400640 1 -- 172.21.15.115:0/3014544995 reap_dead start 2024-05-12T10:50:22.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44e400640 1 --2- 172.21.15.115:0/3014544995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4300051d0 0x7fc43000b9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc440009f90 tx=0x7fc44001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8d61b059dfe71 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:22.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440009c10 con 0x7fc4300051d0 2024-05-12T10:50:22.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4400a5c90 con 0x7fc4300051d0 2024-05-12T10:50:22.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc447e00640 1 -- 172.21.15.115:0/3014544995 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440003be0 con 0x7fc4300051d0 2024-05-12T10:50:22.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 -- 172.21.15.115:0/3014544995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4300051d0 msgr2=0x7fc43000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 --2- 172.21.15.115:0/3014544995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4300051d0 0x7fc43000b9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc440009f90 tx=0x7fc44001cc80 comp rx=0 tx=0).stop 2024-05-12T10:50:22.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 -- 172.21.15.115:0/3014544995 shutdown_connections 2024-05-12T10:50:22.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 --2- 172.21.15.115:0/3014544995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4300051d0 0x7fc43000b9d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 -- 172.21.15.115:0/3014544995 >> 172.21.15.115:0/3014544995 conn(0x7fc448071780 msgr2=0x7fc448076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:22.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 -- 172.21.15.115:0/3014544995 shutdown_connections 2024-05-12T10:50:22.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 -- 172.21.15.115:0/3014544995 wait complete. 2024-05-12T10:50:22.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 Processor -- start 2024-05-12T10:50:22.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 -- start start 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4300051d0 0x7fc4481557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc448072060 0x7fc4481f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4481f4e50 0x7fc448157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc4480c62b0 con 0x7fc4481f4e50 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4480c4510 con 0x7fc4300051d0 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.753+0000 7fc44ee00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc4480c6430 con 0x7fc448072060 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44e400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4481f4e50 0x7fc448157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44e400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4481f4e50 0x7fc448157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52646/0 (socket says 172.21.15.115:52646) 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44e400640 1 -- 172.21.15.115:0/450845189 learned_addr learned my addr 172.21.15.115:0/450845189 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44da00640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4300051d0 0x7fc4481557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44d000640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc448072060 0x7fc4481f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44e400640 1 -- 172.21.15.115:0/450845189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc448072060 msgr2=0x7fc4481f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44e400640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc448072060 0x7fc4481f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44e400640 1 -- 172.21.15.115:0/450845189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4300051d0 msgr2=0x7fc4481557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44e400640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4300051d0 0x7fc4481557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44e400640 1 -- 172.21.15.115:0/450845189 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4481563c0 con 0x7fc4481f4e50 2024-05-12T10:50:22.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44d000640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc448072060 0x7fc4481f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:22.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44e400640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4481f4e50 0x7fc448157860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc44001cab0 tx=0x7fc440009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:22.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc445600640 1 -- 172.21.15.115:0/450845189 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440004230 con 0x7fc4481f4e50 2024-05-12T10:50:22.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc445600640 1 -- 172.21.15.115:0/450845189 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4400be070 con 0x7fc4481f4e50 2024-05-12T10:50:22.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44ee00640 1 -- 172.21.15.115:0/450845189 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4480b2700 con 0x7fc4481f4e50 2024-05-12T10:50:22.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc445600640 1 -- 172.21.15.115:0/450845189 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440004630 con 0x7fc4481f4e50 2024-05-12T10:50:22.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44ee00640 1 -- 172.21.15.115:0/450845189 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc448156630 con 0x7fc4481f4e50 2024-05-12T10:50:22.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc44ee00640 1 -- 172.21.15.115:0/450845189 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc448050750 con 0x7fc4481f4e50 2024-05-12T10:50:22.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.757+0000 7fc445600640 1 -- 172.21.15.115:0/450845189 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc4400b8470 con 0x7fc4481f4e50 2024-05-12T10:50:22.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.761+0000 7fc445600640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc42806f430 0x7fc4280718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:22.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.761+0000 7fc445600640 1 -- 172.21.15.115:0/450845189 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc44012bc50 con 0x7fc4481f4e50 2024-05-12T10:50:22.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.761+0000 7fc44da00640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc42806f430 0x7fc4280718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:22.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.761+0000 7fc44da00640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc42806f430 0x7fc4280718f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc43c000fe0 tx=0x7fc43c001e20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:22.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.761+0000 7fc445600640 1 -- 172.21.15.115:0/450845189 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc4400c8020 con 0x7fc4481f4e50 2024-05-12T10:50:22.917 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.921+0000 7fc44ee00640 1 -- 172.21.15.115:0/450845189 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc44815cd80 con 0x7fc4481f4e50 2024-05-12T10:50:22.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.921+0000 7fc445600640 1 -- 172.21.15.115:0/450845189 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7fc440016990 con 0x7fc4481f4e50 2024-05-12T10:50:22.918 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:22.919 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:01.648279+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:50:22.920 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 -- 172.21.15.115:0/450845189 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc42806f430 msgr2=0x7fc4280718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc42806f430 0x7fc4280718f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc43c000fe0 tx=0x7fc43c001e20 comp rx=0 tx=0).stop 2024-05-12T10:50:22.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 -- 172.21.15.115:0/450845189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4481f4e50 msgr2=0x7fc448157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:22.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4481f4e50 0x7fc448157860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc44001cab0 tx=0x7fc440009750 comp rx=0 tx=0).stop 2024-05-12T10:50:22.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 -- 172.21.15.115:0/450845189 shutdown_connections 2024-05-12T10:50:22.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc42806f430 0x7fc4280718f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4481f4e50 0x7fc448157860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc448072060 0x7fc4481f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 --2- 172.21.15.115:0/450845189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4300051d0 0x7fc4481557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:22.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 -- 172.21.15.115:0/450845189 >> 172.21.15.115:0/450845189 conn(0x7fc448071780 msgr2=0x7fc4480cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:22.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 -- 172.21.15.115:0/450845189 shutdown_connections 2024-05-12T10:50:22.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:22.925+0000 7fc44ee00640 1 -- 172.21.15.115:0/450845189 wait complete. 2024-05-12T10:50:22.939 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-12T10:50:22.940 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:50:23.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61d0a00640 1 Processor -- start 2024-05-12T10:50:23.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61d0a00640 1 -- start start 2024-05-12T10:50:23.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61d0a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61cc0c4890 0x7f61cc0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61d0a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f61cc0c9dc0 0x7f61cc0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61d0a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61cc076650 con 0x7f61cc153f50 2024-05-12T10:50:23.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61d0a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f61cc076930 con 0x7f61cc0c9dc0 2024-05-12T10:50:23.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61d0a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f61cc0c4400 con 0x7f61cc0c4890 2024-05-12T10:50:23.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61cb200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f61cc0c9dc0 0x7f61cc0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61ca800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f61cc153f50 0x7f61cc0ccc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53064/0 (socket says 172.21.15.115:53064) 2024-05-12T10:50:23.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61ca800640 1 -- 172.21.15.115:0/344545612 learned_addr learned my addr 172.21.15.115:0/344545612 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:23.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61c9e00640 1 --2- 172.21.15.115:0/344545612 >> v2:172.21.15.134:3300/0 conn(0x7f61cc0c4890 0x7f61cc0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61cb200640 1 -- 172.21.15.115:0/344545612 >> v2:172.21.15.134:3300/0 conn(0x7f61cc0c4890 msgr2=0x7f61cc0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61cb200640 1 --2- 172.21.15.115:0/344545612 >> v2:172.21.15.134:3300/0 conn(0x7f61cc0c4890 0x7f61cc0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61cb200640 1 -- 172.21.15.115:0/344545612 >> v1:172.21.15.115:6789/0 conn(0x7f61cc153f50 legacy=0x7f61cc0ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61cb200640 1 -- 172.21.15.115:0/344545612 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61cc0c8360 con 0x7f61cc0c9dc0 2024-05-12T10:50:23.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.081+0000 7f61c9400640 1 -- 172.21.15.115:0/344545612 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299822881 0 0) 0x7f61cc076650 con 0x7f61cc153f50 2024-05-12T10:50:23.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61cb200640 1 --2- 172.21.15.115:0/344545612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61cc0c9dc0 0x7f61cc0cb6c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f61cc06d300 tx=0x7f61c401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08d513c596f39df server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61c9400640 1 -- 172.21.15.115:0/344545612 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c40b2070 con 0x7f61cc0c9dc0 2024-05-12T10:50:23.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61c9400640 1 -- 172.21.15.115:0/344545612 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c40a5900 con 0x7f61cc0c9dc0 2024-05-12T10:50:23.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61c9400640 1 -- 172.21.15.115:0/344545612 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c40a5cd0 con 0x7f61cc0c9dc0 2024-05-12T10:50:23.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61d0a00640 1 -- 172.21.15.115:0/344545612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61cc0c9dc0 msgr2=0x7f61cc0cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61d0a00640 1 --2- 172.21.15.115:0/344545612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61cc0c9dc0 0x7f61cc0cb6c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f61cc06d300 tx=0x7f61c401c930 comp rx=0 tx=0).stop 2024-05-12T10:50:23.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61d0a00640 1 -- 172.21.15.115:0/344545612 shutdown_connections 2024-05-12T10:50:23.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61d0a00640 1 --2- 172.21.15.115:0/344545612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61cc0c9dc0 0x7f61cc0cb6c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61d0a00640 1 --2- 172.21.15.115:0/344545612 >> v2:172.21.15.134:3300/0 conn(0x7f61cc0c4890 0x7f61cc0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61d0a00640 1 -- 172.21.15.115:0/344545612 >> 172.21.15.115:0/344545612 conn(0x7f61cc0cd8c0 msgr2=0x7f61cc0cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61d0a00640 1 -- 172.21.15.115:0/344545612 shutdown_connections 2024-05-12T10:50:23.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61d0a00640 1 -- 172.21.15.115:0/344545612 wait complete. 2024-05-12T10:50:23.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61d0a00640 1 Processor -- start 2024-05-12T10:50:23.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.085+0000 7f61d0a00640 1 -- start start 2024-05-12T10:50:23.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61d0a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61cc0c4890 0x7f61cc152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61d0a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc0c9dc0 0x7f61cc149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61d0a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61cc153f50 0x7f61cc1f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61d0a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc166ba0 con 0x7f61cc0c4890 2024-05-12T10:50:23.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61d0a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc0ce780 con 0x7f61cc153f50 2024-05-12T10:50:23.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61d0a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f61cc166d20 con 0x7f61cc0c9dc0 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61ca800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61cc0c4890 0x7f61cc152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61ca800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61cc0c4890 0x7f61cc152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52664/0 (socket says 172.21.15.115:52664) 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61ca800640 1 -- 172.21.15.115:0/3457645574 learned_addr learned my addr 172.21.15.115:0/3457645574 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61cb200640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61cc153f50 0x7f61cc1f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61c9e00640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc0c9dc0 0x7f61cc149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61ca800640 1 -- 172.21.15.115:0/3457645574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc0c9dc0 msgr2=0x7f61cc149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61ca800640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc0c9dc0 0x7f61cc149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61ca800640 1 -- 172.21.15.115:0/3457645574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61cc153f50 msgr2=0x7f61cc1f52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61ca800640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61cc153f50 0x7f61cc1f52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61ca800640 1 -- 172.21.15.115:0/3457645574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61cc162620 con 0x7f61cc0c4890 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61cb200640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61cc153f50 0x7f61cc1f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:23.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61ca800640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61cc0c4890 0x7f61cc152120 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c490 tx=0x7f61bc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61c2a00640 1 -- 172.21.15.115:0/3457645574 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc018070 con 0x7f61cc0c4890 2024-05-12T10:50:23.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61c2a00640 1 -- 172.21.15.115:0/3457645574 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61bc007500 con 0x7f61cc0c4890 2024-05-12T10:50:23.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61c2a00640 1 -- 172.21.15.115:0/3457645574 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc004a30 con 0x7f61cc0c4890 2024-05-12T10:50:23.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61d0a00640 1 -- 172.21.15.115:0/3457645574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61cc1628e0 con 0x7f61cc0c4890 2024-05-12T10:50:23.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61d0a00640 1 -- 172.21.15.115:0/3457645574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61cc162ea0 con 0x7f61cc0c4890 2024-05-12T10:50:23.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61d0a00640 1 -- 172.21.15.115:0/3457645574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61cc050750 con 0x7f61cc0c4890 2024-05-12T10:50:23.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.089+0000 7f61c2a00640 1 -- 172.21.15.115:0/3457645574 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f61bc004bd0 con 0x7f61cc0c4890 2024-05-12T10:50:23.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.093+0000 7f61c2a00640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f61ac06f430 0x7f61ac0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.093+0000 7f61c2a00640 1 -- 172.21.15.115:0/3457645574 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f61bc08e780 con 0x7f61cc0c4890 2024-05-12T10:50:23.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.093+0000 7f61c9e00640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f61ac06f430 0x7f61ac0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.093+0000 7f61c9e00640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f61ac06f430 0x7f61ac0718f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61cc163840 tx=0x7f61b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.097+0000 7f61c2a00640 1 -- 172.21.15.115:0/3457645574 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f61bc05b450 con 0x7f61cc0c4890 2024-05-12T10:50:23.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.253+0000 7f61d0a00640 1 -- 172.21.15.115:0/3457645574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61cc0cdd30 con 0x7f61cc0c4890 2024-05-12T10:50:23.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.253+0000 7f61c2a00640 1 -- 172.21.15.115:0/3457645574 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f61bc05ad50 con 0x7f61cc0c4890 2024-05-12T10:50:23.251 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:23.251 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:01.648279+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:50:23.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 -- 172.21.15.115:0/3457645574 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f61ac06f430 msgr2=0x7f61ac0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f61ac06f430 0x7f61ac0718f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61cc163840 tx=0x7f61b8008040 comp rx=0 tx=0).stop 2024-05-12T10:50:23.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 -- 172.21.15.115:0/3457645574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61cc0c4890 msgr2=0x7f61cc152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61cc0c4890 0x7f61cc152120 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c490 tx=0x7f61bc00c950 comp rx=0 tx=0).stop 2024-05-12T10:50:23.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 -- 172.21.15.115:0/3457645574 shutdown_connections 2024-05-12T10:50:23.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f61ac06f430 0x7f61ac0718f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61cc153f50 0x7f61cc1f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc0c9dc0 0x7f61cc149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 --2- 172.21.15.115:0/3457645574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61cc0c4890 0x7f61cc152120 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 -- 172.21.15.115:0/3457645574 >> 172.21.15.115:0/3457645574 conn(0x7f61cc0cd8c0 msgr2=0x7f61cc158010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 -- 172.21.15.115:0/3457645574 shutdown_connections 2024-05-12T10:50:23.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.257+0000 7f61d0a00640 1 -- 172.21.15.115:0/3457645574 wait complete. 2024-05-12T10:50:23.273 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-12T10:50:23.273 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-12T10:50:23.274 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-12T10:50:23.274 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-12T10:50:23.275 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-12T10:50:23.275 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-12T10:50:23.276 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-12T10:50:23.276 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-12T10:50:23.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.517+0000 7faf04000640 1 Processor -- start 2024-05-12T10:50:23.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.517+0000 7f089fa00640 1 Processor -- start 2024-05-12T10:50:23.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.517+0000 7faf04000640 1 -- start start 2024-05-12T10:50:23.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.517+0000 7ff18ca00640 1 Processor -- start 2024-05-12T10:50:23.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.517+0000 7ff18ca00640 1 -- start start 2024-05-12T10:50:23.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.517+0000 7f089fa00640 1 -- start start 2024-05-12T10:50:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7ff18ca00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 0x7ff18004ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7ff18ca00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff1800d5de0 0x7ff180008070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7ff18ca00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff180008a00 con 0x7ff1800085b0 2024-05-12T10:50:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7ff18ca00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7ff1800dbb00 con 0x7ff1800d5de0 2024-05-12T10:50:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7ff18ca00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff1800dbd30 con 0x7ff18004ca70 2024-05-12T10:50:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf04000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faefc153e90 0x7faefc159a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf04000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faefc0cbba0 0x7faefc164350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089fa00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f089815a180 0x7f08981634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089fa00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0898071210 0x7f0898071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089fa00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08981643d0 con 0x7f0898074140 2024-05-12T10:50:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089fa00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f0898160ed0 con 0x7f0898071210 2024-05-12T10:50:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089fa00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0898163b30 con 0x7f089815a180 2024-05-12T10:50:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089da00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0898071210 0x7f0898071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089da00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0898071210 0x7f0898071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52666/0 (socket says 172.21.15.115:52666) 2024-05-12T10:50:23.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089da00640 1 -- 172.21.15.115:0/3507395361 learned_addr learned my addr 172.21.15.115:0/3507395361 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf04000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faefc0cb3e0 con 0x7faefc071a30 2024-05-12T10:50:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf04000640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7faefc0caa40 con 0x7faefc153e90 2024-05-12T10:50:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf04000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7faefc0c6570 con 0x7faefc0cbba0 2024-05-12T10:50:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf02000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faefc0cbba0 0x7faefc164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf02000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faefc0cbba0 0x7faefc164350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41412/0 (socket says 172.21.15.115:41412) 2024-05-12T10:50:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf02000640 1 -- 172.21.15.115:0/1664163169 learned_addr learned my addr 172.21.15.115:0/1664163169 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7ff187e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff1800085b0 0x7ff18004e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:56106/0 (socket says 172.21.15.115:56106) 2024-05-12T10:50:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7ff187e00640 1 -- 172.21.15.115:0/105560439 learned_addr learned my addr 172.21.15.115:0/105560439 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7ff187400640 1 --2- 172.21.15.115:0/105560439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 0x7ff18004ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089d000640 1 --2- 172.21.15.115:0/3507395361 >> v2:172.21.15.134:3300/0 conn(0x7f089815a180 0x7f08981634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089da00640 1 -- 172.21.15.115:0/3507395361 >> v2:172.21.15.134:3300/0 conn(0x7f089815a180 msgr2=0x7f08981634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089da00640 1 --2- 172.21.15.115:0/3507395361 >> v2:172.21.15.134:3300/0 conn(0x7f089815a180 0x7f08981634a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089da00640 1 -- 172.21.15.115:0/3507395361 >> v1:172.21.15.134:6789/0 conn(0x7f0898074140 legacy=0x7f08981607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7f089da00640 1 -- 172.21.15.115:0/3507395361 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0898163e10 con 0x7f0898071210 2024-05-12T10:50:23.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf02000640 1 -- 172.21.15.115:0/1664163169 >> v2:172.21.15.115:3300/0 conn(0x7faefc153e90 msgr2=0x7faefc159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf02000640 1 --2- 172.21.15.115:0/1664163169 >> v2:172.21.15.115:3300/0 conn(0x7faefc153e90 0x7faefc159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf02000640 1 -- 172.21.15.115:0/1664163169 >> v1:172.21.15.134:6789/0 conn(0x7faefc071a30 legacy=0x7faefc0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7faf02000640 1 -- 172.21.15.115:0/1664163169 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc0ca170 con 0x7faefc0cbba0 2024-05-12T10:50:23.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7ff186000640 1 -- 172.21.15.115:0/105560439 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406380003 0 0) 0x7ff180008a00 con 0x7ff1800085b0 2024-05-12T10:50:23.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.521+0000 7ff186000640 1 -- 172.21.15.115:0/105560439 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff170003530 con 0x7ff1800085b0 2024-05-12T10:50:23.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.525+0000 7ff187400640 1 -- 172.21.15.115:0/105560439 >> v2:172.21.15.115:3300/0 conn(0x7ff1800d5de0 msgr2=0x7ff180008070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.525+0000 7ff187400640 1 --2- 172.21.15.115:0/105560439 >> v2:172.21.15.115:3300/0 conn(0x7ff1800d5de0 0x7ff180008070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.525+0000 7ff186000640 1 -- 172.21.15.115:0/105560439 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1996883241 0 0) 0x7ff170003530 con 0x7ff1800085b0 2024-05-12T10:50:23.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.525+0000 7ff187400640 1 -- 172.21.15.115:0/105560439 >> v1:172.21.15.134:6789/0 conn(0x7ff1800085b0 legacy=0x7ff18004e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.525+0000 7ff187400640 1 -- 172.21.15.115:0/105560439 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1800dbff0 con 0x7ff18004ca70 2024-05-12T10:50:23.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.525+0000 7fbc98800640 1 Processor -- start 2024-05-12T10:50:23.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.525+0000 7f089da00640 1 --2- 172.21.15.115:0/3507395361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0898071210 0x7f0898071640 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0898071fd0 tx=0x7f089001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e054cdce3dfbc84 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.525+0000 7fbc98800640 1 -- start start 2024-05-12T10:50:23.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faf02000640 1 --2- 172.21.15.115:0/1664163169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc0cbba0 0x7faefc164350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faefc0c69a0 tx=0x7faee801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c316ed2d2025d57 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f0897400640 1 -- 172.21.15.115:0/3507395361 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08900b4070 con 0x7f0898071210 2024-05-12T10:50:23.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f0897400640 1 -- 172.21.15.115:0/3507395361 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08900af400 con 0x7f0898071210 2024-05-12T10:50:23.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f0897400640 1 -- 172.21.15.115:0/3507395361 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08900af7d0 con 0x7f0898071210 2024-05-12T10:50:23.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faefbe00640 1 -- 172.21.15.115:0/1664163169 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee80b1070 con 0x7faefc0cbba0 2024-05-12T10:50:23.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7ff187400640 1 --2- 172.21.15.115:0/105560439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 0x7ff18004ce50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097c0 tx=0x7ff17c020e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3411b8589e754bca server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faefbe00640 1 -- 172.21.15.115:0/1664163169 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee80ac630 con 0x7faefc0cbba0 2024-05-12T10:50:23.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc98800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbc90072420 0x7fbc90073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f089fa00640 1 -- 172.21.15.115:0/3507395361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0898071210 msgr2=0x7f0898071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f089fa00640 1 --2- 172.21.15.115:0/3507395361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0898071210 0x7f0898071640 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0898071fd0 tx=0x7f089001f1e0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faefbe00640 1 -- 172.21.15.115:0/1664163169 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee80a8050 con 0x7faefc0cbba0 2024-05-12T10:50:23.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc98800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc90158030 0x7fbc90074490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f089fa00640 1 -- 172.21.15.115:0/3507395361 shutdown_connections 2024-05-12T10:50:23.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f089fa00640 1 --2- 172.21.15.115:0/3507395361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0898071210 0x7f0898071640 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f089fa00640 1 --2- 172.21.15.115:0/3507395361 >> v2:172.21.15.134:3300/0 conn(0x7f089815a180 0x7f08981634a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f089fa00640 1 -- 172.21.15.115:0/3507395361 >> 172.21.15.115:0/3507395361 conn(0x7f08980ce910 msgr2=0x7f08980ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc98800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc900cae20 con 0x7fbc90152450 2024-05-12T10:50:23.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc98800640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fbc90158590 con 0x7fbc90158030 2024-05-12T10:50:23.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc98800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fbc90158870 con 0x7fbc90072420 2024-05-12T10:50:23.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7ff186000640 1 -- 172.21.15.115:0/105560439 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0b7070 con 0x7ff18004ca70 2024-05-12T10:50:23.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7ff186000640 1 -- 172.21.15.115:0/105560439 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17c0aa7e0 con 0x7ff18004ca70 2024-05-12T10:50:23.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7ff186000640 1 -- 172.21.15.115:0/105560439 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff188076b20 con 0x7ff18004ca70 2024-05-12T10:50:23.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f089fa00640 1 -- 172.21.15.115:0/3507395361 shutdown_connections 2024-05-12T10:50:23.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f089fa00640 1 -- 172.21.15.115:0/3507395361 wait complete. 2024-05-12T10:50:23.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc96800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc90158030 0x7fbc90074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc95e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbc90152450 0x7fbc9006fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:56120/0 (socket says 172.21.15.115:56120) 2024-05-12T10:50:23.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc95e00640 1 -- 172.21.15.115:0/3827003415 learned_addr learned my addr 172.21.15.115:0/3827003415 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:23.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faf04000640 1 -- 172.21.15.115:0/1664163169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc0cbba0 msgr2=0x7faefc164350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faf04000640 1 --2- 172.21.15.115:0/1664163169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc0cbba0 0x7faefc164350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faefc0c69a0 tx=0x7faee801c520 comp rx=0 tx=0).stop 2024-05-12T10:50:23.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc95400640 1 --2- 172.21.15.115:0/3827003415 >> v2:172.21.15.134:3300/0 conn(0x7fbc90072420 0x7fbc90073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faf04000640 1 -- 172.21.15.115:0/1664163169 shutdown_connections 2024-05-12T10:50:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faf04000640 1 --2- 172.21.15.115:0/1664163169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc0cbba0 0x7faefc164350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faf04000640 1 --2- 172.21.15.115:0/1664163169 >> v2:172.21.15.115:3300/0 conn(0x7faefc153e90 0x7faefc159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faf04000640 1 -- 172.21.15.115:0/1664163169 >> 172.21.15.115:0/1664163169 conn(0x7faefc072050 msgr2=0x7faefc072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faf04000640 1 -- 172.21.15.115:0/1664163169 shutdown_connections 2024-05-12T10:50:23.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7f349dc00640 1 Processor -- start 2024-05-12T10:50:23.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7faf04000640 1 -- 172.21.15.115:0/1664163169 wait complete. 2024-05-12T10:50:23.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747298670 0 0) 0x7fbc900cae20 con 0x7fbc90152450 2024-05-12T10:50:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc78003530 con 0x7fbc90152450 2024-05-12T10:50:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.529+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1178217159 0 0) 0x7fbc78003530 con 0x7fbc90152450 2024-05-12T10:50:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 >> v2:172.21.15.134:3300/0 conn(0x7fbc90072420 msgr2=0x7fbc90073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 --2- 172.21.15.115:0/3827003415 >> v2:172.21.15.134:3300/0 conn(0x7fbc90072420 0x7fbc90073f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 >> v2:172.21.15.115:3300/0 conn(0x7fbc90158030 msgr2=0x7fbc90074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 --2- 172.21.15.115:0/3827003415 >> v2:172.21.15.115:3300/0 conn(0x7fbc90158030 0x7fbc90074490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc90158b50 con 0x7fbc90152450 2024-05-12T10:50:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7ff18ca00640 1 -- 172.21.15.115:0/105560439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 msgr2=0x7ff18004ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7ff18ca00640 1 --2- 172.21.15.115:0/105560439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 0x7ff18004ce50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097c0 tx=0x7ff17c020e40 comp rx=0 tx=0).stop 2024-05-12T10:50:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fbc8c001a80 con 0x7fbc90152450 2024-05-12T10:50:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 >> v1:172.21.15.134:6789/0 conn(0x7fbc90152450 legacy=0x7fbc9006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc78003ab0 0x7fbc78003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc78004810 0x7fbc78004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f349dc00640 1 -- start start 2024-05-12T10:50:23.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f089fa00640 1 Processor -- start 2024-05-12T10:50:23.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7ff18ca00640 1 -- 172.21.15.115:0/105560439 shutdown_connections 2024-05-12T10:50:23.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7ff18ca00640 1 --2- 172.21.15.115:0/105560439 >> v2:172.21.15.115:3300/0 conn(0x7ff1800d5de0 0x7ff180008070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7ff18ca00640 1 --2- 172.21.15.115:0/105560439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 0x7ff18004ce50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7ff18ca00640 1 -- 172.21.15.115:0/105560439 >> 172.21.15.115:0/105560439 conn(0x7ff18000d190 msgr2=0x7ff18000d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc95e00640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc78003ab0 0x7fbc78003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f089fa00640 1 -- start start 2024-05-12T10:50:23.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc780051d0 0x7fbc7800ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbc90158590 con 0x7fbc78003ab0 2024-05-12T10:50:23.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbc90158870 con 0x7fbc780051d0 2024-05-12T10:50:23.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbc78010520 con 0x7fbc78004810 2024-05-12T10:50:23.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc96800640 1 --2- 172.21.15.115:0/3827003415 >> v2:172.21.15.115:3300/0 conn(0x7fbc90158030 0x7fbc90074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:23.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7faf04000640 1 Processor -- start 2024-05-12T10:50:23.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc95400640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc78004810 0x7fbc78004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc95e00640 1 -- 172.21.15.115:0/3827003415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc78004810 msgr2=0x7fbc78004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7faf04000640 1 -- start start 2024-05-12T10:50:23.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc96800640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc780051d0 0x7fbc7800ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc95e00640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc78004810 0x7fbc78004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc95e00640 1 -- 172.21.15.115:0/3827003415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc780051d0 msgr2=0x7fbc7800ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc95e00640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc780051d0 0x7fbc7800ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc95e00640 1 -- 172.21.15.115:0/3827003415 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc78003530 con 0x7fbc78003ab0 2024-05-12T10:50:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc95400640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc78004810 0x7fbc78004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc96800640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc780051d0 0x7fbc7800ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7fbc96800640 1 -- 172.21.15.115:0/3827003415 reap_dead start 2024-05-12T10:50:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f1b57600640 1 Processor -- start 2024-05-12T10:50:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f1b57600640 1 -- start start 2024-05-12T10:50:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f089fa00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0898071210 0x7f0898152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f089fa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0898074140 0x7f089815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f089d000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0898071210 0x7f0898152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f089d000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0898071210 0x7f0898152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41436/0 (socket says 172.21.15.115:41436) 2024-05-12T10:50:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f089d000640 1 -- 172.21.15.115:0/1174574584 learned_addr learned my addr 172.21.15.115:0/1174574584 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f089fa00640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f089815a180 0x7f089815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f349dc00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f34980b5f30 0x7f34980d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f08981602a0 con 0x7f0898074140 2024-05-12T10:50:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f089815ffc0 con 0x7f0898071210 2024-05-12T10:50:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0898074560 con 0x7f089815a180 2024-05-12T10:50:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7f349dc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34980d1ac0 0x7f34980cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7ff18ca00640 1 -- 172.21.15.115:0/105560439 shutdown_connections 2024-05-12T10:50:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.533+0000 7ff18ca00640 1 -- 172.21.15.115:0/105560439 wait complete. 2024-05-12T10:50:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff18ca00640 1 Processor -- start 2024-05-12T10:50:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f089da00640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f089815a180 0x7f089815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf04000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faefc071a30 0x7faefc14ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f349dc00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f349815be70 con 0x7f34980cc7e0 2024-05-12T10:50:23.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff18ca00640 1 -- start start 2024-05-12T10:50:23.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f349dc00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f34980d1f00 con 0x7f34980b5f30 2024-05-12T10:50:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f349dc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f34980b6310 con 0x7f34980d1ac0 2024-05-12T10:50:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f089d000640 1 -- 172.21.15.115:0/1174574584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f089815a180 msgr2=0x7f089815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f089d000640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f089815a180 0x7f089815f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f089d000640 1 -- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0898074140 msgr2=0x7f089815ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f089d000640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0898074140 0x7f089815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b57600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1b5015a560 0x7f1b50072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f089d000640 1 -- 172.21.15.115:0/1174574584 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089815fce0 con 0x7f0898071210 2024-05-12T10:50:23.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf04000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc0cbba0 0x7faefc155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b57600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b500c9ac0 0x7f1b500c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b57600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b50160de0 con 0x7f1b500c9230 2024-05-12T10:50:23.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b57600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1b50163570 con 0x7f1b5015a560 2024-05-12T10:50:23.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b57600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1b501640f0 con 0x7f1b500c9ac0 2024-05-12T10:50:23.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf04000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faefc153e90 0x7faefc1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf04000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faefc167230 con 0x7faefc153e90 2024-05-12T10:50:23.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf04000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faefc1670b0 con 0x7faefc0cbba0 2024-05-12T10:50:23.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf04000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7faefc1673b0 con 0x7faefc071a30 2024-05-12T10:50:23.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf01600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faefc071a30 0x7faefc14ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf01600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faefc071a30 0x7faefc14ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60148/0 (socket says 172.21.15.115:60148) 2024-05-12T10:50:23.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf01600640 1 -- 172.21.15.115:0/4168908529 learned_addr learned my addr 172.21.15.115:0/4168908529 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f089d000640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0898071210 0x7f0898152e60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f088400c7f0 tx=0x7f088400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f3497400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f34980cc7e0 0x7f349815c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53070/0 (socket says 172.21.15.115:53070) 2024-05-12T10:50:23.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf02000640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faefc153e90 0x7faefc1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f3496000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34980d1ac0 0x7f34980cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f3497400640 1 -- 172.21.15.115:0/847531320 learned_addr learned my addr 172.21.15.115:0/847531320 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:23.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b54c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1b5015a560 0x7f1b50072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b4fe00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1b500c9230 0x7f1b500c81b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:56130/0 (socket says 172.21.15.115:56130) 2024-05-12T10:50:23.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b4fe00640 1 -- 172.21.15.115:0/3556970572 learned_addr learned my addr 172.21.15.115:0/3556970572 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:23.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf00c00640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc0cbba0 0x7faefc155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf01600640 1 -- 172.21.15.115:0/4168908529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc0cbba0 msgr2=0x7faefc155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf01600640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc0cbba0 0x7faefc155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf01600640 1 -- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faefc153e90 msgr2=0x7faefc1565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf01600640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faefc153e90 0x7faefc1565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f0894c00640 1 -- 172.21.15.115:0/1174574584 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884015070 con 0x7f0898071210 2024-05-12T10:50:23.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f3496a00640 1 --2- 172.21.15.115:0/847531320 >> v2:172.21.15.115:3300/0 conn(0x7f34980b5f30 0x7f34980d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f3496000640 1 -- 172.21.15.115:0/847531320 >> v2:172.21.15.115:3300/0 conn(0x7f34980b5f30 msgr2=0x7f34980d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff18ca00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1800085b0 0x7ff1801823f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f3496000640 1 --2- 172.21.15.115:0/847531320 >> v2:172.21.15.115:3300/0 conn(0x7f34980b5f30 0x7f34980d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f3496000640 1 -- 172.21.15.115:0/847531320 >> v1:172.21.15.115:6789/0 conn(0x7f34980cc7e0 legacy=0x7f349815c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf01600640 1 -- 172.21.15.115:0/4168908529 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc14d360 con 0x7faefc071a30 2024-05-12T10:50:23.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0898153940 con 0x7f0898071210 2024-05-12T10:50:23.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08981f93b0 con 0x7f0898071210 2024-05-12T10:50:23.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b55600640 1 --2- 172.21.15.115:0/3556970572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b500c9ac0 0x7f1b500c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff18ca00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 0x7ff1800d6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f0894c00640 1 -- 172.21.15.115:0/1174574584 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0884007820 con 0x7f0898071210 2024-05-12T10:50:23.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f0894c00640 1 -- 172.21.15.115:0/1174574584 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884015070 con 0x7f0898071210 2024-05-12T10:50:23.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff187400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1800085b0 0x7ff1801823f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f3496000640 1 -- 172.21.15.115:0/847531320 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349815f580 con 0x7f34980d1ac0 2024-05-12T10:50:23.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7faf01600640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faefc071a30 0x7faefc14ce20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faef000b440 tx=0x7faef000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff186a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 0x7ff1800d6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff186a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 0x7ff1800d6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60166/0 (socket says 172.21.15.115:60166) 2024-05-12T10:50:23.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff18ca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1800d5de0 0x7ff1800485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff186a00640 1 -- 172.21.15.115:0/2121740095 learned_addr learned my addr 172.21.15.115:0/2121740095 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff1800dc890 con 0x7ff1800d5de0 2024-05-12T10:50:23.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff1800dc5b0 con 0x7ff1800085b0 2024-05-12T10:50:23.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff18004d770 con 0x7ff18004ca70 2024-05-12T10:50:23.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b55600640 1 -- 172.21.15.115:0/3556970572 >> v2:172.21.15.134:3300/0 conn(0x7f1b5015a560 msgr2=0x7f1b50072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b55600640 1 --2- 172.21.15.115:0/3556970572 >> v2:172.21.15.134:3300/0 conn(0x7f1b5015a560 0x7f1b50072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b55600640 1 -- 172.21.15.115:0/3556970572 >> v1:172.21.15.134:6789/0 conn(0x7f1b500c9230 legacy=0x7f1b500c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.537+0000 7f1b55600640 1 -- 172.21.15.115:0/3556970572 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b501637c0 con 0x7f1b500c9ac0 2024-05-12T10:50:23.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c4200640 1 Processor -- start 2024-05-12T10:50:23.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c4200640 1 -- start start 2024-05-12T10:50:23.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7faef9600640 1 -- 172.21.15.115:0/4168908529 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0015020 con 0x7faefc071a30 2024-05-12T10:50:23.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7faef9600640 1 -- 172.21.15.115:0/4168908529 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef00118b0 con 0x7faefc071a30 2024-05-12T10:50:23.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7faef9600640 1 -- 172.21.15.115:0/4168908529 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0011ca0 con 0x7faefc071a30 2024-05-12T10:50:23.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0870001040 con 0x7f0898071210 2024-05-12T10:50:23.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7faf04000640 1 -- 172.21.15.115:0/4168908529 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faefc1f7ab0 con 0x7faefc071a30 2024-05-12T10:50:23.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7fbc95e00640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc78003ab0 0x7fbc78003ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00a720 tx=0x7fbc8c01d0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8a632cbac2cd17 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff187e00640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1800d5de0 0x7ff1800485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff186a00640 1 -- 172.21.15.115:0/2121740095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1800085b0 msgr2=0x7ff1801823f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff186a00640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1800085b0 0x7ff1801823f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff186a00640 1 -- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1800d5de0 msgr2=0x7ff1800485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff186a00640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1800d5de0 0x7ff1800485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7faf04000640 1 -- 172.21.15.115:0/4168908529 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faefc154640 con 0x7faefc071a30 2024-05-12T10:50:23.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff186a00640 1 -- 172.21.15.115:0/2121740095 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff180181c30 con 0x7ff18004ca70 2024-05-12T10:50:23.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff186a00640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 0x7ff1800d6e80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff17400b410 tx=0x7ff17400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c4200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff6bc0b70f0 0x7ff6bc0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c4200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff6bc0cc6a0 0x7ff6bc06cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c4200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6bc0cdbe0 con 0x7ff6bc155ec0 2024-05-12T10:50:23.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c4200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7ff6bc06c810 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c4200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff6bc15be60 con 0x7ff6bc0cc6a0 2024-05-12T10:50:23.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c0e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff6bc0b70f0 0x7ff6bc0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c0e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff6bc0b70f0 0x7ff6bc0cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52752/0 (socket says 172.21.15.115:52752) 2024-05-12T10:50:23.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c0e00640 1 -- 172.21.15.115:0/1534593595 learned_addr learned my addr 172.21.15.115:0/1534593595 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c2200640 1 --2- 172.21.15.115:0/1534593595 >> v2:172.21.15.134:3300/0 conn(0x7ff6bc0cc6a0 0x7ff6bc06cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c0b2070 con 0x7fbc78003ab0 2024-05-12T10:50:23.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc8c0a5d20 con 0x7fbc78003ab0 2024-05-12T10:50:23.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7fbc94a00640 1 -- 172.21.15.115:0/3827003415 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c00a370 con 0x7fbc78003ab0 2024-05-12T10:50:23.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff17b400640 1 -- 172.21.15.115:0/2121740095 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174015020 con 0x7ff18004ca70 2024-05-12T10:50:23.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff17b400640 1 -- 172.21.15.115:0/2121740095 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff174011830 con 0x7ff18004ca70 2024-05-12T10:50:23.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1800d8bb0 con 0x7ff18004ca70 2024-05-12T10:50:23.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c0e00640 1 -- 172.21.15.115:0/1534593595 >> v2:172.21.15.134:3300/0 conn(0x7ff6bc0cc6a0 msgr2=0x7ff6bc06cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c0e00640 1 --2- 172.21.15.115:0/1534593595 >> v2:172.21.15.134:3300/0 conn(0x7ff6bc0cc6a0 0x7ff6bc06cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1800d85f0 con 0x7ff18004ca70 2024-05-12T10:50:23.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff17b400640 1 -- 172.21.15.115:0/2121740095 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174011c20 con 0x7ff18004ca70 2024-05-12T10:50:23.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7faf04000640 1 -- 172.21.15.115:0/4168908529 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faed8001040 con 0x7faefc071a30 2024-05-12T10:50:23.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7fbc98800640 1 -- 172.21.15.115:0/3827003415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc78003ab0 msgr2=0x7fbc78003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7fbc98800640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc78003ab0 0x7fbc78003ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00a720 tx=0x7fbc8c01d0a0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7ff6c0e00640 1 -- 172.21.15.115:0/1534593595 >> v1:172.21.15.115:6789/0 conn(0x7ff6bc155ec0 legacy=0x7ff6bc0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.541+0000 7f0894c00640 1 -- 172.21.15.115:0/1174574584 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0884018070 con 0x7f0898071210 2024-05-12T10:50:23.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7fbc98800640 1 -- 172.21.15.115:0/3827003415 shutdown_connections 2024-05-12T10:50:23.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7fbc98800640 1 --2- 172.21.15.115:0/3827003415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc78003ab0 0x7fbc78003ed0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7fbc98800640 1 -- 172.21.15.115:0/3827003415 >> 172.21.15.115:0/3827003415 conn(0x7fbc90076830 msgr2=0x7fbc900681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7ff6bbe00640 1 -- 172.21.15.115:0/1534593595 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2114764955 0 0) 0x7ff6bc0cdbe0 con 0x7ff6bc155ec0 2024-05-12T10:50:23.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7fbc98800640 1 -- 172.21.15.115:0/3827003415 shutdown_connections 2024-05-12T10:50:23.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7fbc98800640 1 -- 172.21.15.115:0/3827003415 wait complete. 2024-05-12T10:50:23.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f4432400640 1 Processor -- start 2024-05-12T10:50:23.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f4432400640 1 -- start start 2024-05-12T10:50:23.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7ff6c0e00640 1 -- 172.21.15.115:0/1534593595 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc15c140 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f1b55600640 1 --2- 172.21.15.115:0/3556970572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b500c9ac0 0x7f1b500c9f50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0097c0 tx=0x7f1b3c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdf5d516351fffe server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1800057f0 con 0x7ff18004ca70 2024-05-12T10:50:23.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f1b4f400640 1 -- 172.21.15.115:0/3556970572 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0b5070 con 0x7f1b500c9ac0 2024-05-12T10:50:23.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7fbc98800640 1 Processor -- start 2024-05-12T10:50:23.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f3496000640 1 --2- 172.21.15.115:0/847531320 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34980d1ac0 0x7f34980cc2a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3490009d90 tx=0x7f349001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6279a164b4f8a93 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f3495600640 1 -- 172.21.15.115:0/847531320 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34900b2070 con 0x7f34980d1ac0 2024-05-12T10:50:23.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f3495600640 1 -- 172.21.15.115:0/847531320 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34900a5830 con 0x7f34980d1ac0 2024-05-12T10:50:23.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f3495600640 1 -- 172.21.15.115:0/847531320 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34900a5c00 con 0x7f34980d1ac0 2024-05-12T10:50:23.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f1b4f400640 1 -- 172.21.15.115:0/3556970572 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c0a8990 con 0x7f1b500c9ac0 2024-05-12T10:50:23.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f1b4f400640 1 -- 172.21.15.115:0/3556970572 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0a8d60 con 0x7f1b500c9ac0 2024-05-12T10:50:23.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f1b57600640 1 -- 172.21.15.115:0/3556970572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b500c9ac0 msgr2=0x7f1b500c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f1b57600640 1 --2- 172.21.15.115:0/3556970572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b500c9ac0 0x7f1b500c9f50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0097c0 tx=0x7f1b3c01ec90 comp rx=0 tx=0).stop 2024-05-12T10:50:23.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7fbc98800640 1 -- start start 2024-05-12T10:50:23.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7ff17b400640 1 -- 172.21.15.115:0/2121740095 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff174018020 con 0x7ff18004ca70 2024-05-12T10:50:23.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f0894c00640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f087806f600 0x7f0878071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f0894c00640 1 -- 172.21.15.115:0/1174574584 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f088408f340 con 0x7f0898071210 2024-05-12T10:50:23.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f0894c00640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] conn(0x7f0878078d80 0x7f087807b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f0894c00640 1 -- 172.21.15.115:0/1174574584 --> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f087807b890 con 0x7f0878078d80 2024-05-12T10:50:23.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f0894c00640 1 -- 172.21.15.115:0/1174574584 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f088408f730 con 0x7f0898071210 2024-05-12T10:50:23.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f0897e00640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f087806f600 0x7f0878071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f089da00640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] conn(0x7f0878078d80 0x7f087807b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f0897e00640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f087806f600 0x7f0878071ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08980cd530 tx=0x7f08880079c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f349dc00640 1 -- 172.21.15.115:0/847531320 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34980d1ac0 msgr2=0x7f34980cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f349dc00640 1 --2- 172.21.15.115:0/847531320 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34980d1ac0 0x7f34980cc2a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3490009d90 tx=0x7f349001c970 comp rx=0 tx=0).stop 2024-05-12T10:50:23.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f349dc00640 1 -- 172.21.15.115:0/847531320 shutdown_connections 2024-05-12T10:50:23.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f349dc00640 1 --2- 172.21.15.115:0/847531320 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34980d1ac0 0x7f34980cc2a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f349dc00640 1 --2- 172.21.15.115:0/847531320 >> v2:172.21.15.115:3300/0 conn(0x7f34980b5f30 0x7f34980d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f349dc00640 1 -- 172.21.15.115:0/847531320 >> 172.21.15.115:0/847531320 conn(0x7f34980734f0 msgr2=0x7f34980738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f349dc00640 1 -- 172.21.15.115:0/847531320 shutdown_connections 2024-05-12T10:50:23.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f4432400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f442c155b10 0x7f442c0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f4432400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442c15c920 con 0x7f442c15fbd0 2024-05-12T10:50:23.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f4432400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442c15c360 con 0x7f442c15b9d0 2024-05-12T10:50:23.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f4432400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f442c0c6800 con 0x7f442c155b10 2024-05-12T10:50:23.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f4431000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f442c155b10 0x7f442c0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f442be00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f442c15fbd0 0x7f442c0cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53074/0 (socket says 172.21.15.115:53074) 2024-05-12T10:50:23.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f442be00640 1 -- 172.21.15.115:0/1551119308 learned_addr learned my addr 172.21.15.115:0/1551119308 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:23.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f442b400640 1 -- 172.21.15.115:0/1551119308 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 143463590 0 0) 0x7f442c15c360 con 0x7f442c15b9d0 2024-05-12T10:50:23.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f1b57600640 1 -- 172.21.15.115:0/3556970572 shutdown_connections 2024-05-12T10:50:23.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f1b57600640 1 --2- 172.21.15.115:0/3556970572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b500c9ac0 0x7f1b500c9f50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f1b57600640 1 --2- 172.21.15.115:0/3556970572 >> v2:172.21.15.134:3300/0 conn(0x7f1b5015a560 0x7f1b50072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7f1b57600640 1 -- 172.21.15.115:0/3556970572 >> 172.21.15.115:0/3556970572 conn(0x7f1b50076830 msgr2=0x7f1b500681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f1b57600640 1 -- 172.21.15.115:0/3556970572 shutdown_connections 2024-05-12T10:50:23.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f349dc00640 1 -- 172.21.15.115:0/847531320 wait complete. 2024-05-12T10:50:23.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.545+0000 7faef9600640 1 -- 172.21.15.115:0/4168908529 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faef0018020 con 0x7faefc071a30 2024-05-12T10:50:23.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc98800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc78003ab0 0x7fbc9015ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc98800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc9015b5a0 0x7fbc9014c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc98800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc901e54a0 0x7fbc901591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc98800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9006ff90 con 0x7fbc78003ab0 2024-05-12T10:50:23.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc98800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9006fe10 con 0x7fbc901e54a0 2024-05-12T10:50:23.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc98800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbc90070110 con 0x7fbc9015b5a0 2024-05-12T10:50:23.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7ff17b400640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff16806f4d0 0x7ff168071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7ff17b400640 1 -- 172.21.15.115:0/2121740095 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff17408f4b0 con 0x7ff18004ca70 2024-05-12T10:50:23.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7faef9600640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7faedc06f430 0x7faedc0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7faef9600640 1 -- 172.21.15.115:0/4168908529 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faef008fd70 con 0x7faefc071a30 2024-05-12T10:50:23.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7faef9600640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] conn(0x7faedc078b30 0x7faedc07af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7faef9600640 1 -- 172.21.15.115:0/4168908529 --> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faedc07b640 con 0x7faedc078b30 2024-05-12T10:50:23.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc96800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc901e54a0 0x7fbc901591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc96800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc901e54a0 0x7fbc901591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41492/0 (socket says 172.21.15.115:41492) 2024-05-12T10:50:23.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc96800640 1 -- 172.21.15.115:0/1651562960 learned_addr learned my addr 172.21.15.115:0/1651562960 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7faef9600640 1 -- 172.21.15.115:0/4168908529 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faef0090200 con 0x7faefc071a30 2024-05-12T10:50:23.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7faf00c00640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7faedc06f430 0x7faedc0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7ff6c0e00640 1 --2- 172.21.15.115:0/1534593595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc0b70f0 0x7ff6bc0cc160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc06dda0 tx=0x7ff6a801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2d2d346132b95f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7faf02000640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] conn(0x7faedc078b30 0x7faedc07af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f4431000640 1 -- 172.21.15.115:0/1551119308 >> v1:172.21.15.134:6789/0 conn(0x7f442c15b9d0 legacy=0x7f442c072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f4431000640 1 -- 172.21.15.115:0/1551119308 >> v1:172.21.15.115:6789/0 conn(0x7f442c15fbd0 legacy=0x7f442c0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f4431000640 1 -- 172.21.15.115:0/1551119308 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c15c640 con 0x7f442c155b10 2024-05-12T10:50:23.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7ff6bbe00640 1 -- 172.21.15.115:0/1534593595 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80b5070 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7ff6bbe00640 1 -- 172.21.15.115:0/1534593595 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a80a8a10 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7ff6bbe00640 1 -- 172.21.15.115:0/1534593595 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80a8de0 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc96800640 1 -- 172.21.15.115:0/1651562960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc9015b5a0 msgr2=0x7fbc9014c8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:50:23.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc96800640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc9015b5a0 0x7fbc9014c8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc96800640 1 -- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc78003ab0 msgr2=0x7fbc9015ae10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:50:23.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc96800640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc78003ab0 0x7fbc9015ae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc96800640 1 -- 172.21.15.115:0/1651562960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc900c4590 con 0x7fbc901e54a0 2024-05-12T10:50:23.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f089da00640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] conn(0x7f0878078d80 0x7f087807b1c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc96800640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc901e54a0 0x7fbc901591f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc90158410 tx=0x7fbc80010c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f0894c00640 1 -- 172.21.15.115:0/1174574584 <== osd.1 v2:172.21.15.115:6800/2401741239 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f087807b890 con 0x7f0878078d80 2024-05-12T10:50:23.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7faf00c00640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7faedc06f430 0x7faedc0718f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faefc14faf0 tx=0x7faef4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc8a000640 1 -- 172.21.15.115:0/1651562960 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000f040 con 0x7fbc901e54a0 2024-05-12T10:50:23.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc8a000640 1 -- 172.21.15.115:0/1651562960 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc8001b070 con 0x7fbc901e54a0 2024-05-12T10:50:23.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc8a000640 1 -- 172.21.15.115:0/1651562960 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80004430 con 0x7fbc901e54a0 2024-05-12T10:50:23.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7fbc98800640 1 -- 172.21.15.115:0/1651562960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9015bf20 con 0x7fbc901e54a0 2024-05-12T10:50:23.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7ff6c4200640 1 -- 172.21.15.115:0/1534593595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc0b70f0 msgr2=0x7ff6bc0cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7ff6c4200640 1 --2- 172.21.15.115:0/1534593595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc0b70f0 0x7ff6bc0cc160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc06dda0 tx=0x7ff6a801ed10 comp rx=0 tx=0).stop 2024-05-12T10:50:23.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7fbc98800640 1 -- 172.21.15.115:0/1651562960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc901e49c0 con 0x7fbc901e54a0 2024-05-12T10:50:23.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7f1b57600640 1 -- 172.21.15.115:0/3556970572 wait complete. 2024-05-12T10:50:23.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f1b57600640 1 Processor -- start 2024-05-12T10:50:23.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff6c4200640 1 -- 172.21.15.115:0/1534593595 shutdown_connections 2024-05-12T10:50:23.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff6c4200640 1 --2- 172.21.15.115:0/1534593595 >> v2:172.21.15.134:3300/0 conn(0x7ff6bc0cc6a0 0x7ff6bc06cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff6c4200640 1 --2- 172.21.15.115:0/1534593595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc0b70f0 0x7ff6bc0cc160 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff6c4200640 1 -- 172.21.15.115:0/1534593595 >> 172.21.15.115:0/1534593595 conn(0x7ff6bc073b70 msgr2=0x7ff6bc073f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff6c4200640 1 -- 172.21.15.115:0/1534593595 shutdown_connections 2024-05-12T10:50:23.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f349dc00640 1 Processor -- start 2024-05-12T10:50:23.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff6c4200640 1 -- 172.21.15.115:0/1534593595 wait complete. 2024-05-12T10:50:23.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f349dc00640 1 -- start start 2024-05-12T10:50:23.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7ff17b400640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] conn(0x7ff168078bc0 0x7ff16807b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7fbc98800640 1 -- 172.21.15.115:0/1651562960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc90069730 con 0x7fbc901e54a0 2024-05-12T10:50:23.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.549+0000 7ff187400640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff16806f4d0 0x7ff168071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff187e00640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] conn(0x7ff168078bc0 0x7ff16807b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7faf02000640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] conn(0x7faedc078b30 0x7faedc07af70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff187400640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff16806f4d0 0x7ff168071990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0b4000 tx=0x7ff17c0ac070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff17b400640 1 -- 172.21.15.115:0/2121740095 --> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff17400de50 con 0x7ff168078bc0 2024-05-12T10:50:23.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff17b400640 1 -- 172.21.15.115:0/2121740095 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff174096050 con 0x7ff18004ca70 2024-05-12T10:50:23.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff187e00640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] conn(0x7ff168078bc0 0x7ff16807b000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f4431000640 1 --2- 172.21.15.115:0/1551119308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f442c155b10 0x7f442c0c62c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f44200097f0 tx=0x7f442001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbbb7a0c33a98177 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f349dc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34980b5f30 0x7f349815ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f349dc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34980cc7e0 0x7f34980c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f442b400640 1 -- 172.21.15.115:0/1551119308 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44200b0070 con 0x7f442c155b10 2024-05-12T10:50:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f442b400640 1 -- 172.21.15.115:0/1551119308 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44200ab600 con 0x7f442c155b10 2024-05-12T10:50:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f442b400640 1 -- 172.21.15.115:0/1551119308 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44200ab9d0 con 0x7f442c155b10 2024-05-12T10:50:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f3496a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34980b5f30 0x7f349815ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f3496a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34980b5f30 0x7f349815ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41506/0 (socket says 172.21.15.115:41506) 2024-05-12T10:50:23.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7fbc8a000640 1 -- 172.21.15.115:0/1651562960 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbc80003620 con 0x7fbc901e54a0 2024-05-12T10:50:23.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f349dc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34980d1ac0 0x7f34981488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f1b57600640 1 -- start start 2024-05-12T10:50:23.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f349dc00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f34980ccbe0 con 0x7f34980cc7e0 2024-05-12T10:50:23.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7ff17b400640 1 -- 172.21.15.115:0/2121740095 <== osd.0 v2:172.21.15.115:6816/199636976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff17400de50 con 0x7ff168078bc0 2024-05-12T10:50:23.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f349dc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3498160100 con 0x7f34980b5f30 2024-05-12T10:50:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f3496a00640 1 -- 172.21.15.115:0/3308214233 learned_addr learned my addr 172.21.15.115:0/3308214233 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f349dc00640 1 -- 172.21.15.115:0/3308214233 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f34980b4000 con 0x7f34980d1ac0 2024-05-12T10:50:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7faef9600640 1 -- 172.21.15.115:0/4168908529 <== osd.2 v2:172.21.15.115:6817/332404290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faedc07b640 con 0x7faedc078b30 2024-05-12T10:50:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f3497400640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34980d1ac0 0x7f34981488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f4432400640 1 -- 172.21.15.115:0/1551119308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f442c155b10 msgr2=0x7f442c0c62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.553+0000 7f4432400640 1 --2- 172.21.15.115:0/1551119308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f442c155b10 0x7f442c0c62c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f44200097f0 tx=0x7f442001c470 comp rx=0 tx=0).stop 2024-05-12T10:50:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c4200640 1 Processor -- start 2024-05-12T10:50:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c4200640 1 -- start start 2024-05-12T10:50:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f4432400640 1 -- 172.21.15.115:0/1551119308 shutdown_connections 2024-05-12T10:50:23.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7fbc8a000640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbc7406f430 0x7fbc740718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7fbc8a000640 1 -- 172.21.15.115:0/1651562960 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbc8008fe10 con 0x7fbc901e54a0 2024-05-12T10:50:23.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f3496000640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34980cc7e0 0x7f34980c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b57600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b500c9230 0x7f1b5015f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f3496a00640 1 -- 172.21.15.115:0/3308214233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34980d1ac0 msgr2=0x7f34981488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f3496a00640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34980d1ac0 0x7f34981488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f3496a00640 1 -- 172.21.15.115:0/3308214233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34980cc7e0 msgr2=0x7f34980c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f3496a00640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34980cc7e0 0x7f34980c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b57600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500c9ac0 0x7f1b502026c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b57600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b5015a560 0x7f1b50154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b57600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1b50160a80 con 0x7f1b500c9ac0 2024-05-12T10:50:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b57600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1b50163d80 con 0x7f1b5015a560 2024-05-12T10:50:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b57600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1b500c7840 con 0x7f1b500c9230 2024-05-12T10:50:23.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f3496a00640 1 -- 172.21.15.115:0/3308214233 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349815dec0 con 0x7f34980b5f30 2024-05-12T10:50:23.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7fbc8a000640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] conn(0x7fbc74078ba0 0x7fbc7407afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7fbc8a000640 1 -- 172.21.15.115:0/1651562960 --> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc80023e80 con 0x7fbc74078ba0 2024-05-12T10:50:23.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7fbc95e00640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbc7406f430 0x7fbc740718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7fbc8a000640 1 -- 172.21.15.115:0/1651562960 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbc80090200 con 0x7fbc901e54a0 2024-05-12T10:50:23.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f3496000640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34980cc7e0 0x7f34980c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:23.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b55600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b5015a560 0x7f1b50154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b55600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b5015a560 0x7f1b50154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41508/0 (socket says 172.21.15.115:41508) 2024-05-12T10:50:23.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b55600640 1 -- 172.21.15.115:0/58084648 learned_addr learned my addr 172.21.15.115:0/58084648 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7fbc95400640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] conn(0x7fbc74078ba0 0x7fbc7407afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c4200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6bc0b70f0 0x7ff6bc1f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b55600640 1 -- 172.21.15.115:0/58084648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b500c9230 msgr2=0x7f1b5015f410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:50:23.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b55600640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b500c9230 0x7f1b5015f410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b55600640 1 -- 172.21.15.115:0/58084648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500c9ac0 msgr2=0x7f1b502026c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:50:23.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b55600640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500c9ac0 0x7f1b502026c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b55600640 1 -- 172.21.15.115:0/58084648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b501fe950 con 0x7f1b5015a560 2024-05-12T10:50:23.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f3496a00640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34980b5f30 0x7f349815ed90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f348400c820 tx=0x7f348400cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c4200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc0cc6a0 0x7ff6bc159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c4200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc155ec0 0x7ff6bc15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c4200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc15c9e0 con 0x7ff6bc155ec0 2024-05-12T10:50:23.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c4200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc15c700 con 0x7ff6bc0cc6a0 2024-05-12T10:50:23.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c4200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff6bc1562a0 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f4432400640 1 --2- 172.21.15.115:0/1551119308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f442c155b10 0x7f442c0c62c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f4432400640 1 -- 172.21.15.115:0/1551119308 >> 172.21.15.115:0/1551119308 conn(0x7f442c0d1380 msgr2=0x7f442c0d1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7fbc95400640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] conn(0x7fbc74078ba0 0x7fbc7407afe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c1800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6bc0b70f0 0x7ff6bc1f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b55600640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b5015a560 0x7f1b50154730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0097c0 tx=0x7f1b3c01ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c1800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6bc0b70f0 0x7ff6bc1f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60192/0 (socket says 172.21.15.115:60192) 2024-05-12T10:50:23.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c1800640 1 -- 172.21.15.115:0/3267596875 learned_addr learned my addr 172.21.15.115:0/3267596875 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c2200640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc155ec0 0x7ff6bc15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7ff6c0e00640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc0cc6a0 0x7ff6bc159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f348ea00640 1 -- 172.21.15.115:0/3308214233 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484015070 con 0x7f34980b5f30 2024-05-12T10:50:23.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f4432400640 1 -- 172.21.15.115:0/1551119308 shutdown_connections 2024-05-12T10:50:23.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f4432400640 1 -- 172.21.15.115:0/1551119308 wait complete. 2024-05-12T10:50:23.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b4cc00640 1 -- 172.21.15.115:0/58084648 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0bf070 con 0x7f1b5015a560 2024-05-12T10:50:23.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b4cc00640 1 -- 172.21.15.115:0/58084648 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c0b0640 con 0x7f1b5015a560 2024-05-12T10:50:23.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b4cc00640 1 -- 172.21.15.115:0/58084648 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0b5040 con 0x7f1b5015a560 2024-05-12T10:50:23.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b57600640 1 -- 172.21.15.115:0/58084648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5015fb30 con 0x7f1b5015a560 2024-05-12T10:50:23.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f348ea00640 1 -- 172.21.15.115:0/3308214233 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3484007a30 con 0x7f34980b5f30 2024-05-12T10:50:23.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f348ea00640 1 -- 172.21.15.115:0/3308214233 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484007e20 con 0x7f34980b5f30 2024-05-12T10:50:23.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.557+0000 7f1b57600640 1 -- 172.21.15.115:0/58084648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b501febf0 con 0x7f1b5015a560 2024-05-12T10:50:23.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6c1800640 1 -- 172.21.15.115:0/3267596875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc0cc6a0 msgr2=0x7ff6bc159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6c1800640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc0cc6a0 0x7ff6bc159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6c1800640 1 -- 172.21.15.115:0/3267596875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc155ec0 msgr2=0x7ff6bc15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6c1800640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc155ec0 0x7ff6bc15ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6c1800640 1 -- 172.21.15.115:0/3267596875 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc1f5030 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7f349dc00640 1 -- 172.21.15.115:0/3308214233 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34980d13b0 con 0x7f34980b5f30 2024-05-12T10:50:23.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7f349dc00640 1 -- 172.21.15.115:0/3308214233 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34980d1650 con 0x7f34980b5f30 2024-05-12T10:50:23.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6c1800640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6bc0b70f0 0x7ff6bc1f2540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000c3c0 tx=0x7ff6b000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7f3483e00640 1 -- 172.21.15.115:0/3308214233 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f346c001040 con 0x7f34980b5f30 2024-05-12T10:50:23.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6b9600640 1 -- 172.21.15.115:0/3267596875 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0017070 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6b9600640 1 -- 172.21.15.115:0/3267596875 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b00052f0 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6b9600640 1 -- 172.21.15.115:0/3267596875 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0003840 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6c4200640 1 -- 172.21.15.115:0/3267596875 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6bc1e2110 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6c4200640 1 -- 172.21.15.115:0/3267596875 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6bc1f55b0 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7f4432400640 1 Processor -- start 2024-05-12T10:50:23.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7f4432400640 1 -- start start 2024-05-12T10:50:23.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7f1b57600640 1 -- 172.21.15.115:0/58084648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b50154c70 con 0x7f1b5015a560 2024-05-12T10:50:23.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7ff6c4200640 1 -- 172.21.15.115:0/3267596875 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6bc069730 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f1b4cc00640 1 -- 172.21.15.115:0/58084648 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1b3c0b09f0 con 0x7f1b5015a560 2024-05-12T10:50:23.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.561+0000 7fbc8a000640 1 -- 172.21.15.115:0/1651562960 <== osd.3 v2:172.21.15.115:6802/1329544943 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc80023e80 con 0x7fbc74078ba0 2024-05-12T10:50:23.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7fbc95e00640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbc7406f430 0x7fbc740718f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c005ce0 tx=0x7fbc8c001c20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f348ea00640 1 -- 172.21.15.115:0/3308214233 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3484018070 con 0x7f34980b5f30 2024-05-12T10:50:23.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4432400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f442c155b10 0x7f442c15e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4432400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c15b9d0 0x7f442c0d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f1b4cc00640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f1b3006f400 0x7f1b300718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4432400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c15fbd0 0x7f442c15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4432400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f442c156070 con 0x7f442c15b9d0 2024-05-12T10:50:23.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4432400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f442c155ef0 con 0x7f442c15fbd0 2024-05-12T10:50:23.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4432400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f442c169b80 con 0x7f442c155b10 2024-05-12T10:50:23.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f1b4cc00640 1 -- 172.21.15.115:0/58084648 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1b3c12be80 con 0x7f1b5015a560 2024-05-12T10:50:23.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f1b54c00640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f1b3006f400 0x7f1b300718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f348ea00640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f347806f4d0 0x7f3478071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4431000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f442c155b10 0x7f442c15e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4431a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c15fbd0 0x7f442c15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4431a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c15fbd0 0x7f442c15d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41522/0 (socket says 172.21.15.115:41522) 2024-05-12T10:50:23.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4431a00640 1 -- 172.21.15.115:0/2089644045 learned_addr learned my addr 172.21.15.115:0/2089644045 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f442be00640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c15b9d0 0x7f442c0d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4431a00640 1 -- 172.21.15.115:0/2089644045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f442c155b10 msgr2=0x7f442c15e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f1b4cc00640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] conn(0x7f1b30078af0 0x7f1b3007af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f1b4cc00640 1 -- 172.21.15.115:0/58084648 --> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b3c0abec0 con 0x7f1b30078af0 2024-05-12T10:50:23.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f1b4cc00640 1 -- 172.21.15.115:0/58084648 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1b3c12e4a0 con 0x7f1b5015a560 2024-05-12T10:50:23.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f1b4fe00640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] conn(0x7f1b30078af0 0x7f1b3007af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7ff6b9600640 1 -- 172.21.15.115:0/3267596875 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff6b001a070 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f348ea00640 1 -- 172.21.15.115:0/3308214233 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f348408f830 con 0x7f34980b5f30 2024-05-12T10:50:23.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f3496000640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f347806f4d0 0x7f3478071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4431a00640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f442c155b10 0x7f442c15e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4431a00640 1 -- 172.21.15.115:0/2089644045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c15b9d0 msgr2=0x7f442c0d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4431a00640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c15b9d0 0x7f442c0d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.565+0000 7f4431a00640 1 -- 172.21.15.115:0/2089644045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c148fd0 con 0x7f442c15fbd0 2024-05-12T10:50:23.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f442be00640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f442c15b9d0 0x7f442c0d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:23.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f1b4fe00640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] conn(0x7f1b30078af0 0x7f1b3007af30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7ff6b9600640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff69c06f400 0x7ff69c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f4431000640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f442c155b10 0x7f442c15e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:23.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f4431a00640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c15fbd0 0x7f442c15d210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f442400c700 tx=0x7f442400cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7ff6b9600640 1 -- 172.21.15.115:0/3267596875 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff6b008f0d0 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7ff6b9600640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] conn(0x7ff69c078af0 0x7ff69c07af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f348ea00640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] conn(0x7f3478078c40 0x7f347807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f348ea00640 1 -- 172.21.15.115:0/3308214233 --> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f348400bfa0 con 0x7f3478078c40 2024-05-12T10:50:23.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f348ea00640 1 -- 172.21.15.115:0/3308214233 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f348408fc20 con 0x7f34980b5f30 2024-05-12T10:50:23.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f4428c00640 1 -- 172.21.15.115:0/2089644045 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424017070 con 0x7f442c15fbd0 2024-05-12T10:50:23.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f4428c00640 1 -- 172.21.15.115:0/2089644045 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4424003db0 con 0x7f442c15fbd0 2024-05-12T10:50:23.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f4428c00640 1 -- 172.21.15.115:0/2089644045 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424005270 con 0x7f442c15fbd0 2024-05-12T10:50:23.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7ff6b9600640 1 -- 172.21.15.115:0/3267596875 --> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6b001dec0 con 0x7ff69c078af0 2024-05-12T10:50:23.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7ff6b9600640 1 -- 172.21.15.115:0/3267596875 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff6b008f480 con 0x7ff6bc0b70f0 2024-05-12T10:50:23.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f3496000640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f347806f4d0 0x7f3478071990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f34900af000 tx=0x7f34900a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f4432400640 1 -- 172.21.15.115:0/2089644045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c0cff10 con 0x7f442c15fbd0 2024-05-12T10:50:23.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f4432400640 1 -- 172.21.15.115:0/2089644045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c1550e0 con 0x7f442c15fbd0 2024-05-12T10:50:23.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f1b54c00640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f1b3006f400 0x7f1b300718c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009fa0 tx=0x7f1b4800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7ff6c0e00640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff69c06f400 0x7ff69c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7ff6c2200640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] conn(0x7ff69c078af0 0x7ff69c07af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f3497400640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] conn(0x7f3478078c40 0x7f347807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f4432400640 1 -- 172.21.15.115:0/2089644045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f442c069e40 con 0x7f442c15fbd0 2024-05-12T10:50:23.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f1b4cc00640 1 -- 172.21.15.115:0/58084648 <== osd.6 v2:172.21.15.134:6824/1206319910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b3c0abec0 con 0x7f1b30078af0 2024-05-12T10:50:23.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7f3497400640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] conn(0x7f3478078c40 0x7f347807b080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7ff6c0e00640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff69c06f400 0x7ff69c0718c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80b2000 tx=0x7ff6a80aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.569+0000 7ff6c2200640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] conn(0x7ff69c078af0 0x7ff69c07af30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.573+0000 7f348ea00640 1 -- 172.21.15.115:0/3308214233 <== osd.4 v2:172.21.15.134:6800/3949181256 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f348400bfa0 con 0x7f3478078c40 2024-05-12T10:50:23.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.573+0000 7f4428c00640 1 -- 172.21.15.115:0/2089644045 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f442401a070 con 0x7f442c15fbd0 2024-05-12T10:50:23.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.573+0000 7f4428c00640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f440c06f430 0x7f440c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.573+0000 7f4428c00640 1 -- 172.21.15.115:0/2089644045 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f442408f180 con 0x7f442c15fbd0 2024-05-12T10:50:23.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.573+0000 7f4428c00640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] conn(0x7f440c078ba0 0x7f440c07afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.573+0000 7f4428c00640 1 -- 172.21.15.115:0/2089644045 --> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4424022e50 con 0x7f440c078ba0 2024-05-12T10:50:23.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.573+0000 7f4428c00640 1 -- 172.21.15.115:0/2089644045 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f442408f570 con 0x7f442c15fbd0 2024-05-12T10:50:23.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.577+0000 7ff6b9600640 1 -- 172.21.15.115:0/3267596875 <== osd.7 v2:172.21.15.134:6816/3958491632 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6b001dec0 con 0x7ff69c078af0 2024-05-12T10:50:23.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.577+0000 7f4431000640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f440c06f430 0x7f440c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.577+0000 7f442be00640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] conn(0x7f440c078ba0 0x7f440c07afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.577+0000 7f4431000640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f440c06f430 0x7f440c0718f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f442c06d450 tx=0x7f44200a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.577+0000 7f442be00640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] conn(0x7f440c078ba0 0x7f440c07afe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.581+0000 7f4428c00640 1 -- 172.21.15.115:0/2089644045 <== osd.5 v2:172.21.15.134:6808/2656330194 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4424022e50 con 0x7f440c078ba0 2024-05-12T10:50:23.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 --> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0870002de0 con 0x7f0878078d80 2024-05-12T10:50:23.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7faf04000640 1 -- 172.21.15.115:0/4168908529 --> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faed8002de0 con 0x7faedc078b30 2024-05-12T10:50:23.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7faef9600640 1 -- 172.21.15.115:0/4168908529 <== osd.2 v2:172.21.15.115:6817/332404290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faed8002de0 con 0x7faedc078b30 2024-05-12T10:50:23.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7f0894c00640 1 -- 172.21.15.115:0/1174574584 <== osd.1 v2:172.21.15.115:6800/2401741239 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0870002de0 con 0x7f0878078d80 2024-05-12T10:50:23.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] conn(0x7f0878078d80 msgr2=0x7f087807b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7f089fa00640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] conn(0x7f0878078d80 0x7f087807b1c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7faeeea00640 1 -- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] conn(0x7faedc078b30 msgr2=0x7faedc07af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7faeeea00640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] conn(0x7faedc078b30 0x7faedc07af70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 --> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff18004dab0 con 0x7ff168078bc0 2024-05-12T10:50:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f087806f600 msgr2=0x7f0878071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7f089fa00640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f087806f600 0x7f0878071ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08980cd530 tx=0x7f08880079c0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0898071210 msgr2=0x7f0898152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7f089fa00640 1 --2- 172.21.15.115:0/1174574584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0898071210 0x7f0898152e60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f088400c7f0 tx=0x7f088400ccb0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7f089da00640 1 -- 172.21.15.115:0/1174574584 reap_dead start 2024-05-12T10:50:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7faeeea00640 1 -- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7faedc06f430 msgr2=0x7faedc0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7faeeea00640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7faedc06f430 0x7faedc0718f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faefc14faf0 tx=0x7faef4009040 comp rx=0 tx=0).stop 2024-05-12T10:50:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7faeeea00640 1 -- 172.21.15.115:0/4168908529 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faefc071a30 msgr2=0x7faefc14ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.585+0000 7faeeea00640 1 --2- 172.21.15.115:0/4168908529 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faefc071a30 0x7faefc14ce20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faef000b440 tx=0x7faef000b900 comp rx=0 tx=0).stop 2024-05-12T10:50:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7faf02000640 1 -- 172.21.15.115:0/4168908529 reap_dead start 2024-05-12T10:50:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7faeeea00640 1 -- 172.21.15.115:0/4168908529 shutdown_connections 2024-05-12T10:50:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7faeeea00640 1 -- 172.21.15.115:0/4168908529 >> 172.21.15.115:0/4168908529 conn(0x7faefc072050 msgr2=0x7faefc070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 shutdown_connections 2024-05-12T10:50:23.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 >> 172.21.15.115:0/1174574584 conn(0x7f08980ce910 msgr2=0x7f08980759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 shutdown_connections 2024-05-12T10:50:23.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7f089fa00640 1 -- 172.21.15.115:0/1174574584 wait complete. 2024-05-12T10:50:23.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7faeeea00640 1 -- 172.21.15.115:0/4168908529 shutdown_connections 2024-05-12T10:50:23.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7faeeea00640 1 -- 172.21.15.115:0/4168908529 wait complete. 2024-05-12T10:50:23.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7ff17b400640 1 -- 172.21.15.115:0/2121740095 <== osd.0 v2:172.21.15.115:6816/199636976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff18004dab0 con 0x7ff168078bc0 2024-05-12T10:50:23.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7fbc98800640 1 -- 172.21.15.115:0/1651562960 --> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbc90151c80 con 0x7fbc74078ba0 2024-05-12T10:50:23.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] conn(0x7ff168078bc0 msgr2=0x7ff16807b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7ff18ca00640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] conn(0x7ff168078bc0 0x7ff16807b000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff16806f4d0 msgr2=0x7ff168071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7ff18ca00640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff16806f4d0 0x7ff168071990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0b4000 tx=0x7ff17c0ac070 comp rx=0 tx=0).stop 2024-05-12T10:50:23.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 msgr2=0x7ff1800d6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7ff18ca00640 1 --2- 172.21.15.115:0/2121740095 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff18004ca70 0x7ff1800d6e80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff17400b410 tx=0x7ff17400b8d0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.589+0000 7ff187e00640 1 -- 172.21.15.115:0/2121740095 reap_dead start 2024-05-12T10:50:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.593+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 shutdown_connections 2024-05-12T10:50:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.593+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 >> 172.21.15.115:0/2121740095 conn(0x7ff18000d190 msgr2=0x7ff18000d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.593+0000 7fbc8a000640 1 -- 172.21.15.115:0/1651562960 <== osd.3 v2:172.21.15.115:6802/1329544943 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbc90151c80 con 0x7fbc74078ba0 2024-05-12T10:50:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.593+0000 7fbc98800640 1 -- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] conn(0x7fbc74078ba0 msgr2=0x7fbc7407afe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.593+0000 7fbc98800640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] conn(0x7fbc74078ba0 0x7fbc7407afe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.593+0000 7fbc98800640 1 -- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbc7406f430 msgr2=0x7fbc740718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.593+0000 7fbc98800640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbc7406f430 0x7fbc740718f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c005ce0 tx=0x7fbc8c001c20 comp rx=0 tx=0).stop 2024-05-12T10:50:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.593+0000 7fbc98800640 1 -- 172.21.15.115:0/1651562960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc901e54a0 msgr2=0x7fbc901591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.593+0000 7fbc98800640 1 --2- 172.21.15.115:0/1651562960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc901e54a0 0x7fbc901591f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc90158410 tx=0x7fbc80010c20 comp rx=0 tx=0).stop 2024-05-12T10:50:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.593+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 shutdown_connections 2024-05-12T10:50:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.593+0000 7ff18ca00640 1 -- 172.21.15.115:0/2121740095 wait complete. 2024-05-12T10:50:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.597+0000 7fbc96800640 1 -- 172.21.15.115:0/1651562960 reap_dead start 2024-05-12T10:50:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.597+0000 7fbc98800640 1 -- 172.21.15.115:0/1651562960 shutdown_connections 2024-05-12T10:50:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.597+0000 7fbc98800640 1 -- 172.21.15.115:0/1651562960 >> 172.21.15.115:0/1651562960 conn(0x7fbc90076830 msgr2=0x7fbc9014ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.597+0000 7fbc98800640 1 -- 172.21.15.115:0/1651562960 shutdown_connections 2024-05-12T10:50:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.597+0000 7f1b57600640 1 -- 172.21.15.115:0/58084648 --> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1b501fe740 con 0x7f1b30078af0 2024-05-12T10:50:23.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.597+0000 7fbc98800640 1 -- 172.21.15.115:0/1651562960 wait complete. 2024-05-12T10:50:23.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.597+0000 7f1b4cc00640 1 -- 172.21.15.115:0/58084648 <== osd.6 v2:172.21.15.134:6824/1206319910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1b501fe740 con 0x7f1b30078af0 2024-05-12T10:50:23.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f1b57600640 1 -- 172.21.15.115:0/58084648 >> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] conn(0x7f1b30078af0 msgr2=0x7f1b3007af30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f1b57600640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] conn(0x7f1b30078af0 0x7f1b3007af30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f1b57600640 1 -- 172.21.15.115:0/58084648 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f1b3006f400 msgr2=0x7f1b300718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f1b57600640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f1b3006f400 0x7f1b300718c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009fa0 tx=0x7f1b4800b040 comp rx=0 tx=0).stop 2024-05-12T10:50:23.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f1b57600640 1 -- 172.21.15.115:0/58084648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b5015a560 msgr2=0x7f1b50154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f1b57600640 1 --2- 172.21.15.115:0/58084648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b5015a560 0x7f1b50154730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0097c0 tx=0x7f1b3c01ba50 comp rx=0 tx=0).stop 2024-05-12T10:50:23.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f1b55600640 1 -- 172.21.15.115:0/58084648 reap_dead start 2024-05-12T10:50:23.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f1b57600640 1 -- 172.21.15.115:0/58084648 shutdown_connections 2024-05-12T10:50:23.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f1b57600640 1 -- 172.21.15.115:0/58084648 >> 172.21.15.115:0/58084648 conn(0x7f1b50076830 msgr2=0x7f1b50073030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f3483e00640 1 -- 172.21.15.115:0/3308214233 --> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f346c002de0 con 0x7f3478078c40 2024-05-12T10:50:23.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f1b57600640 1 -- 172.21.15.115:0/58084648 shutdown_connections 2024-05-12T10:50:23.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.601+0000 7f1b57600640 1 -- 172.21.15.115:0/58084648 wait complete. 2024-05-12T10:50:23.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f348ea00640 1 -- 172.21.15.115:0/3308214233 <== osd.4 v2:172.21.15.134:6800/3949181256 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f346c002de0 con 0x7f3478078c40 2024-05-12T10:50:23.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f3483e00640 1 -- 172.21.15.115:0/3308214233 >> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] conn(0x7f3478078c40 msgr2=0x7f347807b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f3483e00640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] conn(0x7f3478078c40 0x7f347807b080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f3483e00640 1 -- 172.21.15.115:0/3308214233 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f347806f4d0 msgr2=0x7f3478071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f3483e00640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f347806f4d0 0x7f3478071990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f34900af000 tx=0x7f34900a7070 comp rx=0 tx=0).stop 2024-05-12T10:50:23.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f3483e00640 1 -- 172.21.15.115:0/3308214233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34980b5f30 msgr2=0x7f349815ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f3483e00640 1 --2- 172.21.15.115:0/3308214233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34980b5f30 0x7f349815ed90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f348400c820 tx=0x7f348400cce0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f3497400640 1 -- 172.21.15.115:0/3308214233 reap_dead start 2024-05-12T10:50:23.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f3483e00640 1 -- 172.21.15.115:0/3308214233 shutdown_connections 2024-05-12T10:50:23.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f3483e00640 1 -- 172.21.15.115:0/3308214233 >> 172.21.15.115:0/3308214233 conn(0x7f34980734f0 msgr2=0x7f34980cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7ff6c4200640 1 -- 172.21.15.115:0/3267596875 --> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff6bc06cdf0 con 0x7ff69c078af0 2024-05-12T10:50:23.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f3483e00640 1 -- 172.21.15.115:0/3308214233 shutdown_connections 2024-05-12T10:50:23.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f3483e00640 1 -- 172.21.15.115:0/3308214233 wait complete. 2024-05-12T10:50:23.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f4432400640 1 -- 172.21.15.115:0/2089644045 --> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f442c0cccb0 con 0x7f440c078ba0 2024-05-12T10:50:23.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f4428c00640 1 -- 172.21.15.115:0/2089644045 <== osd.5 v2:172.21.15.134:6808/2656330194 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f442c0cccb0 con 0x7f440c078ba0 2024-05-12T10:50:23.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7ff6b9600640 1 -- 172.21.15.115:0/3267596875 <== osd.7 v2:172.21.15.134:6816/3958491632 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff6bc06cdf0 con 0x7ff69c078af0 2024-05-12T10:50:23.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f4432400640 1 -- 172.21.15.115:0/2089644045 >> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] conn(0x7f440c078ba0 msgr2=0x7f440c07afe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.605+0000 7f4432400640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] conn(0x7f440c078ba0 0x7f440c07afe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7f4432400640 1 -- 172.21.15.115:0/2089644045 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f440c06f430 msgr2=0x7f440c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7f4432400640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f440c06f430 0x7f440c0718f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f442c06d450 tx=0x7f44200a6000 comp rx=0 tx=0).stop 2024-05-12T10:50:23.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7f4432400640 1 -- 172.21.15.115:0/2089644045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c15fbd0 msgr2=0x7f442c15d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7f4432400640 1 --2- 172.21.15.115:0/2089644045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c15fbd0 0x7f442c15d210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f442400c700 tx=0x7f442400cbc0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7f4431a00640 1 -- 172.21.15.115:0/2089644045 reap_dead start 2024-05-12T10:50:23.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7f4432400640 1 -- 172.21.15.115:0/2089644045 shutdown_connections 2024-05-12T10:50:23.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7f4432400640 1 -- 172.21.15.115:0/2089644045 >> 172.21.15.115:0/2089644045 conn(0x7f442c0d1380 msgr2=0x7f442c159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7f4432400640 1 -- 172.21.15.115:0/2089644045 shutdown_connections 2024-05-12T10:50:23.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7f4432400640 1 -- 172.21.15.115:0/2089644045 wait complete. 2024-05-12T10:50:23.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7ff6c4200640 1 -- 172.21.15.115:0/3267596875 >> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] conn(0x7ff69c078af0 msgr2=0x7ff69c07af30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7ff6c4200640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] conn(0x7ff69c078af0 0x7ff69c07af30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7ff6c4200640 1 -- 172.21.15.115:0/3267596875 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff69c06f400 msgr2=0x7ff69c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7ff6c4200640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff69c06f400 0x7ff69c0718c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80b2000 tx=0x7ff6a80aa070 comp rx=0 tx=0).stop 2024-05-12T10:50:23.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7ff6c4200640 1 -- 172.21.15.115:0/3267596875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6bc0b70f0 msgr2=0x7ff6bc1f2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7ff6c4200640 1 --2- 172.21.15.115:0/3267596875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6bc0b70f0 0x7ff6bc1f2540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000c3c0 tx=0x7ff6b000c880 comp rx=0 tx=0).stop 2024-05-12T10:50:23.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7ff6c2200640 1 -- 172.21.15.115:0/3267596875 reap_dead start 2024-05-12T10:50:23.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7ff6c4200640 1 -- 172.21.15.115:0/3267596875 shutdown_connections 2024-05-12T10:50:23.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.609+0000 7ff6c4200640 1 -- 172.21.15.115:0/3267596875 >> 172.21.15.115:0/3267596875 conn(0x7ff6bc073b70 msgr2=0x7ff6bc073f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.613+0000 7ff6c4200640 1 -- 172.21.15.115:0/3267596875 shutdown_connections 2024-05-12T10:50:23.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.613+0000 7ff6c4200640 1 -- 172.21.15.115:0/3267596875 wait complete. 2024-05-12T10:50:23.640 INFO:teuthology.orchestra.run.smithi115.stdout:60129542154 2024-05-12T10:50:23.640 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-12T10:50:23.641 INFO:teuthology.orchestra.run.smithi115.stdout:60129542155 2024-05-12T10:50:23.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-12T10:50:23.642 INFO:teuthology.orchestra.run.smithi115.stdout:60129542155 2024-05-12T10:50:23.642 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-12T10:50:23.643 INFO:teuthology.orchestra.run.smithi115.stdout:60129542157 2024-05-12T10:50:23.643 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-12T10:50:23.644 INFO:teuthology.orchestra.run.smithi115.stdout:60129542155 2024-05-12T10:50:23.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-12T10:50:23.645 INFO:teuthology.orchestra.run.smithi115.stdout:60129542155 2024-05-12T10:50:23.646 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-12T10:50:23.647 INFO:teuthology.orchestra.run.smithi115.stdout:60129542155 2024-05-12T10:50:23.647 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-12T10:50:23.649 INFO:teuthology.orchestra.run.smithi115.stdout:60129542154 2024-05-12T10:50:23.649 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-12T10:50:23.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.901+0000 7fe806c00640 1 Processor -- start 2024-05-12T10:50:23.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.901+0000 7fe806c00640 1 -- start start 2024-05-12T10:50:23.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc134200640 1 Processor -- start 2024-05-12T10:50:23.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fe806c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe800155c80 0x7fe800072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fe806c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 0x7fe800073490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fe7ffe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe800155c80 0x7fe800072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fe7ffe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe800155c80 0x7fe800072230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41536/0 (socket says 172.21.15.115:41536) 2024-05-12T10:50:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc134200640 1 -- start start 2024-05-12T10:50:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc134200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1240d6dc0 0x7fc124047340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc134200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc124047880 0x7fc12404d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc134200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1240dd920 con 0x7fc12404d8d0 2024-05-12T10:50:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc134200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc1240e0130 con 0x7fc124047880 2024-05-12T10:50:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc134200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc1240e0360 con 0x7fc1240d6dc0 2024-05-12T10:50:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fe7ffe00640 1 -- 172.21.15.115:0/1968111526 learned_addr learned my addr 172.21.15.115:0/1968111526 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fe806c00640 1 -- 172.21.15.115:0/1968111526 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8000c7ce0 con 0x7fe80006fa10 2024-05-12T10:50:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fe806c00640 1 -- 172.21.15.115:0/1968111526 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe8000729d0 con 0x7fe800155c80 2024-05-12T10:50:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc130e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc124047880 0x7fc12404d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc130e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc124047880 0x7fc12404d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41540/0 (socket says 172.21.15.115:41540) 2024-05-12T10:50:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc130e00640 1 -- 172.21.15.115:0/779714497 learned_addr learned my addr 172.21.15.115:0/779714497 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fe806c00640 1 -- 172.21.15.115:0/1968111526 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe8000c7f80 con 0x7fe80015c3d0 2024-05-12T10:50:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc131800640 1 --2- 172.21.15.115:0/779714497 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1240d6dc0 0x7fc124047340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc130e00640 1 -- 172.21.15.115:0/779714497 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1240d6dc0 msgr2=0x7fc124047340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc130e00640 1 --2- 172.21.15.115:0/779714497 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1240d6dc0 0x7fc124047340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fd6b3e00640 1 Processor -- start 2024-05-12T10:50:23.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fd6b3e00640 1 -- start start 2024-05-12T10:50:23.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fe7ff400640 1 --2- 172.21.15.115:0/1968111526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 0x7fe800073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fe7fea00640 1 -- 172.21.15.115:0/1968111526 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576209333 0 0) 0x7fe8000c7ce0 con 0x7fe80006fa10 2024-05-12T10:50:23.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fe7fea00640 1 -- 172.21.15.115:0/1968111526 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7e4003530 con 0x7fe80006fa10 2024-05-12T10:50:23.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc130e00640 1 -- 172.21.15.115:0/779714497 >> v1:172.21.15.115:6789/0 conn(0x7fc12404d8d0 legacy=0x7fc1240dcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fe7ffe00640 1 -- 172.21.15.115:0/1968111526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 msgr2=0x7fe800073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fe7ffe00640 1 --2- 172.21.15.115:0/1968111526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 0x7fe800073490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fe7ffe00640 1 -- 172.21.15.115:0/1968111526 >> v1:172.21.15.134:6789/0 conn(0x7fe80006fa10 legacy=0x7fe80015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fe7ffe00640 1 -- 172.21.15.115:0/1968111526 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8000c8260 con 0x7fe800155c80 2024-05-12T10:50:23.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.905+0000 7fc130e00640 1 -- 172.21.15.115:0/779714497 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1240e0600 con 0x7fc124047880 2024-05-12T10:50:23.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b3e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd6b40c6140 0x7fd6b4160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b3e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd6b40c9d50 0x7fd6b4160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b3e00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b40716a0 con 0x7fd6b415a1d0 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b3e00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fd6b40cccd0 con 0x7fd6b40c9d50 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b3e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd6b4070990 con 0x7fd6b40c6140 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b2a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd6b415a1d0 0x7fd6b40cf2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53080/0 (socket says 172.21.15.115:53080) 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b2a00640 1 -- 172.21.15.115:0/3158244343 learned_addr learned my addr 172.21.15.115:0/3158244343 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b2000640 1 --2- 172.21.15.115:0/3158244343 >> v2:172.21.15.134:3300/0 conn(0x7fd6b40c6140 0x7fd6b4160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b3400640 1 --2- 172.21.15.115:0/3158244343 >> v2:172.21.15.115:3300/0 conn(0x7fd6b40c9d50 0x7fd6b4160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b1600640 1 -- 172.21.15.115:0/3158244343 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557601273 0 0) 0x7fd6b40716a0 con 0x7fd6b415a1d0 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b1600640 1 -- 172.21.15.115:0/3158244343 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd698003530 con 0x7fd6b415a1d0 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b3400640 1 -- 172.21.15.115:0/3158244343 >> v2:172.21.15.134:3300/0 conn(0x7fd6b40c6140 msgr2=0x7fd6b4160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b3400640 1 --2- 172.21.15.115:0/3158244343 >> v2:172.21.15.134:3300/0 conn(0x7fd6b40c6140 0x7fd6b4160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b3400640 1 -- 172.21.15.115:0/3158244343 >> v1:172.21.15.115:6789/0 conn(0x7fd6b415a1d0 legacy=0x7fd6b40cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fd6b3400640 1 -- 172.21.15.115:0/3158244343 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b4070c70 con 0x7fd6b40c9d50 2024-05-12T10:50:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fa937200640 1 Processor -- start 2024-05-12T10:50:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.909+0000 7fa937200640 1 -- start start 2024-05-12T10:50:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe7ffe00640 1 --2- 172.21.15.115:0/1968111526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe800155c80 0x7fe800072230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009870 tx=0x7fe7f001c5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dc9d12da262ca92 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe7fea00640 1 -- 172.21.15.115:0/1968111526 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00b2070 con 0x7fe800155c80 2024-05-12T10:50:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe7fea00640 1 -- 172.21.15.115:0/1968111526 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f00a9070 con 0x7fe800155c80 2024-05-12T10:50:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe7fea00640 1 -- 172.21.15.115:0/1968111526 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00ad860 con 0x7fe800155c80 2024-05-12T10:50:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa937200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa930005ea0 0x7fa9300467b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa937200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa93004b4d0 con 0x7fa93004aef0 2024-05-12T10:50:23.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa937200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9300d9400 con 0x7fa9300d9020 2024-05-12T10:50:23.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa937200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fa9300062b0 con 0x7fa930005ea0 2024-05-12T10:50:23.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa936800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa930005ea0 0x7fa9300467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa935e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa9300d9020 0x7fa93004c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:56138/0 (socket says 172.21.15.115:56138) 2024-05-12T10:50:23.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa935e00640 1 -- 172.21.15.115:0/529058550 learned_addr learned my addr 172.21.15.115:0/529058550 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:23.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe806c00640 1 -- 172.21.15.115:0/1968111526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe800155c80 msgr2=0x7fe800072230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe806c00640 1 --2- 172.21.15.115:0/1968111526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe800155c80 0x7fe800072230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009870 tx=0x7fe7f001c5a0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fd6b3400640 1 --2- 172.21.15.115:0/3158244343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b40c9d50 0x7fd6b4160740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd6b406fae0 tx=0x7fd6a401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351dd2809d57546d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.912 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe806c00640 1 -- 172.21.15.115:0/1968111526 shutdown_connections 2024-05-12T10:50:23.912 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa934a00640 1 -- 172.21.15.115:0/529058550 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237835683 0 0) 0x7fa9300d9400 con 0x7fa9300d9020 2024-05-12T10:50:23.912 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa934a00640 1 -- 172.21.15.115:0/529058550 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa91c003530 con 0x7fa9300d9020 2024-05-12T10:50:23.912 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa936800640 1 -- 172.21.15.115:0/529058550 >> v1:172.21.15.134:6789/0 conn(0x7fa9300d9020 legacy=0x7fa93004c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa936800640 1 -- 172.21.15.115:0/529058550 >> v1:172.21.15.115:6789/0 conn(0x7fa93004aef0 legacy=0x7fa9300e2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fa936800640 1 -- 172.21.15.115:0/529058550 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9300459f0 con 0x7fa930005ea0 2024-05-12T10:50:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe806c00640 1 --2- 172.21.15.115:0/1968111526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 0x7fe800073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe806c00640 1 --2- 172.21.15.115:0/1968111526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe800155c80 0x7fe800072230 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe806c00640 1 -- 172.21.15.115:0/1968111526 >> 172.21.15.115:0/1968111526 conn(0x7fe800076430 msgr2=0x7fe8000681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fd6b1600640 1 -- 172.21.15.115:0/3158244343 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a40a66c0 con 0x7fd6b40c9d50 2024-05-12T10:50:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe806c00640 1 -- 172.21.15.115:0/1968111526 shutdown_connections 2024-05-12T10:50:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fe806c00640 1 -- 172.21.15.115:0/1968111526 wait complete. 2024-05-12T10:50:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fd6b1600640 1 -- 172.21.15.115:0/3158244343 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a40a6860 con 0x7fd6b40c9d50 2024-05-12T10:50:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.913+0000 7fd6b1600640 1 -- 172.21.15.115:0/3158244343 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a40a6c30 con 0x7fd6b40c9d50 2024-05-12T10:50:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 -- 172.21.15.115:0/3158244343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b40c9d50 msgr2=0x7fd6b4160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 --2- 172.21.15.115:0/3158244343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b40c9d50 0x7fd6b4160740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd6b406fae0 tx=0x7fd6a401c6e0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 -- 172.21.15.115:0/3158244343 shutdown_connections 2024-05-12T10:50:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 --2- 172.21.15.115:0/3158244343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b40c9d50 0x7fd6b4160740 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 --2- 172.21.15.115:0/3158244343 >> v2:172.21.15.134:3300/0 conn(0x7fd6b40c6140 0x7fd6b4160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 -- 172.21.15.115:0/3158244343 >> 172.21.15.115:0/3158244343 conn(0x7fd6b4076830 msgr2=0x7fd6b40681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 -- 172.21.15.115:0/3158244343 shutdown_connections 2024-05-12T10:50:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 -- 172.21.15.115:0/3158244343 wait complete. 2024-05-12T10:50:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fe806c00640 1 Processor -- start 2024-05-12T10:50:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fe806c00640 1 -- start start 2024-05-12T10:50:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 Processor -- start 2024-05-12T10:50:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fe806c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe80006fa10 0x7fe80015e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fe806c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe800155c80 0x7fe8001432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fe806c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 0x7fe800140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fe806c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe8000706b0 con 0x7fe800155c80 2024-05-12T10:50:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fe806c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe800156060 con 0x7fe80006fa10 2024-05-12T10:50:23.917 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fe806c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe80015c7b0 con 0x7fe80015c3d0 2024-05-12T10:50:23.917 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 -- start start 2024-05-12T10:50:23.917 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fa936800640 1 --2- 172.21.15.115:0/529058550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa930005ea0 0x7fa9300467b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa9240097c0 tx=0x7fa92401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a297a36b1877b1e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40c6140 0x7fd6b40cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.917+0000 7fd6b3e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b40c9d50 0x7fd6b40ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b3e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b415a1d0 0x7fd6b41f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fc130e00640 1 --2- 172.21.15.115:0/779714497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc124047880 0x7fc12404d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc1240ddaf0 tx=0x7fc11801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f00648929bb65f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe7ff400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe800155c80 0x7fe8001432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe804c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 0x7fe800140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b2a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40c6140 0x7fd6b40cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b2000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b40c9d50 0x7fd6b40ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b2a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40c6140 0x7fd6b40cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60222/0 (socket says 172.21.15.115:60222) 2024-05-12T10:50:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b2a00640 1 -- 172.21.15.115:0/2209924316 learned_addr learned my addr 172.21.15.115:0/2209924316 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b3e00640 1 -- 172.21.15.115:0/2209924316 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b40cfb50 con 0x7fd6b415a1d0 2024-05-12T10:50:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b3e00640 1 -- 172.21.15.115:0/2209924316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b40cf9d0 con 0x7fd6b40c9d50 2024-05-12T10:50:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b3e00640 1 -- 172.21.15.115:0/2209924316 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b416d110 con 0x7fd6b40c6140 2024-05-12T10:50:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b3400640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b415a1d0 0x7fd6b41f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe804c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 0x7fe800140e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60228/0 (socket says 172.21.15.115:60228) 2024-05-12T10:50:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe804c00640 1 -- 172.21.15.115:0/3022218105 learned_addr learned my addr 172.21.15.115:0/3022218105 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe7ffe00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe80006fa10 0x7fe80015e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fc12be00640 1 -- 172.21.15.115:0/779714497 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1180b1070 con 0x7fc124047880 2024-05-12T10:50:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fc12be00640 1 -- 172.21.15.115:0/779714497 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1180ac630 con 0x7fc124047880 2024-05-12T10:50:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fc12be00640 1 -- 172.21.15.115:0/779714497 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1180a8050 con 0x7fc124047880 2024-05-12T10:50:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe804c00640 1 -- 172.21.15.115:0/3022218105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe80006fa10 msgr2=0x7fe80015e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe804c00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe80006fa10 0x7fe80015e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe804c00640 1 -- 172.21.15.115:0/3022218105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe800155c80 msgr2=0x7fe8001432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe804c00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe800155c80 0x7fe8001432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe804c00640 1 -- 172.21.15.115:0/3022218105 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80015ed10 con 0x7fe80015c3d0 2024-05-12T10:50:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b3400640 1 -- 172.21.15.115:0/2209924316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40c6140 msgr2=0x7fd6b40cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b3400640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40c6140 0x7fd6b40cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe804c00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 0x7fe800140e40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800c730 tx=0x7fe7f800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fa934a00640 1 -- 172.21.15.115:0/529058550 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9240b5070 con 0x7fa930005ea0 2024-05-12T10:50:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fa934a00640 1 -- 172.21.15.115:0/529058550 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9240a8990 con 0x7fa930005ea0 2024-05-12T10:50:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fa934a00640 1 -- 172.21.15.115:0/529058550 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9240a8d60 con 0x7fa930005ea0 2024-05-12T10:50:23.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b3400640 1 -- 172.21.15.115:0/2209924316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b40c9d50 msgr2=0x7fd6b40ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b3400640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b40c9d50 0x7fd6b40ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b3400640 1 -- 172.21.15.115:0/2209924316 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b415e970 con 0x7fd6b415a1d0 2024-05-12T10:50:23.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fc134200640 1 -- 172.21.15.115:0/779714497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc124047880 msgr2=0x7fc12404d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fc134200640 1 --2- 172.21.15.115:0/779714497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc124047880 0x7fc12404d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc1240ddaf0 tx=0x7fc11801c540 comp rx=0 tx=0).stop 2024-05-12T10:50:23.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fd6b3400640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b415a1d0 0x7fd6b41f2380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40ac000 tx=0x7fd6a4019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe7f7e00640 1 -- 172.21.15.115:0/3022218105 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8003b80 con 0x7fe80015c3d0 2024-05-12T10:50:23.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe7f7e00640 1 -- 172.21.15.115:0/3022218105 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f8003d20 con 0x7fe80015c3d0 2024-05-12T10:50:23.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe7f7e00640 1 -- 172.21.15.115:0/3022218105 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f800aa90 con 0x7fe80015c3d0 2024-05-12T10:50:23.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe806c00640 1 -- 172.21.15.115:0/3022218105 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80015d430 con 0x7fe80015c3d0 2024-05-12T10:50:23.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fe806c00640 1 -- 172.21.15.115:0/3022218105 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe80015d9f0 con 0x7fe80015c3d0 2024-05-12T10:50:23.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fc134200640 1 -- 172.21.15.115:0/779714497 shutdown_connections 2024-05-12T10:50:23.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fa937200640 1 -- 172.21.15.115:0/529058550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa930005ea0 msgr2=0x7fa9300467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fa937200640 1 --2- 172.21.15.115:0/529058550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa930005ea0 0x7fa9300467b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa9240097c0 tx=0x7fa92401ec90 comp rx=0 tx=0).stop 2024-05-12T10:50:23.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fa937200640 1 -- 172.21.15.115:0/529058550 shutdown_connections 2024-05-12T10:50:23.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa937200640 1 --2- 172.21.15.115:0/529058550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa930005ea0 0x7fa9300467b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa937200640 1 -- 172.21.15.115:0/529058550 >> 172.21.15.115:0/529058550 conn(0x7fa930050190 msgr2=0x7fa9300505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fd6aaa00640 1 -- 172.21.15.115:0/2209924316 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4004040 con 0x7fd6b415a1d0 2024-05-12T10:50:23.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fd6aaa00640 1 -- 172.21.15.115:0/2209924316 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a40be070 con 0x7fd6b415a1d0 2024-05-12T10:50:23.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fd6b3e00640 1 -- 172.21.15.115:0/2209924316 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b41fbe10 con 0x7fd6b415a1d0 2024-05-12T10:50:23.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fd6aaa00640 1 -- 172.21.15.115:0/2209924316 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4004420 con 0x7fd6b415a1d0 2024-05-12T10:50:23.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa937200640 1 -- 172.21.15.115:0/529058550 shutdown_connections 2024-05-12T10:50:23.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa937200640 1 -- 172.21.15.115:0/529058550 wait complete. 2024-05-12T10:50:23.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fd6b3e00640 1 -- 172.21.15.115:0/2209924316 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b41fc3d0 con 0x7fd6b415a1d0 2024-05-12T10:50:23.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fe806c00640 1 -- 172.21.15.115:0/3022218105 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe800069730 con 0x7fe80015c3d0 2024-05-12T10:50:23.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fc134200640 1 --2- 172.21.15.115:0/779714497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc124047880 0x7fc12404d390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fc134200640 1 --2- 172.21.15.115:0/779714497 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1240d6dc0 0x7fc124047340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fc134200640 1 -- 172.21.15.115:0/779714497 >> 172.21.15.115:0/779714497 conn(0x7fc12400e090 msgr2=0x7fc12400e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fc134200640 1 -- 172.21.15.115:0/779714497 shutdown_connections 2024-05-12T10:50:23.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fc134200640 1 -- 172.21.15.115:0/779714497 wait complete. 2024-05-12T10:50:23.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7f3db8c00640 1 Processor -- start 2024-05-12T10:50:23.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7f3db8c00640 1 -- start start 2024-05-12T10:50:23.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fa4db800640 1 Processor -- start 2024-05-12T10:50:23.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.921+0000 7fa4db800640 1 -- start start 2024-05-12T10:50:23.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fd69fe00640 1 -- 172.21.15.115:0/2209924316 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6b41f2060 con 0x7fd6b415a1d0 2024-05-12T10:50:23.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa4db800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa4d4151cc0 0x7fa4d4158660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa4db800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 0x7fa4d40ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa4db800640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d40c9b90 con 0x7fa4d40c8880 2024-05-12T10:50:23.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa4db800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d4158ba0 con 0x7fa4d4151cc0 2024-05-12T10:50:23.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa4db800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d40c8540 con 0x7fa4d40ca040 2024-05-12T10:50:23.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa4d8e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa4d4151cc0 0x7fa4d4158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa4d8e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa4d4151cc0 0x7fa4d4158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41576/0 (socket says 172.21.15.115:41576) 2024-05-12T10:50:23.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa4d8e00640 1 -- 172.21.15.115:0/1559461021 learned_addr learned my addr 172.21.15.115:0/1559461021 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa4d9800640 1 --2- 172.21.15.115:0/1559461021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 0x7fa4d40ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa937200640 1 Processor -- start 2024-05-12T10:50:23.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7fa937200640 1 -- start start 2024-05-12T10:50:23.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7f3db8c00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3db4069730 0x7f3db40c9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7f3db8c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3db406ed10 0x7f3db4151d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7f3db8c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3db40c85d0 con 0x7f3db4072d00 2024-05-12T10:50:23.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7f3db8c00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f3db4073130 con 0x7f3db4069730 2024-05-12T10:50:23.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.925+0000 7f3db8c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3db40c88b0 con 0x7f3db406ed10 2024-05-12T10:50:23.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fe7f7e00640 1 -- 172.21.15.115:0/3022218105 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe7f800ac30 con 0x7fe80015c3d0 2024-05-12T10:50:23.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fe7f7e00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe7e006f4d0 0x7fe7e0071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fe7f7e00640 1 -- 172.21.15.115:0/3022218105 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe7f808f720 con 0x7fe80015c3d0 2024-05-12T10:50:23.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7f3db2800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3db406ed10 0x7f3db4151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7f3db2800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3db406ed10 0x7f3db4151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41586/0 (socket says 172.21.15.115:41586) 2024-05-12T10:50:23.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7f3db2800640 1 -- 172.21.15.115:0/3510956646 learned_addr learned my addr 172.21.15.115:0/3510956646 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7f3db1e00640 1 --2- 172.21.15.115:0/3510956646 >> v2:172.21.15.115:3300/0 conn(0x7f3db4069730 0x7f3db40c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa4d8e00640 1 -- 172.21.15.115:0/1559461021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 msgr2=0x7fa4d40ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa4d8e00640 1 --2- 172.21.15.115:0/1559461021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 0x7fa4d40ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa4d8e00640 1 -- 172.21.15.115:0/1559461021 >> v1:172.21.15.115:6789/0 conn(0x7fa4d40c8880 legacy=0x7fa4d40c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa4d8e00640 1 -- 172.21.15.115:0/1559461021 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d40caa10 con 0x7fa4d4151cc0 2024-05-12T10:50:23.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa937200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa930005ea0 0x7fa9300d5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa937200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa93004aef0 0x7fa9300cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa937200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9300d9020 0x7fa9300e1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa937200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa930046290 con 0x7fa930005ea0 2024-05-12T10:50:23.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa937200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa930045fb0 con 0x7fa93004aef0 2024-05-12T10:50:23.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa937200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa9300e2f10 con 0x7fa9300d9020 2024-05-12T10:50:23.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa935e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa930005ea0 0x7fa9300d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa935e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa930005ea0 0x7fa9300d5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52820/0 (socket says 172.21.15.115:52820) 2024-05-12T10:50:23.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa935e00640 1 -- 172.21.15.115:0/2909325990 learned_addr learned my addr 172.21.15.115:0/2909325990 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa935400640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa93004aef0 0x7fa9300cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fa936800640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9300d9020 0x7fa9300e1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7f56b1800640 1 Processor -- start 2024-05-12T10:50:23.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fe7ffe00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe7e006f4d0 0x7fe7e0071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fc134200640 1 Processor -- start 2024-05-12T10:50:23.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fc134200640 1 -- start start 2024-05-12T10:50:23.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fc134200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc124047880 0x7fc124009450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fc134200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc12404d8d0 0x7fc1240dbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fc134200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1240d6dc0 0x7fc12404ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fd6aaa00640 1 -- 172.21.15.115:0/2209924316 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd6a4003620 con 0x7fd6b415a1d0 2024-05-12T10:50:23.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7fd6aaa00640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd69406f400 0x7fd6940718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fd6aaa00640 1 -- 172.21.15.115:0/2209924316 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd6a412a530 con 0x7fd6b415a1d0 2024-05-12T10:50:23.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc130e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc12404d8d0 0x7fc1240dbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc130e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc12404d8d0 0x7fc1240dbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60258/0 (socket says 172.21.15.115:60258) 2024-05-12T10:50:23.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7f3db1e00640 1 -- 172.21.15.115:0/3510956646 >> v2:172.21.15.134:3300/0 conn(0x7f3db406ed10 msgr2=0x7f3db4151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7f3db1e00640 1 --2- 172.21.15.115:0/3510956646 >> v2:172.21.15.134:3300/0 conn(0x7f3db406ed10 0x7f3db4151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7f3db1e00640 1 -- 172.21.15.115:0/3510956646 >> v1:172.21.15.134:6789/0 conn(0x7f3db4072d00 legacy=0x7f3db4158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7f3db1e00640 1 -- 172.21.15.115:0/3510956646 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db40c8b90 con 0x7f3db4069730 2024-05-12T10:50:23.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc131800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc124047880 0x7fc124009450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.929+0000 7f56b1800640 1 -- start start 2024-05-12T10:50:23.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa935400640 1 -- 172.21.15.115:0/2909325990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9300d9020 msgr2=0x7fa9300e1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa935400640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9300d9020 0x7fa9300e1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa935400640 1 -- 172.21.15.115:0/2909325990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa930005ea0 msgr2=0x7fa9300d5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa935400640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa930005ea0 0x7fa9300d5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa935400640 1 -- 172.21.15.115:0/2909325990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa930175a40 con 0x7fa93004aef0 2024-05-12T10:50:23.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc132200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1240d6dc0 0x7fc12404ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc132200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1240d6dc0 0x7fc12404ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41594/0 (socket says 172.21.15.115:41594) 2024-05-12T10:50:23.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc130e00640 1 -- 172.21.15.115:0/364578405 learned_addr learned my addr 172.21.15.115:0/364578405 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fd6b2a00640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd69406f400 0x7fd6940718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc12404ec40 con 0x7fc124047880 2024-05-12T10:50:23.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc12404eac0 con 0x7fc1240d6dc0 2024-05-12T10:50:23.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc1240e9ce0 con 0x7fc12404d8d0 2024-05-12T10:50:23.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa935400640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa93004aef0 0x7fa9300cee30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa92800c410 tx=0x7fa92800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa936800640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9300d9020 0x7fa9300e1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:23.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56b1800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f56ac1521e0 0x7f56ac15b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56b1800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac072420 0x7f56ac15b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56b1800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56ac157c50 con 0x7f56ac0ca180 2024-05-12T10:50:23.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56b1800640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f56ac158b20 con 0x7f56ac1521e0 2024-05-12T10:50:23.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56ab400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac072420 0x7f56ac15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56ab400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac072420 0x7f56ac15b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60262/0 (socket says 172.21.15.115:60262) 2024-05-12T10:50:23.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56ab400640 1 -- 172.21.15.115:0/288008743 learned_addr learned my addr 172.21.15.115:0/288008743 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56b1800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f56ac157f10 con 0x7f56ac072420 2024-05-12T10:50:23.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56aa000640 1 --2- 172.21.15.115:0/288008743 >> v2:172.21.15.115:3300/0 conn(0x7f56ac1521e0 0x7f56ac15b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa92e000640 1 -- 172.21.15.115:0/2909325990 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa928011790 con 0x7fa93004aef0 2024-05-12T10:50:23.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa92e000640 1 -- 172.21.15.115:0/2909325990 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa928017070 con 0x7fa93004aef0 2024-05-12T10:50:23.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa92e000640 1 -- 172.21.15.115:0/2909325990 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa928011b30 con 0x7fa93004aef0 2024-05-12T10:50:23.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc130e00640 1 -- 172.21.15.115:0/364578405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1240d6dc0 msgr2=0x7fc12404ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fe7ffe00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe7e006f4d0 0x7fe7e0071990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00af000 tx=0x7fe7f00a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa937200640 1 -- 172.21.15.115:0/2909325990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa930174be0 con 0x7fa93004aef0 2024-05-12T10:50:23.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc130e00640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1240d6dc0 0x7fc12404ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc130e00640 1 -- 172.21.15.115:0/364578405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc124047880 msgr2=0x7fc124009450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc130e00640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc124047880 0x7fc124009450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc130e00640 1 -- 172.21.15.115:0/364578405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1241801a0 con 0x7fc12404d8d0 2024-05-12T10:50:23.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc131800640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc124047880 0x7fc124009450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:23.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa937200640 1 -- 172.21.15.115:0/2909325990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9301751a0 con 0x7fa93004aef0 2024-05-12T10:50:23.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56ab400640 1 -- 172.21.15.115:0/288008743 >> v2:172.21.15.115:3300/0 conn(0x7f56ac1521e0 msgr2=0x7f56ac15b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:23.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56ab400640 1 --2- 172.21.15.115:0/288008743 >> v2:172.21.15.115:3300/0 conn(0x7f56ac1521e0 0x7f56ac15b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f19c7600640 1 Processor -- start 2024-05-12T10:50:23.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f19c7600640 1 -- start start 2024-05-12T10:50:23.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fc130e00640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc12404d8d0 0x7fc1240dbc60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc1180af040 tx=0x7fc1180192e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa4d8e00640 1 --2- 172.21.15.115:0/1559461021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4d4151cc0 0x7fa4d4158660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009870 tx=0x7fa4c401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd992d31d06b09d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56ab400640 1 -- 172.21.15.115:0/288008743 >> v1:172.21.15.134:6789/0 conn(0x7f56ac0ca180 legacy=0x7f56ac151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f56ab400640 1 -- 172.21.15.115:0/288008743 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac1581f0 con 0x7f56ac072420 2024-05-12T10:50:23.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fa937200640 1 -- 172.21.15.115:0/2909325990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9300053a0 con 0x7fa93004aef0 2024-05-12T10:50:23.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f19c7600640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f19c006c4b0 0x7f19c006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f19c7600640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19c0160340 con 0x7f19c015a3f0 2024-05-12T10:50:23.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f19c7600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19c0160620 con 0x7f19c006f070 2024-05-12T10:50:23.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7f19c7600640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f19c00cbcd0 con 0x7f19c006c4b0 2024-05-12T10:50:23.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.933+0000 7fd6b2a00640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd69406f400 0x7fd6940718c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0007fd0 tx=0x7fd6a0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f19c4c00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f19c015a3f0 0x7f19c0073f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53112/0 (socket says 172.21.15.115:53112) 2024-05-12T10:50:23.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f19c4c00640 1 -- 172.21.15.115:0/2896464085 learned_addr learned my addr 172.21.15.115:0/2896464085 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:23.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f3db1e00640 1 --2- 172.21.15.115:0/3510956646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3db4069730 0x7f3db40c9390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3db40c4900 tx=0x7f3d9c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0987fd315e4b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa4d3400640 1 -- 172.21.15.115:0/1559461021 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40ab650 con 0x7fa4d4151cc0 2024-05-12T10:50:23.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f19c5600640 1 --2- 172.21.15.115:0/2896464085 >> v2:172.21.15.115:3300/0 conn(0x7f19c006c4b0 0x7f19c006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa4d3400640 1 -- 172.21.15.115:0/1559461021 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c40b0070 con 0x7fa4d4151cc0 2024-05-12T10:50:23.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f19bf400640 1 -- 172.21.15.115:0/2896464085 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822922606 0 0) 0x7f19c0160340 con 0x7f19c015a3f0 2024-05-12T10:50:23.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f19bf400640 1 -- 172.21.15.115:0/2896464085 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19a8003530 con 0x7f19c015a3f0 2024-05-12T10:50:23.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa4d3400640 1 -- 172.21.15.115:0/1559461021 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40ab650 con 0x7fa4d4151cc0 2024-05-12T10:50:23.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa4db800640 1 -- 172.21.15.115:0/1559461021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4d4151cc0 msgr2=0x7fa4d4158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa4db800640 1 --2- 172.21.15.115:0/1559461021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4d4151cc0 0x7fa4d4158660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009870 tx=0x7fa4c401c560 comp rx=0 tx=0).stop 2024-05-12T10:50:23.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f3db0a00640 1 -- 172.21.15.115:0/3510956646 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0b0070 con 0x7f3db4069730 2024-05-12T10:50:23.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f3db0a00640 1 -- 172.21.15.115:0/3510956646 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0ab600 con 0x7f3db4069730 2024-05-12T10:50:23.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f3db0a00640 1 -- 172.21.15.115:0/3510956646 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0ab9d0 con 0x7f3db4069730 2024-05-12T10:50:23.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fd6aaa00640 1 -- 172.21.15.115:0/2209924316 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd6b41f2060 con 0x7fd6b415a1d0 2024-05-12T10:50:23.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f19c5600640 1 -- 172.21.15.115:0/2896464085 >> v1:172.21.15.134:6789/0 conn(0x7f19c006f070 legacy=0x7f19c006f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f19c5600640 1 -- 172.21.15.115:0/2896464085 >> v1:172.21.15.115:6789/0 conn(0x7f19c015a3f0 legacy=0x7f19c0073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f19c5600640 1 -- 172.21.15.115:0/2896464085 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c0160900 con 0x7f19c006c4b0 2024-05-12T10:50:23.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa4db800640 1 -- 172.21.15.115:0/1559461021 shutdown_connections 2024-05-12T10:50:23.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa4db800640 1 --2- 172.21.15.115:0/1559461021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 0x7fa4d40ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa4db800640 1 --2- 172.21.15.115:0/1559461021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4d4151cc0 0x7fa4d4158660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa4db800640 1 -- 172.21.15.115:0/1559461021 >> 172.21.15.115:0/1559461021 conn(0x7fa4d4076830 msgr2=0x7fa4d40681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f3db8c00640 1 -- 172.21.15.115:0/3510956646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3db4069730 msgr2=0x7f3db40c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f3db8c00640 1 --2- 172.21.15.115:0/3510956646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3db4069730 0x7f3db40c9390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3db40c4900 tx=0x7f3d9c01c3e0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa4db800640 1 -- 172.21.15.115:0/1559461021 shutdown_connections 2024-05-12T10:50:23.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa4db800640 1 -- 172.21.15.115:0/1559461021 wait complete. 2024-05-12T10:50:23.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa92e000640 1 -- 172.21.15.115:0/2909325990 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa928011cd0 con 0x7fa93004aef0 2024-05-12T10:50:23.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa92e000640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa91806f400 0x7fa9180718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f3db8c00640 1 -- 172.21.15.115:0/3510956646 shutdown_connections 2024-05-12T10:50:23.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f3db8c00640 1 --2- 172.21.15.115:0/3510956646 >> v2:172.21.15.134:3300/0 conn(0x7f3db406ed10 0x7f3db4151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f3db8c00640 1 --2- 172.21.15.115:0/3510956646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3db4069730 0x7f3db40c9390 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3db40c4900 tx=0x7f3d9c01c3e0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f3db8c00640 1 -- 172.21.15.115:0/3510956646 >> 172.21.15.115:0/3510956646 conn(0x7f3db40ca350 msgr2=0x7f3db40ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa92e000640 1 -- 172.21.15.115:0/2909325990 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa9280588e0 con 0x7fa93004aef0 2024-05-12T10:50:23.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7fa935e00640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa91806f400 0x7fa9180718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.937+0000 7f56ab400640 1 --2- 172.21.15.115:0/288008743 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac072420 0x7f56ac15b980 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f56a4008c80 tx=0x7f56a401f1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=966a0dbebfb31c0b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f3db8c00640 1 -- 172.21.15.115:0/3510956646 shutdown_connections 2024-05-12T10:50:23.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f3db8c00640 1 -- 172.21.15.115:0/3510956646 wait complete. 2024-05-12T10:50:23.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fa935e00640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa91806f400 0x7fa9180718c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa93806b860 tx=0x7fa938051780 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f3db8c00640 1 Processor -- start 2024-05-12T10:50:23.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fa4db800640 1 Processor -- start 2024-05-12T10:50:23.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f3db8c00640 1 -- start start 2024-05-12T10:50:23.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fa4db800640 1 -- start start 2024-05-12T10:50:23.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f56a9600640 1 -- 172.21.15.115:0/288008743 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a400a2d0 con 0x7f56ac072420 2024-05-12T10:50:23.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f56a9600640 1 -- 172.21.15.115:0/288008743 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a400a470 con 0x7f56ac072420 2024-05-12T10:50:23.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f56a9600640 1 -- 172.21.15.115:0/288008743 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a400a860 con 0x7f56ac072420 2024-05-12T10:50:23.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fc129600640 1 -- 172.21.15.115:0/364578405 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1180bc070 con 0x7fc12404d8d0 2024-05-12T10:50:23.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fc129600640 1 -- 172.21.15.115:0/364578405 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1180ab980 con 0x7fc12404d8d0 2024-05-12T10:50:23.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fc129600640 1 -- 172.21.15.115:0/364578405 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1180b1070 con 0x7fc12404d8d0 2024-05-12T10:50:23.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fe7f7e00640 1 -- 172.21.15.115:0/3022218105 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe7f805c340 con 0x7fe80015c3d0 2024-05-12T10:50:23.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc124180440 con 0x7fc12404d8d0 2024-05-12T10:50:23.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc124180a00 con 0x7fc12404d8d0 2024-05-12T10:50:23.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f3db8c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3db406ed10 0x7f3db4156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f56b1800640 1 -- 172.21.15.115:0/288008743 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac072420 msgr2=0x7f56ac15b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f56b1800640 1 --2- 172.21.15.115:0/288008743 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac072420 0x7f56ac15b980 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f56a4008c80 tx=0x7f56a401f1d0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fa4db800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4d40c8880 0x7fa4d41661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fa4db800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 0x7fa4d40c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fa4db800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4d4151cc0 0x7fa4d4141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fa4db800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d415b1d0 con 0x7fa4d4151cc0 2024-05-12T10:50:23.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fa4db800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d415bd90 con 0x7fa4d40c8880 2024-05-12T10:50:23.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7fa4db800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d415c070 con 0x7fa4d40ca040 2024-05-12T10:50:23.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f3db8c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db4072d00 0x7f3db40cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f3db8c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db40c7160 0x7f3db40cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f3db8c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3db4152260 con 0x7f3db406ed10 2024-05-12T10:50:23.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f3db8c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3db406f430 con 0x7f3db4072d00 2024-05-12T10:50:23.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f3db8c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3db41523e0 con 0x7f3db40c7160 2024-05-12T10:50:23.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f56b1800640 1 -- 172.21.15.115:0/288008743 shutdown_connections 2024-05-12T10:50:23.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f56b1800640 1 --2- 172.21.15.115:0/288008743 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac072420 0x7f56ac15b980 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f56b1800640 1 --2- 172.21.15.115:0/288008743 >> v2:172.21.15.115:3300/0 conn(0x7f56ac1521e0 0x7f56ac15b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.941+0000 7f56b1800640 1 -- 172.21.15.115:0/288008743 >> 172.21.15.115:0/288008743 conn(0x7f56ac076830 msgr2=0x7f56ac0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db1400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db4072d00 0x7f3db40cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db1400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db4072d00 0x7f3db40cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41606/0 (socket says 172.21.15.115:41606) 2024-05-12T10:50:23.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db1400640 1 -- 172.21.15.115:0/1339896795 learned_addr learned my addr 172.21.15.115:0/1339896795 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d8e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4d40c8880 0x7fa4d41661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db1e00640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3db406ed10 0x7f3db4156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d8e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4d40c8880 0x7fa4d41661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41618/0 (socket says 172.21.15.115:41618) 2024-05-12T10:50:23.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f56b1800640 1 -- 172.21.15.115:0/288008743 shutdown_connections 2024-05-12T10:50:23.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f56b1800640 1 -- 172.21.15.115:0/288008743 wait complete. 2024-05-12T10:50:23.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db1400640 1 -- 172.21.15.115:0/1339896795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db40c7160 msgr2=0x7f3db40cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db2800640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db40c7160 0x7f3db40cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d3e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 0x7fa4d40c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4d4151cc0 0x7fa4d4141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d3e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 0x7fa4d40c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60270/0 (socket says 172.21.15.115:60270) 2024-05-12T10:50:23.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d3e00640 1 -- 172.21.15.115:0/4057070443 learned_addr learned my addr 172.21.15.115:0/4057070443 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db1400640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db40c7160 0x7f3db40cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db1400640 1 -- 172.21.15.115:0/1339896795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3db406ed10 msgr2=0x7f3db4156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db1400640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3db406ed10 0x7f3db4156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db1400640 1 -- 172.21.15.115:0/1339896795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db40cb860 con 0x7f3db4072d00 2024-05-12T10:50:23.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db2800640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db40c7160 0x7f3db40cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:23.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d3e00640 1 -- 172.21.15.115:0/4057070443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4d40c8880 msgr2=0x7fa4d41661c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d3e00640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4d40c8880 0x7fa4d41661c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d3e00640 1 -- 172.21.15.115:0/4057070443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4d4151cc0 msgr2=0x7fa4d4141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d3e00640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4d4151cc0 0x7fa4d4141f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d3e00640 1 -- 172.21.15.115:0/4057070443 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d4160850 con 0x7fa4d40ca040 2024-05-12T10:50:23.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f3db1400640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db4072d00 0x7f3db40cc300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3da400c4f0 tx=0x7f3da4001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1240057f0 con 0x7fc12404d8d0 2024-05-12T10:50:23.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d3e00640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 0x7fa4d40c7060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800c3f0 tx=0x7fa4c800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f19c5600640 1 --2- 172.21.15.115:0/2896464085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c006c4b0 0x7f19c006c900 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009d90 tx=0x7f19b801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6f6ab827d2a632 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f56b1800640 1 Processor -- start 2024-05-12T10:50:23.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f56b1800640 1 -- start start 2024-05-12T10:50:23.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d0c00640 1 -- 172.21.15.115:0/4057070443 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8017070 con 0x7fa4d40ca040 2024-05-12T10:50:23.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d0c00640 1 -- 172.21.15.115:0/4057070443 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c80052d0 con 0x7fa4d40ca040 2024-05-12T10:50:23.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4d0c00640 1 -- 172.21.15.115:0/4057070443 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8003840 con 0x7fa4d40ca040 2024-05-12T10:50:23.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4db800640 1 -- 172.21.15.115:0/4057070443 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d4158ed0 con 0x7fa4d40ca040 2024-05-12T10:50:23.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7fa4db800640 1 -- 172.21.15.115:0/4057070443 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d4166700 con 0x7fa4d40ca040 2024-05-12T10:50:23.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f19bf400640 1 -- 172.21.15.115:0/2896464085 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b80b4070 con 0x7f19c006c4b0 2024-05-12T10:50:23.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f19bf400640 1 -- 172.21.15.115:0/2896464085 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b80af600 con 0x7f19c006c4b0 2024-05-12T10:50:23.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f19bf400640 1 -- 172.21.15.115:0/2896464085 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b80af9d0 con 0x7f19c006c4b0 2024-05-12T10:50:23.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f56b1800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56ac072420 0x7f56ac142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f56b1800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac0ca180 0x7f56ac143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f56b1800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56ac1521e0 0x7f56ac147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f56b1800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac0ca6e0 con 0x7f56ac072420 2024-05-12T10:50:23.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f56b1800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac0ca560 con 0x7f56ac1521e0 2024-05-12T10:50:23.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.945+0000 7f56b1800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f56ac0729b0 con 0x7f56ac0ca180 2024-05-12T10:50:23.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7fc129600640 1 -- 172.21.15.115:0/364578405 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc1180bf070 con 0x7fc12404d8d0 2024-05-12T10:50:23.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7fa4db800640 1 -- 172.21.15.115:0/4057070443 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d4069730 con 0x7fa4d40ca040 2024-05-12T10:50:23.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56aaa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56ac072420 0x7f56ac142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56aaa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56ac072420 0x7f56ac142cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52878/0 (socket says 172.21.15.115:52878) 2024-05-12T10:50:23.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56aaa00640 1 -- 172.21.15.115:0/1107821513 learned_addr learned my addr 172.21.15.115:0/1107821513 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56ab400640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56ac1521e0 0x7f56ac147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f19c7600640 1 -- 172.21.15.115:0/2896464085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c006c4b0 msgr2=0x7f19c006c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f19c7600640 1 --2- 172.21.15.115:0/2896464085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c006c4b0 0x7f19c006c900 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009d90 tx=0x7f19b801f150 comp rx=0 tx=0).stop 2024-05-12T10:50:23.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56aaa00640 1 -- 172.21.15.115:0/1107821513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac0ca180 msgr2=0x7f56ac143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56aaa00640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac0ca180 0x7f56ac143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56aaa00640 1 -- 172.21.15.115:0/1107821513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56ac1521e0 msgr2=0x7f56ac147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56aaa00640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56ac1521e0 0x7f56ac147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56aaa00640 1 -- 172.21.15.115:0/1107821513 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac15af00 con 0x7f56ac072420 2024-05-12T10:50:23.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f19c7600640 1 -- 172.21.15.115:0/2896464085 shutdown_connections 2024-05-12T10:50:23.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f19c7600640 1 --2- 172.21.15.115:0/2896464085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c006c4b0 0x7f19c006c900 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f19c7600640 1 -- 172.21.15.115:0/2896464085 >> 172.21.15.115:0/2896464085 conn(0x7f19c00cae30 msgr2=0x7f19c00cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:23.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56aaa00640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56ac072420 0x7f56ac142cc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f569400c4b0 tx=0x7f569400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f19c7600640 1 -- 172.21.15.115:0/2896464085 shutdown_connections 2024-05-12T10:50:23.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f19c7600640 1 -- 172.21.15.115:0/2896464085 wait complete. 2024-05-12T10:50:23.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56a2a00640 1 -- 172.21.15.115:0/1107821513 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56940052d0 con 0x7f56ac072420 2024-05-12T10:50:23.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56a2a00640 1 -- 172.21.15.115:0/1107821513 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5694005470 con 0x7f56ac072420 2024-05-12T10:50:23.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56a2a00640 1 -- 172.21.15.115:0/1107821513 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5694012850 con 0x7f56ac072420 2024-05-12T10:50:23.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7fc129600640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc10c06f400 0x7fc10c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7fc129600640 1 -- 172.21.15.115:0/364578405 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc118129360 con 0x7fc12404d8d0 2024-05-12T10:50:23.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56b1800640 1 -- 172.21.15.115:0/1107821513 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac159a30 con 0x7f56ac072420 2024-05-12T10:50:23.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7f56b1800640 1 -- 172.21.15.115:0/1107821513 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac159ff0 con 0x7f56ac072420 2024-05-12T10:50:23.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7fc131800640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc10c06f400 0x7fc10c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7fc131800640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc10c06f400 0x7fc10c0718c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc12000ae10 tx=0x7fc120008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7fa4d0c00640 1 -- 172.21.15.115:0/4057070443 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa4c801a070 con 0x7fa4d40ca040 2024-05-12T10:50:23.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.949+0000 7fa4d0c00640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa4b806f4d0 0x7fa4b8071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c7600640 1 Processor -- start 2024-05-12T10:50:23.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c7600640 1 -- start start 2024-05-12T10:50:23.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7fa4d0c00640 1 -- 172.21.15.115:0/4057070443 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa4c808ec20 con 0x7fa4d40ca040 2024-05-12T10:50:23.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f569be00640 1 -- 172.21.15.115:0/1107821513 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567c0052a0 con 0x7f56ac072420 2024-05-12T10:50:23.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c7600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c006c4b0 0x7f19c0154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c7600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c006f070 0x7f19c01f99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c7600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19c015a3f0 0x7f19c00cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c7600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f19c015a7d0 con 0x7f19c006c4b0 2024-05-12T10:50:23.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c7600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19c0160ec0 con 0x7f19c006f070 2024-05-12T10:50:23.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c7600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f19c0074660 con 0x7f19c015a3f0 2024-05-12T10:50:23.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f56a2a00640 1 -- 172.21.15.115:0/1107821513 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f56940129f0 con 0x7f56ac072420 2024-05-12T10:50:23.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c4c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c006c4b0 0x7f19c0154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c4c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c006c4b0 0x7f19c0154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52890/0 (socket says 172.21.15.115:52890) 2024-05-12T10:50:23.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c4c00640 1 -- 172.21.15.115:0/1372532339 learned_addr learned my addr 172.21.15.115:0/1372532339 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:23.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c4c00640 1 -- 172.21.15.115:0/1372532339 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19c015a3f0 msgr2=0x7f19c00cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c4c00640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19c015a3f0 0x7f19c00cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c4c00640 1 -- 172.21.15.115:0/1372532339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c006f070 msgr2=0x7f19c01f99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:23.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c4c00640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c006f070 0x7f19c01f99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:23.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c4c00640 1 -- 172.21.15.115:0/1372532339 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c015b230 con 0x7f19c006c4b0 2024-05-12T10:50:23.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f56a2a00640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f568806f480 0x7f5688071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f56a2a00640 1 -- 172.21.15.115:0/1107821513 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f569408f080 con 0x7f56ac072420 2024-05-12T10:50:23.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7fa4d8e00640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa4b806f4d0 0x7fa4b8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f19c4c00640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c006c4b0 0x7f19c0154cc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00c340 tx=0x7f19ac00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7f56aa000640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f568806f480 0x7f5688071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.953+0000 7fa4d8e00640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa4b806f4d0 0x7fa4b8071990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40af000 tx=0x7fa4c40a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.957+0000 7f56aa000640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f568806f480 0x7f5688071940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f569c006aa0 tx=0x7f569c006a30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.957+0000 7f19bcc00640 1 -- 172.21.15.115:0/1372532339 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac017070 con 0x7f19c006c4b0 2024-05-12T10:50:23.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.957+0000 7f19bcc00640 1 -- 172.21.15.115:0/1372532339 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ac005cf0 con 0x7f19c006c4b0 2024-05-12T10:50:23.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.957+0000 7f19bcc00640 1 -- 172.21.15.115:0/1372532339 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac007310 con 0x7f19c006c4b0 2024-05-12T10:50:23.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.957+0000 7f19c7600640 1 -- 172.21.15.115:0/1372532339 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c015b4a0 con 0x7f19c006c4b0 2024-05-12T10:50:23.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.957+0000 7f19c7600640 1 -- 172.21.15.115:0/1372532339 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c01f91d0 con 0x7f19c006c4b0 2024-05-12T10:50:23.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.957+0000 7f56a2a00640 1 -- 172.21.15.115:0/1107821513 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f569405bd30 con 0x7f56ac072420 2024-05-12T10:50:23.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.961+0000 7f19c7600640 1 -- 172.21.15.115:0/1372532339 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c0069730 con 0x7f19c006c4b0 2024-05-12T10:50:23.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.961+0000 7f19bcc00640 1 -- 172.21.15.115:0/1372532339 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f19ac01a070 con 0x7f19c006c4b0 2024-05-12T10:50:23.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.961+0000 7f19bcc00640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f19a006f480 0x7f19a0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.961+0000 7f19bcc00640 1 -- 172.21.15.115:0/1372532339 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f19ac08e7a0 con 0x7f19c006c4b0 2024-05-12T10:50:23.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.961+0000 7f19bfe00640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f19a006f480 0x7f19a0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.961+0000 7f19bfe00640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f19a006f480 0x7f19a0071940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f19b4007fd0 tx=0x7f19b4007980 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.965+0000 7fc129600640 1 -- 172.21.15.115:0/364578405 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc118016150 con 0x7fc12404d8d0 2024-05-12T10:50:23.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.965+0000 7fa92e000640 1 -- 172.21.15.115:0/2909325990 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa92805c9f0 con 0x7fa93004aef0 2024-05-12T10:50:23.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.965+0000 7f3daa000640 1 -- 172.21.15.115:0/1339896795 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da4017070 con 0x7f3db4072d00 2024-05-12T10:50:23.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.965+0000 7f3daa000640 1 -- 172.21.15.115:0/1339896795 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da4003600 con 0x7f3db4072d00 2024-05-12T10:50:23.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.965+0000 7f3daa000640 1 -- 172.21.15.115:0/1339896795 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da40039f0 con 0x7f3db4072d00 2024-05-12T10:50:23.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.969+0000 7f3db8c00640 1 -- 172.21.15.115:0/1339896795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db413ffb0 con 0x7f3db4072d00 2024-05-12T10:50:23.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.969+0000 7f3db8c00640 1 -- 172.21.15.115:0/1339896795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db40cbb00 con 0x7f3db4072d00 2024-05-12T10:50:23.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.969+0000 7f19bcc00640 1 -- 172.21.15.115:0/1372532339 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f19ac05b550 con 0x7f19c006c4b0 2024-05-12T10:50:23.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.969+0000 7f3db8c00640 1 -- 172.21.15.115:0/1339896795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db4069e40 con 0x7f3db4072d00 2024-05-12T10:50:23.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.973+0000 7f3daa000640 1 -- 172.21.15.115:0/1339896795 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3da4003b90 con 0x7f3db4072d00 2024-05-12T10:50:23.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.973+0000 7f3daa000640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3d9006f400 0x7f3d900718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:23.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.973+0000 7f3daa000640 1 -- 172.21.15.115:0/1339896795 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3da408e950 con 0x7f3db4072d00 2024-05-12T10:50:23.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.973+0000 7f3db1e00640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3d9006f400 0x7f3d900718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:23.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.977+0000 7f3db1e00640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3d9006f400 0x7f3d900718c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3db40c5960 tx=0x7f3d9c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:23.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.985+0000 7fa4d0c00640 1 -- 172.21.15.115:0/4057070443 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa4c8021020 con 0x7fa4d40ca040 2024-05-12T10:50:23.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:23.993+0000 7f3daa000640 1 -- 172.21.15.115:0/1339896795 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3da405b600 con 0x7f3db4072d00 2024-05-12T10:50:24.265 INFO:teuthology.orchestra.run.smithi115.stdout:60129542153 2024-05-12T10:50:24.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.269+0000 7f569be00640 1 -- 172.21.15.115:0/1107821513 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f567c005590 con 0x7f56ac072420 2024-05-12T10:50:24.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.269+0000 7f56a2a00640 1 -- 172.21.15.115:0/1107821513 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f569405b630 con 0x7f56ac072420 2024-05-12T10:50:24.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 -- 172.21.15.115:0/1107821513 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f568806f480 msgr2=0x7f5688071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f568806f480 0x7f5688071940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f569c006aa0 tx=0x7f569c006a30 comp rx=0 tx=0).stop 2024-05-12T10:50:24.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 -- 172.21.15.115:0/1107821513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56ac072420 msgr2=0x7f56ac142cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56ac072420 0x7f56ac142cc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f569400c4b0 tx=0x7f569400c970 comp rx=0 tx=0).stop 2024-05-12T10:50:24.269 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 -- 172.21.15.115:0/1107821513 shutdown_connections 2024-05-12T10:50:24.269 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f568806f480 0x7f5688071940 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.269 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56ac1521e0 0x7f56ac147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.269 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac0ca180 0x7f56ac143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.269 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 --2- 172.21.15.115:0/1107821513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56ac072420 0x7f56ac142cc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.269 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 -- 172.21.15.115:0/1107821513 >> 172.21.15.115:0/1107821513 conn(0x7f56ac076830 msgr2=0x7f56ac0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:24.269 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 -- 172.21.15.115:0/1107821513 shutdown_connections 2024-05-12T10:50:24.269 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.273+0000 7f56b1800640 1 -- 172.21.15.115:0/1107821513 wait complete. 2024-05-12T10:50:24.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.277+0000 7fe806c00640 1 -- 172.21.15.115:0/3022218105 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe80014fd10 con 0x7fe80015c3d0 2024-05-12T10:50:24.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.277+0000 7fe7f7e00640 1 -- 172.21.15.115:0/3022218105 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe7f805bc40 con 0x7fe80015c3d0 2024-05-12T10:50:24.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.277+0000 7fd69fe00640 1 -- 172.21.15.115:0/2209924316 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd6b4069940 con 0x7fd6b415a1d0 2024-05-12T10:50:24.275 INFO:teuthology.orchestra.run.smithi115.stdout:60129542153 2024-05-12T10:50:24.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.281+0000 7fd6aaa00640 1 -- 172.21.15.115:0/2209924316 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd6a40fd030 con 0x7fd6b415a1d0 2024-05-12T10:50:24.276 INFO:teuthology.orchestra.run.smithi115.stdout:60129542155 2024-05-12T10:50:24.279 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 -- 172.21.15.115:0/3022218105 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe7e006f4d0 msgr2=0x7fe7e0071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 -- 172.21.15.115:0/2209924316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd69406f400 msgr2=0x7fd6940718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd69406f400 0x7fd6940718c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0007fd0 tx=0x7fd6a0009040 comp rx=0 tx=0).stop 2024-05-12T10:50:24.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 -- 172.21.15.115:0/2209924316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b415a1d0 msgr2=0x7fd6b41f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe7e006f4d0 0x7fe7e0071990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00af000 tx=0x7fe7f00a7000 comp rx=0 tx=0).stop 2024-05-12T10:50:24.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b415a1d0 0x7fd6b41f2380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40ac000 tx=0x7fd6a4019480 comp rx=0 tx=0).stop 2024-05-12T10:50:24.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 -- 172.21.15.115:0/3022218105 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 msgr2=0x7fe800140e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 0x7fe800140e40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800c730 tx=0x7fe7f800cbf0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 -- 172.21.15.115:0/2209924316 shutdown_connections 2024-05-12T10:50:24.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd69406f400 0x7fd6940718c0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0007fd0 tx=0x7fd6a0009040 comp rx=0 tx=0).stop 2024-05-12T10:50:24.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b415a1d0 0x7fd6b41f2380 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b40c9d50 0x7fd6b40ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 --2- 172.21.15.115:0/2209924316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6b40c6140 0x7fd6b40cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 -- 172.21.15.115:0/2209924316 >> 172.21.15.115:0/2209924316 conn(0x7fd6b4076830 msgr2=0x7fd6b40681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:24.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 -- 172.21.15.115:0/3022218105 shutdown_connections 2024-05-12T10:50:24.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe7e006f4d0 0x7fe7e0071990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe80015c3d0 0x7fe800140e40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe800155c80 0x7fe8001432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 --2- 172.21.15.115:0/3022218105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe80006fa10 0x7fe80015e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 -- 172.21.15.115:0/3022218105 >> 172.21.15.115:0/3022218105 conn(0x7fe800076430 msgr2=0x7fe80015a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:24.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 -- 172.21.15.115:0/3022218105 shutdown_connections 2024-05-12T10:50:24.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fe806c00640 1 -- 172.21.15.115:0/3022218105 wait complete. 2024-05-12T10:50:24.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 -- 172.21.15.115:0/2209924316 shutdown_connections 2024-05-12T10:50:24.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.285+0000 7fd69fe00640 1 -- 172.21.15.115:0/2209924316 wait complete. 2024-05-12T10:50:24.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.305+0000 7fa937200640 1 -- 172.21.15.115:0/2909325990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa9300d38b0 con 0x7fa93004aef0 2024-05-12T10:50:24.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.305+0000 7fa92e000640 1 -- 172.21.15.115:0/2909325990 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa92805c2f0 con 0x7fa93004aef0 2024-05-12T10:50:24.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.5 2024-05-12T10:50:24.304 INFO:teuthology.orchestra.run.smithi115.stdout:60129542153 2024-05-12T10:50:24.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.305+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc124038310 con 0x7fc12404d8d0 2024-05-12T10:50:24.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fc129600640 1 -- 172.21.15.115:0/364578405 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc1180f58b0 con 0x7fc12404d8d0 2024-05-12T10:50:24.305 INFO:teuthology.orchestra.run.smithi115.stdout:60129542152 2024-05-12T10:50:24.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fa937200640 1 -- 172.21.15.115:0/2909325990 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa91806f400 msgr2=0x7fa9180718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fa937200640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa91806f400 0x7fa9180718c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa93806b860 tx=0x7fa938051780 comp rx=0 tx=0).stop 2024-05-12T10:50:24.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fa937200640 1 -- 172.21.15.115:0/2909325990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa93004aef0 msgr2=0x7fa9300cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fa937200640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa93004aef0 0x7fa9300cee30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa92800c410 tx=0x7fa92800c8d0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fa937200640 1 -- 172.21.15.115:0/2909325990 shutdown_connections 2024-05-12T10:50:24.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fa937200640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa91806f400 0x7fa9180718c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fa937200640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9300d9020 0x7fa9300e1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fa937200640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa93004aef0 0x7fa9300cee30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fa937200640 1 --2- 172.21.15.115:0/2909325990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa930005ea0 0x7fa9300d5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fa937200640 1 -- 172.21.15.115:0/2909325990 >> 172.21.15.115:0/2909325990 conn(0x7fa930050190 msgr2=0x7fa93004c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:24.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7fa937200640 1 -- 172.21.15.115:0/2909325990 shutdown_connections 2024-05-12T10:50:24.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.309+0000 7f19c7600640 1 -- 172.21.15.115:0/1372532339 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f19c00741a0 con 0x7f19c006c4b0 2024-05-12T10:50:24.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fa937200640 1 -- 172.21.15.115:0/2909325990 wait complete. 2024-05-12T10:50:24.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7f19bcc00640 1 -- 172.21.15.115:0/1372532339 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f19ac05ae50 con 0x7f19c006c4b0 2024-05-12T10:50:24.309 INFO:teuthology.orchestra.run.smithi115.stdout:60129542153 2024-05-12T10:50:24.309 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc10c06f400 msgr2=0x7fc10c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc10c06f400 0x7fc10c0718c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc12000ae10 tx=0x7fc120008040 comp rx=0 tx=0).stop 2024-05-12T10:50:24.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc12404d8d0 msgr2=0x7fc1240dbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc12404d8d0 0x7fc1240dbc60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc1180af040 tx=0x7fc1180192e0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 shutdown_connections 2024-05-12T10:50:24.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc10c06f400 0x7fc10c0718c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1240d6dc0 0x7fc12404ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc12404d8d0 0x7fc1240dbc60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 --2- 172.21.15.115:0/364578405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc124047880 0x7fc124009450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 >> 172.21.15.115:0/364578405 conn(0x7fc12400e090 msgr2=0x7fc124005a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:24.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 shutdown_connections 2024-05-12T10:50:24.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.313+0000 7fc134200640 1 -- 172.21.15.115:0/364578405 wait complete. 2024-05-12T10:50:24.312 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 -- 172.21.15.115:0/1372532339 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f19a006f480 msgr2=0x7f19a0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.312 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f19a006f480 0x7f19a0071940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f19b4007fd0 tx=0x7f19b4007980 comp rx=0 tx=0).stop 2024-05-12T10:50:24.312 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 -- 172.21.15.115:0/1372532339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c006c4b0 msgr2=0x7f19c0154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.312 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c006c4b0 0x7f19c0154cc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00c340 tx=0x7f19ac00c800 comp rx=0 tx=0).stop 2024-05-12T10:50:24.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7fa4db800640 1 -- 172.21.15.115:0/4057070443 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa4d40c8d90 con 0x7fa4d40ca040 2024-05-12T10:50:24.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 -- 172.21.15.115:0/1372532339 shutdown_connections 2024-05-12T10:50:24.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f19a006f480 0x7f19a0071940 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19c015a3f0 0x7f19c00cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c006f070 0x7f19c01f99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 --2- 172.21.15.115:0/1372532339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c006c4b0 0x7f19c0154cc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 -- 172.21.15.115:0/1372532339 >> 172.21.15.115:0/1372532339 conn(0x7f19c00cae30 msgr2=0x7f19c00cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:24.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 -- 172.21.15.115:0/1372532339 shutdown_connections 2024-05-12T10:50:24.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.317+0000 7f19c7600640 1 -- 172.21.15.115:0/1372532339 wait complete. 2024-05-12T10:50:24.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.1 2024-05-12T10:50:24.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542155 for osd.4 2024-05-12T10:50:24.318 INFO:teuthology.orchestra.run.smithi115.stdout:60129542152 2024-05-12T10:50:24.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.321+0000 7fa4d0c00640 1 -- 172.21.15.115:0/4057070443 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa4c8005480 con 0x7fa4d40ca040 2024-05-12T10:50:24.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 -- 172.21.15.115:0/4057070443 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa4b806f4d0 msgr2=0x7fa4b8071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa4b806f4d0 0x7fa4b8071990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40af000 tx=0x7fa4c40a7000 comp rx=0 tx=0).stop 2024-05-12T10:50:24.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 -- 172.21.15.115:0/4057070443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 msgr2=0x7fa4d40c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 0x7fa4d40c7060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800c3f0 tx=0x7fa4c800c8b0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 -- 172.21.15.115:0/4057070443 shutdown_connections 2024-05-12T10:50:24.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa4b806f4d0 0x7fa4b8071990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4d4151cc0 0x7fa4d4141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4d40ca040 0x7fa4d40c7060 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 --2- 172.21.15.115:0/4057070443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4d40c8880 0x7fa4d41661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 -- 172.21.15.115:0/4057070443 >> 172.21.15.115:0/4057070443 conn(0x7fa4d4076830 msgr2=0x7fa4d40c4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:24.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 -- 172.21.15.115:0/4057070443 shutdown_connections 2024-05-12T10:50:24.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.325+0000 7fa4db800640 1 -- 172.21.15.115:0/4057070443 wait complete. 2024-05-12T10:50:24.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.333+0000 7f3db8c00640 1 -- 172.21.15.115:0/1339896795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3db414c110 con 0x7f3db4072d00 2024-05-12T10:50:24.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.333+0000 7f3daa000640 1 -- 172.21.15.115:0/1339896795 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3da405af00 con 0x7f3db4072d00 2024-05-12T10:50:24.328 INFO:teuthology.orchestra.run.smithi115.stdout:60129542153 2024-05-12T10:50:24.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 -- 172.21.15.115:0/1339896795 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3d9006f400 msgr2=0x7f3d900718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3d9006f400 0x7f3d900718c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3db40c5960 tx=0x7f3d9c0a6000 comp rx=0 tx=0).stop 2024-05-12T10:50:24.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 -- 172.21.15.115:0/1339896795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db4072d00 msgr2=0x7f3db40cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:24.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db4072d00 0x7f3db40cc300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3da400c4f0 tx=0x7f3da4001e80 comp rx=0 tx=0).stop 2024-05-12T10:50:24.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 -- 172.21.15.115:0/1339896795 shutdown_connections 2024-05-12T10:50:24.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3d9006f400 0x7f3d900718c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db40c7160 0x7f3db40cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db4072d00 0x7f3db40cc300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 --2- 172.21.15.115:0/1339896795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3db406ed10 0x7f3db4156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:24.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 -- 172.21.15.115:0/1339896795 >> 172.21.15.115:0/1339896795 conn(0x7f3db40ca350 msgr2=0x7f3db4151140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:24.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 -- 172.21.15.115:0/1339896795 shutdown_connections 2024-05-12T10:50:24.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:24.337+0000 7f3db8c00640 1 -- 172.21.15.115:0/1339896795 wait complete. 2024-05-12T10:50:24.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.0 2024-05-12T10:50:24.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.6 2024-05-12T10:50:24.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.2 2024-05-12T10:50:24.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.7 2024-05-12T10:50:24.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.3 2024-05-12T10:50:25.305 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-12T10:50:25.318 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-12T10:50:25.318 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-12T10:50:25.339 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-12T10:50:25.343 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-12T10:50:25.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-12T10:50:25.349 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-12T10:50:25.356 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-12T10:50:25.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.521+0000 7f37ffe00640 1 Processor -- start 2024-05-12T10:50:25.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.521+0000 7f37ffe00640 1 -- start start 2024-05-12T10:50:25.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.521+0000 7f37ffe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 0x7f38000723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.521+0000 7f37ffe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f38000736a0 0x7f3800072b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.521+0000 7f37ffe00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f38000730a0 0x7f3800157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.521+0000 7f37fea00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 0x7f38000723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.521+0000 7f37fea00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 0x7f38000723d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60288/0 (socket says 172.21.15.115:60288) 2024-05-12T10:50:25.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37ff400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f38000730a0 0x7f3800157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37ff400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f38000730a0 0x7f3800157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52896/0 (socket says 172.21.15.115:52896) 2024-05-12T10:50:25.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37ffe00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f38000cabb0 con 0x7f38000730a0 2024-05-12T10:50:25.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37fea00640 1 -- 172.21.15.115:0/3705422764 learned_addr learned my addr 172.21.15.115:0/3705422764 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37fe000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f38000736a0 0x7f3800072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37ffe00640 1 -- 172.21.15.115:0/3705422764 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f380015b180 con 0x7f38000736a0 2024-05-12T10:50:25.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37ffe00640 1 -- 172.21.15.115:0/3705422764 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f380015b440 con 0x7f3800151c60 2024-05-12T10:50:25.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37ff400640 1 -- 172.21.15.115:0/3705422764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 msgr2=0x7f38000723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:25.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37ff400640 1 --2- 172.21.15.115:0/3705422764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 0x7f38000723d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37ff400640 1 -- 172.21.15.115:0/3705422764 >> v2:172.21.15.134:3300/0 conn(0x7f38000736a0 msgr2=0x7f3800072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:25.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37ff400640 1 --2- 172.21.15.115:0/3705422764 >> v2:172.21.15.134:3300/0 conn(0x7f38000736a0 0x7f3800072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.525+0000 7f37ff400640 1 -- 172.21.15.115:0/3705422764 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380015b720 con 0x7f38000730a0 2024-05-12T10:50:25.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.529+0000 7f37ff400640 1 --2- 172.21.15.115:0/3705422764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38000730a0 0x7f3800157e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3800071c20 tx=0x7f37ec01ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0b54349b5eedcc server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37fd600640 1 -- 172.21.15.115:0/3705422764 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec0b5070 con 0x7f38000730a0 2024-05-12T10:50:25.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37fd600640 1 -- 172.21.15.115:0/3705422764 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ec0a8930 con 0x7f38000730a0 2024-05-12T10:50:25.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37fd600640 1 -- 172.21.15.115:0/3705422764 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec0a8d00 con 0x7f38000730a0 2024-05-12T10:50:25.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37ffe00640 1 -- 172.21.15.115:0/3705422764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38000730a0 msgr2=0x7f3800157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37ffe00640 1 --2- 172.21.15.115:0/3705422764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38000730a0 0x7f3800157e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3800071c20 tx=0x7f37ec01ec80 comp rx=0 tx=0).stop 2024-05-12T10:50:25.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37ffe00640 1 -- 172.21.15.115:0/3705422764 shutdown_connections 2024-05-12T10:50:25.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37ffe00640 1 --2- 172.21.15.115:0/3705422764 >> v2:172.21.15.134:3300/0 conn(0x7f38000736a0 0x7f3800072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37ffe00640 1 --2- 172.21.15.115:0/3705422764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38000730a0 0x7f3800157e60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37ffe00640 1 --2- 172.21.15.115:0/3705422764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 0x7f38000723d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37ffe00640 1 -- 172.21.15.115:0/3705422764 >> 172.21.15.115:0/3705422764 conn(0x7f3800076630 msgr2=0x7f380006e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37ffe00640 1 -- 172.21.15.115:0/3705422764 shutdown_connections 2024-05-12T10:50:25.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.537+0000 7f37ffe00640 1 -- 172.21.15.115:0/3705422764 wait complete. 2024-05-12T10:50:25.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.541+0000 7f37ffe00640 1 Processor -- start 2024-05-12T10:50:25.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.541+0000 7f37ffe00640 1 -- start start 2024-05-12T10:50:25.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37ffe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38000730a0 0x7f38000cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37ffe00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38000736a0 0x7f380014b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37ffe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 0x7f38000c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37ffe00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3800152040 con 0x7f38000730a0 2024-05-12T10:50:25.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37ffe00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f380015bce0 con 0x7f38000736a0 2024-05-12T10:50:25.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37ffe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f38001521c0 con 0x7f3800151c60 2024-05-12T10:50:25.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37ff400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 0x7f38000c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37ff400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 0x7f38000c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60294/0 (socket says 172.21.15.115:60294) 2024-05-12T10:50:25.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37ff400640 1 -- 172.21.15.115:0/941906260 learned_addr learned my addr 172.21.15.115:0/941906260 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37fe000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38000736a0 0x7f380014b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37fe000640 1 -- 172.21.15.115:0/941906260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 msgr2=0x7f38000c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37fe000640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 0x7f38000c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37fe000640 1 -- 172.21.15.115:0/941906260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38000730a0 msgr2=0x7f38000cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37fea00640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38000730a0 0x7f38000cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37fe000640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38000730a0 0x7f38000cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37fe000640 1 -- 172.21.15.115:0/941906260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38001f0f70 con 0x7f38000736a0 2024-05-12T10:50:25.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37fea00640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38000730a0 0x7f38000cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:25.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37fe000640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38000736a0 0x7f380014b670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f37f8014fd0 tx=0x7f37f80099d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37f6a00640 1 -- 172.21.15.115:0/941906260 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8024070 con 0x7f38000736a0 2024-05-12T10:50:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37ffe00640 1 -- 172.21.15.115:0/941906260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38001f0c90 con 0x7f38000736a0 2024-05-12T10:50:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37ffe00640 1 -- 172.21.15.115:0/941906260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f380014ab90 con 0x7f38000736a0 2024-05-12T10:50:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37f6a00640 1 -- 172.21.15.115:0/941906260 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f801f420 con 0x7f38000736a0 2024-05-12T10:50:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.545+0000 7f37f6a00640 1 -- 172.21.15.115:0/941906260 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f801f7d0 con 0x7f38000736a0 2024-05-12T10:50:25.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.549+0000 7f37ffe00640 1 -- 172.21.15.115:0/941906260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d80052a0 con 0x7f38000736a0 2024-05-12T10:50:25.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.549+0000 7f37f6a00640 1 -- 172.21.15.115:0/941906260 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f37f8027070 con 0x7f38000736a0 2024-05-12T10:50:25.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.553+0000 7f37f6a00640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f37e006f400 0x7f37e00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.553+0000 7f37f6a00640 1 -- 172.21.15.115:0/941906260 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f37f8097fe0 con 0x7f38000736a0 2024-05-12T10:50:25.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.553+0000 7f37fea00640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f37e006f400 0x7f37e00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.557+0000 7f37fea00640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f37e006f400 0x7f37e00718c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f37f000f860 tx=0x7f37f0011040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.565+0000 7f37f6a00640 1 -- 172.21.15.115:0/941906260 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f37f8064640 con 0x7f38000736a0 2024-05-12T10:50:25.570 INFO:tasks.ceph.mds.b.smithi134.stderr:2024-05-12T10:50:25.576+0000 7f9f96df4640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-12T10:50:25.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.593+0000 7ff213a00640 1 Processor -- start 2024-05-12T10:50:25.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.593+0000 7ff213a00640 1 -- start start 2024-05-12T10:50:25.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.593+0000 7ff213a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff20c0b70f0 0x7ff20c0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.593+0000 7ff213a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff20c0cc6a0 0x7ff20c06cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.593+0000 7ff213a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff20c0cdbe0 con 0x7ff20c155ec0 2024-05-12T10:50:25.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.593+0000 7ff213a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7ff20c06c810 con 0x7ff20c0cc6a0 2024-05-12T10:50:25.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.593+0000 7ff213a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff20c15be60 con 0x7ff20c0b70f0 2024-05-12T10:50:25.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff211000640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff20c155ec0 0x7ff20c0cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53120/0 (socket says 172.21.15.115:53120) 2024-05-12T10:50:25.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff211000640 1 -- 172.21.15.115:0/1219978821 learned_addr learned my addr 172.21.15.115:0/1219978821 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:25.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20be00640 1 --2- 172.21.15.115:0/1219978821 >> v2:172.21.15.134:3300/0 conn(0x7ff20c0b70f0 0x7ff20c0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7f71fee00640 1 Processor -- start 2024-05-12T10:50:25.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4091715079 0 0) 0x7ff20c0cdbe0 con 0x7ff20c155ec0 2024-05-12T10:50:25.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1f0003530 con 0x7ff20c155ec0 2024-05-12T10:50:25.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7f71fee00640 1 -- start start 2024-05-12T10:50:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3646062790 0 0) 0x7ff1f0003530 con 0x7ff20c155ec0 2024-05-12T10:50:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 >> v2:172.21.15.134:3300/0 conn(0x7ff20c0b70f0 msgr2=0x7ff20c0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 --2- 172.21.15.115:0/1219978821 >> v2:172.21.15.134:3300/0 conn(0x7ff20c0b70f0 0x7ff20c0cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 >> v2:172.21.15.115:3300/0 conn(0x7ff20c0cc6a0 msgr2=0x7ff20c06cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 --2- 172.21.15.115:0/1219978821 >> v2:172.21.15.115:3300/0 conn(0x7ff20c0cc6a0 0x7ff20c06cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20c15c140 con 0x7ff20c155ec0 2024-05-12T10:50:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7ff204001aa0 con 0x7ff20c155ec0 2024-05-12T10:50:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 >> v1:172.21.15.115:6789/0 conn(0x7ff20c155ec0 legacy=0x7ff20c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 --2- 172.21.15.115:0/1219978821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f0003a60 0x7ff1f0003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 --2- 172.21.15.115:0/1219978821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1f0004810 0x7ff1f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 --2- 172.21.15.115:0/1219978821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f00053d0 0x7ff1f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff20c06c810 con 0x7ff1f0003a60 2024-05-12T10:50:25.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff20c15be60 con 0x7ff1f00053d0 2024-05-12T10:50:25.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f000c300 con 0x7ff1f0004810 2024-05-12T10:50:25.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.597+0000 7ff211000640 1 --2- 172.21.15.115:0/1219978821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f0003a60 0x7ff1f0003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71fee00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71f8072230 0x7f71f806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71fee00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f71f806ff50 0x7f71f8070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71fee00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f80c82e0 con 0x7f71f81519b0 2024-05-12T10:50:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71fee00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f71f80c9380 con 0x7f71f8072230 2024-05-12T10:50:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71f7e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f71f81519b0 0x7f71f81584c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:56174/0 (socket says 172.21.15.115:56174) 2024-05-12T10:50:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71f7e00640 1 -- 172.21.15.115:0/3985645175 learned_addr learned my addr 172.21.15.115:0/3985645175 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71fee00640 1 -- 172.21.15.115:0/3985645175 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f71f80c9f00 con 0x7f71f806ff50 2024-05-12T10:50:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7ff211a00640 1 --2- 172.21.15.115:0/1219978821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f00053d0 0x7ff1f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7ff211000640 1 -- 172.21.15.115:0/1219978821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1f0004810 msgr2=0x7ff1f0004c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-12T10:50:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7ff211000640 1 --2- 172.21.15.115:0/1219978821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1f0004810 0x7ff1f0004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7ff211000640 1 -- 172.21.15.115:0/1219978821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f00053d0 msgr2=0x7ff1f000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:25.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7ff211000640 1 --2- 172.21.15.115:0/1219978821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f00053d0 0x7ff1f000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7ff211000640 1 -- 172.21.15.115:0/1219978821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f0003530 con 0x7ff1f0003a60 2024-05-12T10:50:25.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7ff211a00640 1 -- 172.21.15.115:0/1219978821 reap_dead start 2024-05-12T10:50:25.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71f7400640 1 --2- 172.21.15.115:0/3985645175 >> v2:172.21.15.115:3300/0 conn(0x7f71f8072230 0x7f71f806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71f7400640 1 -- 172.21.15.115:0/3985645175 >> v2:172.21.15.134:3300/0 conn(0x7f71f806ff50 msgr2=0x7f71f8070380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-12T10:50:25.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71f7400640 1 --2- 172.21.15.115:0/3985645175 >> v2:172.21.15.134:3300/0 conn(0x7f71f806ff50 0x7f71f8070380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71f6a00640 1 -- 172.21.15.115:0/3985645175 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3572251582 0 0) 0x7f71f80c82e0 con 0x7f71f81519b0 2024-05-12T10:50:25.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71f7400640 1 -- 172.21.15.115:0/3985645175 >> v1:172.21.15.134:6789/0 conn(0x7f71f81519b0 legacy=0x7f71f81584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f9479800640 1 Processor -- start 2024-05-12T10:50:25.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f71f7400640 1 -- 172.21.15.115:0/3985645175 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f80c95d0 con 0x7f71f8072230 2024-05-12T10:50:25.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f9479800640 1 -- start start 2024-05-12T10:50:25.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.601+0000 7f3849000640 1 Processor -- start 2024-05-12T10:50:25.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f3849000640 1 -- start start 2024-05-12T10:50:25.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9479800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94740c9a70 0x7f9474151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9479800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f94740688d0 0x7f9474152010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9479800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9474157f10 con 0x7f9474072420 2024-05-12T10:50:25.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9479800640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f9474158b20 con 0x7f94740c9a70 2024-05-12T10:50:25.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9479800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f94741581f0 con 0x7f94740688d0 2024-05-12T10:50:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f3849000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3844070900 0x7f3844073aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f3849000640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3844160870 con 0x7f3844070ce0 2024-05-12T10:50:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f3849000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3844160b10 con 0x7f38440c9a50 2024-05-12T10:50:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f3849000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3844073fe0 con 0x7f3844070900 2024-05-12T10:50:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7ff211000640 1 --2- 172.21.15.115:0/1219978821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f0003a60 0x7ff1f0003e80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff20400a880 tx=0x7ff20401fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4a37ebb214bda server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9472000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94740c9a70 0x7f9474151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9472000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94740c9a70 0x7f9474151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52940/0 (socket says 172.21.15.115:52940) 2024-05-12T10:50:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9472000640 1 -- 172.21.15.115:0/2371410177 learned_addr learned my addr 172.21.15.115:0/2371410177 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9473400640 1 --2- 172.21.15.115:0/2371410177 >> v2:172.21.15.134:3300/0 conn(0x7f94740688d0 0x7f9474152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9472000640 1 -- 172.21.15.115:0/2371410177 >> v2:172.21.15.134:3300/0 conn(0x7f94740688d0 msgr2=0x7f9474152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9472000640 1 --2- 172.21.15.115:0/2371410177 >> v2:172.21.15.134:3300/0 conn(0x7f94740688d0 0x7f9474152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9472000640 1 -- 172.21.15.115:0/2371410177 >> v1:172.21.15.134:6789/0 conn(0x7f9474072420 legacy=0x7f94740c9f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-12T10:50:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f9472000640 1 -- 172.21.15.115:0/2371410177 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94741584d0 con 0x7f94740c9a70 2024-05-12T10:50:25.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f3842a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3844070ce0 0x7f3844159aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53134/0 (socket says 172.21.15.115:53134) 2024-05-12T10:50:25.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20400a4d0 con 0x7ff1f0003a60 2024-05-12T10:50:25.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2040aa6f0 con 0x7ff1f0003a60 2024-05-12T10:50:25.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7ff20b400640 1 -- 172.21.15.115:0/1219978821 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2040aab20 con 0x7ff1f0003a60 2024-05-12T10:50:25.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f3842a00640 1 -- 172.21.15.115:0/1969820406 learned_addr learned my addr 172.21.15.115:0/1969820406 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:25.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f3843e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f38440c9a50 0x7f384416a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:56194/0 (socket says 172.21.15.115:56194) 2024-05-12T10:50:25.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.605+0000 7f3843400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3844070900 0x7f3844073aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71f7400640 1 --2- 172.21.15.115:0/3985645175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f8072230 0x7f71f806fa10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71f8068ef0 tx=0x7f71f001ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b702391f09eae0f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f2a22e00640 1 Processor -- start 2024-05-12T10:50:25.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71f6a00640 1 -- 172.21.15.115:0/3985645175 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f00b3070 con 0x7f71f8072230 2024-05-12T10:50:25.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f3843400640 1 -- 172.21.15.115:0/1969820406 >> v1:172.21.15.134:6789/0 conn(0x7f38440c9a50 legacy=0x7f384416a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f3843400640 1 -- 172.21.15.115:0/1969820406 >> v1:172.21.15.115:6789/0 conn(0x7f3844070ce0 legacy=0x7f3844159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f2a22e00640 1 -- start start 2024-05-12T10:50:25.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7ff213a00640 1 -- 172.21.15.115:0/1219978821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f0003a60 msgr2=0x7ff1f0003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7ff213a00640 1 --2- 172.21.15.115:0/1219978821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f0003a60 0x7ff1f0003e80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff20400a880 tx=0x7ff20401fa40 comp rx=0 tx=0).stop 2024-05-12T10:50:25.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71f6a00640 1 -- 172.21.15.115:0/3985645175 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f000a2d0 con 0x7f71f8072230 2024-05-12T10:50:25.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71f6a00640 1 -- 172.21.15.115:0/3985645175 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f000a6a0 con 0x7f71f8072230 2024-05-12T10:50:25.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71fee00640 1 -- 172.21.15.115:0/3985645175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f8072230 msgr2=0x7f71f806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71fee00640 1 --2- 172.21.15.115:0/3985645175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f8072230 0x7f71f806fa10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71f8068ef0 tx=0x7f71f001ef30 comp rx=0 tx=0).stop 2024-05-12T10:50:25.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71fee00640 1 -- 172.21.15.115:0/3985645175 shutdown_connections 2024-05-12T10:50:25.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71fee00640 1 --2- 172.21.15.115:0/3985645175 >> v2:172.21.15.134:3300/0 conn(0x7f71f806ff50 0x7f71f8070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71fee00640 1 --2- 172.21.15.115:0/3985645175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f8072230 0x7f71f806fa10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71fee00640 1 -- 172.21.15.115:0/3985645175 >> 172.21.15.115:0/3985645175 conn(0x7f71f8076430 msgr2=0x7f71f80681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f2a22e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c152a10 0x7f2a1c159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71fee00640 1 -- 172.21.15.115:0/3985645175 shutdown_connections 2024-05-12T10:50:25.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f71fee00640 1 -- 172.21.15.115:0/3985645175 wait complete. 2024-05-12T10:50:25.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f2a22e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2a1c152df0 0x7f2a1c073d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f9472000640 1 --2- 172.21.15.115:0/2371410177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94740c9a70 0x7f9474151ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f94740c4840 tx=0x7f946001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5ddc0498b88a46 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f2a22e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a1c15be20 con 0x7f2a1c073820 2024-05-12T10:50:25.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f2a22e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1c072cf0 con 0x7f2a1c152df0 2024-05-12T10:50:25.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f2a22e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1c072fd0 con 0x7f2a1c152a10 2024-05-12T10:50:25.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f2a1be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c152a10 0x7f2a1c159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f2a1be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c152a10 0x7f2a1c159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60306/0 (socket says 172.21.15.115:60306) 2024-05-12T10:50:25.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f2a1be00640 1 -- 172.21.15.115:0/2324908673 learned_addr learned my addr 172.21.15.115:0/2324908673 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f2a1b400640 1 --2- 172.21.15.115:0/2324908673 >> v2:172.21.15.134:3300/0 conn(0x7f2a1c152df0 0x7f2a1c073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f2a1be00640 1 -- 172.21.15.115:0/2324908673 >> v2:172.21.15.134:3300/0 conn(0x7f2a1c152df0 msgr2=0x7f2a1c073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:25.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f2a1be00640 1 --2- 172.21.15.115:0/2324908673 >> v2:172.21.15.134:3300/0 conn(0x7f2a1c152df0 0x7f2a1c073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f2a1be00640 1 -- 172.21.15.115:0/2324908673 >> v1:172.21.15.134:6789/0 conn(0x7f2a1c073820 legacy=0x7f2a1c15c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f2a1be00640 1 -- 172.21.15.115:0/2324908673 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c0c4990 con 0x7f2a1c152a10 2024-05-12T10:50:25.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.609+0000 7f3843400640 1 -- 172.21.15.115:0/1969820406 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3844072ce0 con 0x7f3844070900 2024-05-12T10:50:25.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f9471600640 1 -- 172.21.15.115:0/2371410177 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600b5070 con 0x7f94740c9a70 2024-05-12T10:50:25.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f9471600640 1 -- 172.21.15.115:0/2371410177 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94600a89d0 con 0x7f94740c9a70 2024-05-12T10:50:25.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7ff213a00640 1 -- 172.21.15.115:0/1219978821 shutdown_connections 2024-05-12T10:50:25.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7ff213a00640 1 --2- 172.21.15.115:0/1219978821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1f0003a60 0x7ff1f0003e80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7ff213a00640 1 -- 172.21.15.115:0/1219978821 >> 172.21.15.115:0/1219978821 conn(0x7ff20c073b70 msgr2=0x7ff20c073f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f9471600640 1 -- 172.21.15.115:0/2371410177 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600a8da0 con 0x7f94740c9a70 2024-05-12T10:50:25.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7ff213a00640 1 -- 172.21.15.115:0/1219978821 shutdown_connections 2024-05-12T10:50:25.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f71fee00640 1 Processor -- start 2024-05-12T10:50:25.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f71fee00640 1 -- start start 2024-05-12T10:50:25.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f9479800640 1 -- 172.21.15.115:0/2371410177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94740c9a70 msgr2=0x7f9474151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f9479800640 1 --2- 172.21.15.115:0/2371410177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94740c9a70 0x7f9474151ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f94740c4840 tx=0x7f946001ed10 comp rx=0 tx=0).stop 2024-05-12T10:50:25.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f9479800640 1 -- 172.21.15.115:0/2371410177 shutdown_connections 2024-05-12T10:50:25.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f9479800640 1 --2- 172.21.15.115:0/2371410177 >> v2:172.21.15.134:3300/0 conn(0x7f94740688d0 0x7f9474152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f9479800640 1 --2- 172.21.15.115:0/2371410177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94740c9a70 0x7f9474151ad0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f9479800640 1 -- 172.21.15.115:0/2371410177 >> 172.21.15.115:0/2371410177 conn(0x7f9474076830 msgr2=0x7f94740681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f71fee00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71f806ff50 0x7f71f8073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f71fee00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71f8072230 0x7f71f814c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f71fee00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f81519b0 0x7f71f81f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f71fee00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8151f10 con 0x7f71f81519b0 2024-05-12T10:50:25.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f71fee00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8151d90 con 0x7f71f8072230 2024-05-12T10:50:25.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f71fee00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f71f80726a0 con 0x7f71f806ff50 2024-05-12T10:50:25.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71f7e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71f806ff50 0x7f71f8073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71f7400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71f8072230 0x7f71f814c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71f7e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71f806ff50 0x7f71f8073580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60314/0 (socket says 172.21.15.115:60314) 2024-05-12T10:50:25.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71f7e00640 1 -- 172.21.15.115:0/1263865656 learned_addr learned my addr 172.21.15.115:0/1263865656 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f9479800640 1 -- 172.21.15.115:0/2371410177 shutdown_connections 2024-05-12T10:50:25.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7f9479800640 1 -- 172.21.15.115:0/2371410177 wait complete. 2024-05-12T10:50:25.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.613+0000 7ff213a00640 1 -- 172.21.15.115:0/1219978821 wait complete. 2024-05-12T10:50:25.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7ff213a00640 1 Processor -- start 2024-05-12T10:50:25.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71fce00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f81519b0 0x7f71f81f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71f7e00640 1 -- 172.21.15.115:0/1263865656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71f8072230 msgr2=0x7f71f814c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71f7e00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71f8072230 0x7f71f814c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71f7e00640 1 -- 172.21.15.115:0/1263865656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f81519b0 msgr2=0x7f71f81f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71f7e00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f81519b0 0x7f71f81f5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71f7e00640 1 -- 172.21.15.115:0/1263865656 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f81e9f20 con 0x7f71f806ff50 2024-05-12T10:50:25.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71fce00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f81519b0 0x7f71f81f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:25.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71f7e00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71f806ff50 0x7f71f8073580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71e400c480 tx=0x7f71e400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7ff213a00640 1 -- start start 2024-05-12T10:50:25.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f82d1200640 1 Processor -- start 2024-05-12T10:50:25.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71efe00640 1 -- 172.21.15.115:0/1263865656 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4018070 con 0x7f71f806ff50 2024-05-12T10:50:25.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71fee00640 1 -- 172.21.15.115:0/1263865656 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f814cff0 con 0x7f71f806ff50 2024-05-12T10:50:25.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71efe00640 1 -- 172.21.15.115:0/1263865656 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e40074e0 con 0x7f71f806ff50 2024-05-12T10:50:25.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71efe00640 1 -- 172.21.15.115:0/1263865656 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4004a30 con 0x7f71f806ff50 2024-05-12T10:50:25.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f82d1200640 1 -- start start 2024-05-12T10:50:25.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f71fee00640 1 -- 172.21.15.115:0/1263865656 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f814d5b0 con 0x7f71f806ff50 2024-05-12T10:50:25.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f9479800640 1 Processor -- start 2024-05-12T10:50:25.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f9479800640 1 -- start start 2024-05-12T10:50:25.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7ff213a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1f0003a60 0x7ff20c0c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7ff213a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff20c0c6790 0x7ff20c1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f2a1be00640 1 --2- 172.21.15.115:0/2324908673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c152a10 0x7f2a1c159310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c009870 tx=0x7f2a0c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53118448f9c2f3e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7ff211000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1f0003a60 0x7ff20c0c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7ff20be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff20c0c6790 0x7ff20c1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7ff20be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff20c0c6790 0x7ff20c1583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52954/0 (socket says 172.21.15.115:52954) 2024-05-12T10:50:25.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7ff211000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1f0003a60 0x7ff20c0c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60326/0 (socket says 172.21.15.115:60326) 2024-05-12T10:50:25.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f3843400640 1 --2- 172.21.15.115:0/1969820406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3844070900 0x7f3844073aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38300097c0 tx=0x7f383001c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28d7b0c42dce11d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f2a1aa00640 1 -- 172.21.15.115:0/2324908673 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0b5070 con 0x7f2a1c152a10 2024-05-12T10:50:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f2a1aa00640 1 -- 172.21.15.115:0/2324908673 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0c0a8a50 con 0x7f2a1c152a10 2024-05-12T10:50:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7f2a1aa00640 1 -- 172.21.15.115:0/2324908673 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0a8e20 con 0x7f2a1c152a10 2024-05-12T10:50:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7ff20be00640 1 -- 172.21.15.115:0/3916117925 learned_addr learned my addr 172.21.15.115:0/3916117925 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.617+0000 7ff213a00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff20c158930 0x7ff20c157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff20c15c9e0 con 0x7ff20c0c6790 2024-05-12T10:50:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f3842000640 1 -- 172.21.15.115:0/1969820406 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38300b0070 con 0x7f3844070900 2024-05-12T10:50:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f3842000640 1 -- 172.21.15.115:0/1969820406 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38300ab600 con 0x7f3844070900 2024-05-12T10:50:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f3842000640 1 -- 172.21.15.115:0/1969820406 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38300ab9d0 con 0x7f3844070900 2024-05-12T10:50:25.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82d1200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152a10 0x7f82cc159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82d1200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f82cc152df0 0x7f82cc073d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9479800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94740688d0 0x7f947414b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82d1200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f82cc073820 0x7f82cc0742b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82d1200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f82cc15be20 con 0x7f82cc152df0 2024-05-12T10:50:25.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82d1200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f82cc072cf0 con 0x7f82cc073820 2024-05-12T10:50:25.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9479800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9474072420 0x7f94741f9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9479800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94740c9a70 0x7f94741597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82d1200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f82cc072fd0 con 0x7f82cc152a10 2024-05-12T10:50:25.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9472a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94740688d0 0x7f947414b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9472a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94740688d0 0x7f947414b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60328/0 (socket says 172.21.15.115:60328) 2024-05-12T10:50:25.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9472000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9474072420 0x7f94741f9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9472a00640 1 -- 172.21.15.115:0/1956258009 learned_addr learned my addr 172.21.15.115:0/1956258009 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f94740ca630 con 0x7f94740c9a70 2024-05-12T10:50:25.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9474073050 con 0x7f9474072420 2024-05-12T10:50:25.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f94740ca7b0 con 0x7f94740688d0 2024-05-12T10:50:25.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7ff211a00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff20c158930 0x7ff20c157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff20c15c700 con 0x7ff20c158930 2024-05-12T10:50:25.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff20c1562a0 con 0x7ff1f0003a60 2024-05-12T10:50:25.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f2a22e00640 1 -- 172.21.15.115:0/2324908673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c152a10 msgr2=0x7f2a1c159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f2a22e00640 1 --2- 172.21.15.115:0/2324908673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c152a10 0x7f2a1c159310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c009870 tx=0x7f2a0c01ed50 comp rx=0 tx=0).stop 2024-05-12T10:50:25.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82c9e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152a10 0x7f82cc159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f71fee00640 1 -- 172.21.15.115:0/1263865656 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f8069730 con 0x7f71f806ff50 2024-05-12T10:50:25.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9473400640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94740c9a70 0x7f94741597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9472000640 1 -- 172.21.15.115:0/1956258009 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94740688d0 msgr2=0x7f947414b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9472000640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94740688d0 0x7f947414b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9472000640 1 -- 172.21.15.115:0/1956258009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94740c9a70 msgr2=0x7f94741597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9472000640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94740c9a70 0x7f94741597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9472000640 1 -- 172.21.15.115:0/1956258009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94741fa1f0 con 0x7f9474072420 2024-05-12T10:50:25.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9472a00640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94740688d0 0x7f947414b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:25.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9473400640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94740c9a70 0x7f94741597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:25.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7ff211000640 1 -- 172.21.15.115:0/3916117925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff20c158930 msgr2=0x7ff20c157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7ff211000640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff20c158930 0x7ff20c157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7ff211000640 1 -- 172.21.15.115:0/3916117925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff20c0c6790 msgr2=0x7ff20c1583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7ff211000640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff20c0c6790 0x7ff20c1583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7ff211000640 1 -- 172.21.15.115:0/3916117925 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20c159160 con 0x7ff1f0003a60 2024-05-12T10:50:25.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7ff211a00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff20c158930 0x7ff20c157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:25.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f3849000640 1 -- 172.21.15.115:0/1969820406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3844070900 msgr2=0x7f3844073aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f3849000640 1 --2- 172.21.15.115:0/1969820406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3844070900 0x7f3844073aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38300097c0 tx=0x7f383001c430 comp rx=0 tx=0).stop 2024-05-12T10:50:25.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f3849000640 1 -- 172.21.15.115:0/1969820406 shutdown_connections 2024-05-12T10:50:25.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f71efe00640 1 -- 172.21.15.115:0/1263865656 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f71e401b070 con 0x7f71f806ff50 2024-05-12T10:50:25.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f2a22e00640 1 -- 172.21.15.115:0/2324908673 shutdown_connections 2024-05-12T10:50:25.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f2a22e00640 1 --2- 172.21.15.115:0/2324908673 >> v2:172.21.15.134:3300/0 conn(0x7f2a1c152df0 0x7f2a1c073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f2a22e00640 1 --2- 172.21.15.115:0/2324908673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c152a10 0x7f2a1c159310 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f2a22e00640 1 -- 172.21.15.115:0/2324908673 >> 172.21.15.115:0/2324908673 conn(0x7f2a1c076830 msgr2=0x7f2a1c0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f2a22e00640 1 -- 172.21.15.115:0/2324908673 shutdown_connections 2024-05-12T10:50:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f2a22e00640 1 -- 172.21.15.115:0/2324908673 wait complete. 2024-05-12T10:50:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82c9e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152a10 0x7f82cc159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60336/0 (socket says 172.21.15.115:60336) 2024-05-12T10:50:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82c9e00640 1 -- 172.21.15.115:0/2237787891 learned_addr learned my addr 172.21.15.115:0/2237787891 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82ca800640 1 --2- 172.21.15.115:0/2237787891 >> v2:172.21.15.134:3300/0 conn(0x7f82cc073820 0x7f82cc0742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82c9e00640 1 -- 172.21.15.115:0/2237787891 >> v2:172.21.15.134:3300/0 conn(0x7f82cc073820 msgr2=0x7f82cc0742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82c9e00640 1 --2- 172.21.15.115:0/2237787891 >> v2:172.21.15.134:3300/0 conn(0x7f82cc073820 0x7f82cc0742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82c9400640 1 --2- 172.21.15.115:0/2237787891 >> v2:172.21.15.115:3300/0 conn(0x7f82cc152df0 0x7f82cc073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82c9e00640 1 -- 172.21.15.115:0/2237787891 >> v2:172.21.15.115:3300/0 conn(0x7f82cc152df0 msgr2=0x7f82cc073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82c9e00640 1 --2- 172.21.15.115:0/2237787891 >> v2:172.21.15.115:3300/0 conn(0x7f82cc152df0 0x7f82cc073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f71efe00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f71d806f4d0 0x7f71d8071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82c9e00640 1 -- 172.21.15.115:0/2237787891 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82cc0c4990 con 0x7f82cc152a10 2024-05-12T10:50:25.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f9472000640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9474072420 0x7f94741f9cb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f94600af000 tx=0x7f946001bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f3849000640 1 --2- 172.21.15.115:0/1969820406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3844070900 0x7f3844073aa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f3849000640 1 -- 172.21.15.115:0/1969820406 >> 172.21.15.115:0/1969820406 conn(0x7f384406f1b0 msgr2=0x7f38440cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f71efe00640 1 -- 172.21.15.115:0/1263865656 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f71e408e910 con 0x7f71f806ff50 2024-05-12T10:50:25.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7ff211000640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1f0003a60 0x7ff20c0c5fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000c250 tx=0x7ff1f0005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f3849000640 1 -- 172.21.15.115:0/1969820406 shutdown_connections 2024-05-12T10:50:25.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f71f7400640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f71d806f4d0 0x7f71d8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f3849000640 1 -- 172.21.15.115:0/1969820406 wait complete. 2024-05-12T10:50:25.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.621+0000 7f82c9400640 1 --2- 172.21.15.115:0/2237787891 >> v2:172.21.15.115:3300/0 conn(0x7f82cc152df0 0x7f82cc073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:25.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f946aa00640 1 -- 172.21.15.115:0/1956258009 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600be070 con 0x7f9474072420 2024-05-12T10:50:25.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f946aa00640 1 -- 172.21.15.115:0/1956258009 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94600b0720 con 0x7f9474072420 2024-05-12T10:50:25.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f946aa00640 1 -- 172.21.15.115:0/1956258009 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600b5040 con 0x7f9474072420 2024-05-12T10:50:25.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94740cb330 con 0x7f9474072420 2024-05-12T10:50:25.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94741f63c0 con 0x7f9474072420 2024-05-12T10:50:25.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f71f7400640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f71d806f4d0 0x7f71d8071990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71f00b0000 tx=0x7f71f00a9000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f3849000640 1 Processor -- start 2024-05-12T10:50:25.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f2a22e00640 1 Processor -- start 2024-05-12T10:50:25.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f3849000640 1 -- start start 2024-05-12T10:50:25.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9474069730 con 0x7f9474072420 2024-05-12T10:50:25.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f2a22e00640 1 -- start start 2024-05-12T10:50:25.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f82c9e00640 1 --2- 172.21.15.115:0/2237787891 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152a10 0x7f82cc159310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f82cc06f490 tx=0x7f82bc01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d56ab34d4a9fc11 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f3849000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3844070900 0x7f38440cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f3849000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3844070ce0 0x7f38440cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f2a22e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c073820 0x7f2a1c1f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f3849000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38440c9a50 0x7f38440cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f3849000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f38440687b0 con 0x7f3844070900 2024-05-12T10:50:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f2a22e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c152a10 0x7f2a1c14e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f3849000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3844068630 con 0x7f38440c9a50 2024-05-12T10:50:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f3849000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f384415a1b0 con 0x7f3844070ce0 2024-05-12T10:50:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f3843400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3844070900 0x7f38440cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.625+0000 7f3843400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3844070900 0x7f38440cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52968/0 (socket says 172.21.15.115:52968) 2024-05-12T10:50:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3843400640 1 -- 172.21.15.115:0/4264747789 learned_addr learned my addr 172.21.15.115:0/4264747789 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a1be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c073820 0x7f2a1c1f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a1be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c073820 0x7f2a1c1f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60352/0 (socket says 172.21.15.115:60352) 2024-05-12T10:50:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a1b400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c152a10 0x7f2a1c14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3842a00640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3844070ce0 0x7f38440cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a1b400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c152a10 0x7f2a1c14e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41736/0 (socket says 172.21.15.115:41736) 2024-05-12T10:50:25.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3843e00640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38440c9a50 0x7f38440cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f946aa00640 1 -- 172.21.15.115:0/1956258009 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f94600b0b10 con 0x7f9474072420 2024-05-12T10:50:25.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3843400640 1 -- 172.21.15.115:0/4264747789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3844070ce0 msgr2=0x7f38440cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3843400640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3844070ce0 0x7f38440cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3843400640 1 -- 172.21.15.115:0/4264747789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38440c9a50 msgr2=0x7f38440cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3843400640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38440c9a50 0x7f38440cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3843400640 1 -- 172.21.15.115:0/4264747789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3844149f60 con 0x7f3844070900 2024-05-12T10:50:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3843400640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3844070900 0x7f38440cd560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3830019040 tx=0x7f383001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f383b400640 1 -- 172.21.15.115:0/4264747789 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38300b0050 con 0x7f3844070900 2024-05-12T10:50:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3849000640 1 -- 172.21.15.115:0/4264747789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384414a220 con 0x7f3844070900 2024-05-12T10:50:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3849000640 1 -- 172.21.15.115:0/4264747789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38440cbbb0 con 0x7f3844070900 2024-05-12T10:50:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a22e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a1c152df0 0x7f2a1c150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a22e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c073460 con 0x7f2a1c152df0 2024-05-12T10:50:25.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a22e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c0c4f50 con 0x7f2a1c152a10 2024-05-12T10:50:25.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a22e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1c0735e0 con 0x7f2a1c073820 2024-05-12T10:50:25.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a20e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a1c152df0 0x7f2a1c150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a20e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a1c152df0 0x7f2a1c150060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52980/0 (socket says 172.21.15.115:52980) 2024-05-12T10:50:25.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a20e00640 1 -- 172.21.15.115:0/2915676438 learned_addr learned my addr 172.21.15.115:0/2915676438 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f383b400640 1 -- 172.21.15.115:0/4264747789 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38300bc070 con 0x7f3844070900 2024-05-12T10:50:25.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f383b400640 1 -- 172.21.15.115:0/4264747789 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38300b5a70 con 0x7f3844070900 2024-05-12T10:50:25.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f946aa00640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f945406f450 0x7f9454071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a1be00640 1 -- 172.21.15.115:0/2915676438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c152a10 msgr2=0x7f2a1c14e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a1be00640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c152a10 0x7f2a1c14e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a1be00640 1 -- 172.21.15.115:0/2915676438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a1c152df0 msgr2=0x7f2a1c150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a1be00640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a1c152df0 0x7f2a1c150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a1be00640 1 -- 172.21.15.115:0/2915676438 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c14f9e0 con 0x7f2a1c073820 2024-05-12T10:50:25.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a1b400640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c152a10 0x7f2a1c14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:25.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a20e00640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a1c152df0 0x7f2a1c150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:25.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f946aa00640 1 -- 172.21.15.115:0/1956258009 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f946012c4b0 con 0x7f9474072420 2024-05-12T10:50:25.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f9472a00640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f945406f450 0x7f9454071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f3849000640 1 -- 172.21.15.115:0/4264747789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381c0052a0 con 0x7f3844070900 2024-05-12T10:50:25.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f2a1be00640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c073820 0x7f2a1c1f57c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0af000 tx=0x7f2a0c01baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.629+0000 7f9472a00640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f945406f450 0x7f9454071910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9464009e20 tx=0x7f9464009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.633+0000 7f383b400640 1 -- 172.21.15.115:0/4264747789 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f38300ab480 con 0x7f3844070900 2024-05-12T10:50:25.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.633+0000 7f383b400640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f382406f450 0x7f3824071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.633+0000 7f383b400640 1 -- 172.21.15.115:0/4264747789 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3830129da0 con 0x7f3844070900 2024-05-12T10:50:25.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.633+0000 7f3842a00640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f382406f450 0x7f3824071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.633+0000 7f3842a00640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f382406f450 0x7f3824071910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f384415fff0 tx=0x7f383c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.637+0000 7f383b400640 1 -- 172.21.15.115:0/4264747789 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f38300160b0 con 0x7f3844070900 2024-05-12T10:50:25.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7ff208c00640 1 -- 172.21.15.115:0/3916117925 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20400a4d0 con 0x7ff1f0003a60 2024-05-12T10:50:25.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82c8a00640 1 -- 172.21.15.115:0/2237787891 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0b5070 con 0x7f82cc152a10 2024-05-12T10:50:25.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f2a13e00640 1 -- 172.21.15.115:0/2915676438 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0bf070 con 0x7f2a1c073820 2024-05-12T10:50:25.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7ff208c00640 1 -- 172.21.15.115:0/3916117925 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2040aa4f0 con 0x7ff1f0003a60 2024-05-12T10:50:25.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff20c159400 con 0x7ff1f0003a60 2024-05-12T10:50:25.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff20c156660 con 0x7ff1f0003a60 2024-05-12T10:50:25.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7ff208c00640 1 -- 172.21.15.115:0/3916117925 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20400a4d0 con 0x7ff1f0003a60 2024-05-12T10:50:25.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f71efe00640 1 -- 172.21.15.115:0/1263865656 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f71f81e9f20 con 0x7f71f806ff50 2024-05-12T10:50:25.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f2a22e00640 1 -- 172.21.15.115:0/2915676438 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1c1f92a0 con 0x7f2a1c073820 2024-05-12T10:50:25.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f2a22e00640 1 -- 172.21.15.115:0/2915676438 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a1c1f9860 con 0x7f2a1c073820 2024-05-12T10:50:25.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f2a13e00640 1 -- 172.21.15.115:0/2915676438 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0c0b9420 con 0x7f2a1c073820 2024-05-12T10:50:25.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f2a13e00640 1 -- 172.21.15.115:0/2915676438 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0b5040 con 0x7f2a1c073820 2024-05-12T10:50:25.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82c8a00640 1 -- 172.21.15.115:0/2237787891 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82bc0a89d0 con 0x7f82cc152a10 2024-05-12T10:50:25.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82c8a00640 1 -- 172.21.15.115:0/2237787891 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0a8da0 con 0x7f82cc152a10 2024-05-12T10:50:25.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82d1200640 1 -- 172.21.15.115:0/2237787891 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152a10 msgr2=0x7f82cc159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82d1200640 1 --2- 172.21.15.115:0/2237787891 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152a10 0x7f82cc159310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f82cc06f490 tx=0x7f82bc01ed10 comp rx=0 tx=0).stop 2024-05-12T10:50:25.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82d1200640 1 -- 172.21.15.115:0/2237787891 shutdown_connections 2024-05-12T10:50:25.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82d1200640 1 --2- 172.21.15.115:0/2237787891 >> v2:172.21.15.134:3300/0 conn(0x7f82cc073820 0x7f82cc0742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82d1200640 1 --2- 172.21.15.115:0/2237787891 >> v2:172.21.15.115:3300/0 conn(0x7f82cc152df0 0x7f82cc073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82d1200640 1 --2- 172.21.15.115:0/2237787891 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152a10 0x7f82cc159310 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82d1200640 1 -- 172.21.15.115:0/2237787891 >> 172.21.15.115:0/2237787891 conn(0x7f82cc076830 msgr2=0x7f82cc0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82d1200640 1 -- 172.21.15.115:0/2237787891 shutdown_connections 2024-05-12T10:50:25.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f82d1200640 1 -- 172.21.15.115:0/2237787891 wait complete. 2024-05-12T10:50:25.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7f2a22e00640 1 -- 172.21.15.115:0/2915676438 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f40052a0 con 0x7f2a1c073820 2024-05-12T10:50:25.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.645+0000 7f946aa00640 1 -- 172.21.15.115:0/1956258009 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f94600c7020 con 0x7f9474072420 2024-05-12T10:50:25.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.641+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e40052a0 con 0x7ff1f0003a60 2024-05-12T10:50:25.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.645+0000 7ff208c00640 1 -- 172.21.15.115:0/3916117925 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff2040b9070 con 0x7ff1f0003a60 2024-05-12T10:50:25.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.645+0000 7f82d1200640 1 Processor -- start 2024-05-12T10:50:25.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.645+0000 7f82d1200640 1 -- start start 2024-05-12T10:50:25.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.645+0000 7f82d1200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82cc073820 0x7f82cc0c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.645+0000 7f82d1200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82cc152a10 0x7f82cc0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.645+0000 7ff208c00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff1ec06f630 0x7ff1ec071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.645+0000 7f2a13e00640 1 -- 172.21.15.115:0/2915676438 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2a0c0b9810 con 0x7f2a1c073820 2024-05-12T10:50:25.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.645+0000 7ff208c00640 1 -- 172.21.15.115:0/3916117925 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff20412bee0 con 0x7ff1f0003a60 2024-05-12T10:50:25.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.645+0000 7f82d1200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152df0 0x7f82cc0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f2a13e00640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f29fc06f400 0x7f29fc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c9e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82cc073820 0x7f82cc0c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82d1200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc073460 con 0x7f82cc152a10 2024-05-12T10:50:25.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82d1200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc0c4f50 con 0x7f82cc073820 2024-05-12T10:50:25.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82d1200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f82cc0735e0 con 0x7f82cc152df0 2024-05-12T10:50:25.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c9e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82cc073820 0x7f82cc0c3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41754/0 (socket says 172.21.15.115:41754) 2024-05-12T10:50:25.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c9e00640 1 -- 172.21.15.115:0/2301115395 learned_addr learned my addr 172.21.15.115:0/2301115395 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c9400640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82cc152a10 0x7f82cc0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f2a13e00640 1 -- 172.21.15.115:0/2915676438 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2a0c12cc60 con 0x7f2a1c073820 2024-05-12T10:50:25.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82ca800640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152df0 0x7f82cc0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c9e00640 1 -- 172.21.15.115:0/2301115395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152df0 msgr2=0x7f82cc0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c9e00640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152df0 0x7f82cc0cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c9e00640 1 -- 172.21.15.115:0/2301115395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82cc152a10 msgr2=0x7f82cc0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c9e00640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82cc152a10 0x7f82cc0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c9e00640 1 -- 172.21.15.115:0/2301115395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82cc14eb40 con 0x7f82cc073820 2024-05-12T10:50:25.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c9400640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82cc152a10 0x7f82cc0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:25.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f2a1b400640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f29fc06f400 0x7f29fc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c9e00640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82cc073820 0x7f82cc0c3b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f82bc01d3c0 tx=0x7f82bc01bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7ff20be00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff1ec06f630 0x7ff1ec071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c2000640 1 -- 172.21.15.115:0/2301115395 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0b5070 con 0x7f82cc073820 2024-05-12T10:50:25.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c2000640 1 -- 172.21.15.115:0/2301115395 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82bc0b09d0 con 0x7f82cc073820 2024-05-12T10:50:25.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f2a1b400640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f29fc06f400 0x7f29fc0718c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c1594c0 tx=0x7f2a08009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82c2000640 1 -- 172.21.15.115:0/2301115395 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0b0dc0 con 0x7f82cc073820 2024-05-12T10:50:25.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82d1200640 1 -- 172.21.15.115:0/2301115395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82cc0c8530 con 0x7f82cc073820 2024-05-12T10:50:25.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7ff20be00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff1ec06f630 0x7ff1ec071af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff20c06e8a0 tx=0x7ff1f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.649+0000 7f82d1200640 1 -- 172.21.15.115:0/2301115395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82cc14d040 con 0x7f82cc073820 2024-05-12T10:50:25.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.653+0000 7f82d1200640 1 -- 172.21.15.115:0/2301115395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82cc069730 con 0x7f82cc073820 2024-05-12T10:50:25.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.653+0000 7f82c2000640 1 -- 172.21.15.115:0/2301115395 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f82bc0c2060 con 0x7f82cc073820 2024-05-12T10:50:25.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.657+0000 7f82c2000640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f82ac06f4d0 0x7f82ac071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.657+0000 7f82c2000640 1 -- 172.21.15.115:0/2301115395 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f82bc12c9e0 con 0x7f82cc073820 2024-05-12T10:50:25.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.657+0000 7f82c9400640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f82ac06f4d0 0x7f82ac071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.657+0000 7f82c9400640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f82ac06f4d0 0x7f82ac071990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0ce490 tx=0x7f82b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.657+0000 7f2a13e00640 1 -- 172.21.15.115:0/2915676438 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2a0c0188b0 con 0x7f2a1c073820 2024-05-12T10:50:25.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.665+0000 7f0d9ae00640 1 Processor -- start 2024-05-12T10:50:25.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.665+0000 7f82c2000640 1 -- 172.21.15.115:0/2301115395 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f82cc14eb40 con 0x7f82cc073820 2024-05-12T10:50:25.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.665+0000 7f0d9ae00640 1 -- start start 2024-05-12T10:50:25.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d9ae00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 0x7f0d9415bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d9ae00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d94158360 con 0x7f0d9415c0a0 2024-05-12T10:50:25.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d9ae00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d94158640 con 0x7f0d940c9630 2024-05-12T10:50:25.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d9ae00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0d94158920 con 0x7f0d94151fd0 2024-05-12T10:50:25.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d99000640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0d9415c0a0 0x7f0d940ca0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53136/0 (socket says 172.21.15.115:53136) 2024-05-12T10:50:25.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d99000640 1 -- 172.21.15.115:0/1577651375 learned_addr learned my addr 172.21.15.115:0/1577651375 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:25.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d99a00640 1 --2- 172.21.15.115:0/1577651375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 0x7f0d9415bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d93e00640 1 -- 172.21.15.115:0/1577651375 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760431289 0 0) 0x7f0d94158360 con 0x7f0d9415c0a0 2024-05-12T10:50:25.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d93e00640 1 -- 172.21.15.115:0/1577651375 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d7c003530 con 0x7f0d9415c0a0 2024-05-12T10:50:25.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d99a00640 1 -- 172.21.15.115:0/1577651375 >> v1:172.21.15.134:6789/0 conn(0x7f0d940c9630 legacy=0x7f0d940ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:25.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d99a00640 1 -- 172.21.15.115:0/1577651375 >> v1:172.21.15.115:6789/0 conn(0x7f0d9415c0a0 legacy=0x7f0d940ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.669+0000 7f0d99a00640 1 -- 172.21.15.115:0/1577651375 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d94158c00 con 0x7f0d94151fd0 2024-05-12T10:50:25.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.673+0000 7ff208c00640 1 -- 172.21.15.115:0/3916117925 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff2040c0020 con 0x7ff1f0003a60 2024-05-12T10:50:25.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.673+0000 7f0d99a00640 1 --2- 172.21.15.115:0/1577651375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 0x7f0d9415bb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0d880097f0 tx=0x7f0d8801ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a15d22ff4de10c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.673+0000 7f0d93e00640 1 -- 172.21.15.115:0/1577651375 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d880b5070 con 0x7f0d94151fd0 2024-05-12T10:50:25.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.673+0000 7f0d93e00640 1 -- 172.21.15.115:0/1577651375 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d880a8990 con 0x7f0d94151fd0 2024-05-12T10:50:25.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.673+0000 7f0d93e00640 1 -- 172.21.15.115:0/1577651375 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d880b5070 con 0x7f0d94151fd0 2024-05-12T10:50:25.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.673+0000 7f0d9ae00640 1 -- 172.21.15.115:0/1577651375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 msgr2=0x7f0d9415bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.673+0000 7f0d9ae00640 1 --2- 172.21.15.115:0/1577651375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 0x7f0d9415bb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0d880097f0 tx=0x7f0d8801ecd0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.673+0000 7f0d9ae00640 1 -- 172.21.15.115:0/1577651375 shutdown_connections 2024-05-12T10:50:25.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.673+0000 7f0d9ae00640 1 --2- 172.21.15.115:0/1577651375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 0x7f0d9415bb60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.673+0000 7f0d9ae00640 1 -- 172.21.15.115:0/1577651375 >> 172.21.15.115:0/1577651375 conn(0x7f0d94070610 msgr2=0x7f0d94070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.677+0000 7f0d9ae00640 1 -- 172.21.15.115:0/1577651375 shutdown_connections 2024-05-12T10:50:25.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.677+0000 7f0d9ae00640 1 -- 172.21.15.115:0/1577651375 wait complete. 2024-05-12T10:50:25.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.681+0000 7f0d9ae00640 1 Processor -- start 2024-05-12T10:50:25.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.681+0000 7f0d9ae00640 1 -- start start 2024-05-12T10:50:25.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.681+0000 7f0d9ae00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d940c9630 0x7f0d941f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.681+0000 7f0d9ae00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 0x7f0d941efad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.681+0000 7f0d99a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d940c9630 0x7f0d941f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.681+0000 7f0d99a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d940c9630 0x7f0d941f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:41758/0 (socket says 172.21.15.115:41758) 2024-05-12T10:50:25.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.681+0000 7f0d9ae00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d9415c0a0 0x7f0d941f0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d99000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 0x7f0d941efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d99000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 0x7f0d941efad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60384/0 (socket says 172.21.15.115:60384) 2024-05-12T10:50:25.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9a400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d9415c0a0 0x7f0d941f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9a400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d9415c0a0 0x7f0d941f0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53008/0 (socket says 172.21.15.115:53008) 2024-05-12T10:50:25.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9ae00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94073520 con 0x7f0d9415c0a0 2024-05-12T10:50:25.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9ae00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9415b640 con 0x7f0d940c9630 2024-05-12T10:50:25.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9ae00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0d941523b0 con 0x7f0d94151fd0 2024-05-12T10:50:25.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d99a00640 1 -- 172.21.15.115:0/4165769704 learned_addr learned my addr 172.21.15.115:0/4165769704 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:25.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9a400640 1 -- 172.21.15.115:0/4165769704 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 msgr2=0x7f0d941efad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9a400640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 0x7f0d941efad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9a400640 1 -- 172.21.15.115:0/4165769704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d940c9630 msgr2=0x7f0d941f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9a400640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d940c9630 0x7f0d941f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9a400640 1 -- 172.21.15.115:0/4165769704 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d940ccbb0 con 0x7f0d9415c0a0 2024-05-12T10:50:25.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d99000640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 0x7f0d941efad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-12T10:50:25.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9a400640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d9415c0a0 0x7f0d941f0010 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c7b0 tx=0x7f0d8c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d91600640 1 -- 172.21.15.115:0/4165769704 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c016020 con 0x7f0d9415c0a0 2024-05-12T10:50:25.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9ae00640 1 -- 172.21.15.115:0/4165769704 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9414e550 con 0x7f0d9415c0a0 2024-05-12T10:50:25.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d9ae00640 1 -- 172.21.15.115:0/4165769704 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d941f1030 con 0x7f0d9415c0a0 2024-05-12T10:50:25.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.685+0000 7f0d91600640 1 -- 172.21.15.115:0/4165769704 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8c00aa50 con 0x7f0d9415c0a0 2024-05-12T10:50:25.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.689+0000 7f0d91600640 1 -- 172.21.15.115:0/4165769704 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c016020 con 0x7f0d9415c0a0 2024-05-12T10:50:25.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.693+0000 7f0d9ae00640 1 -- 172.21.15.115:0/4165769704 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d700052a0 con 0x7f0d9415c0a0 2024-05-12T10:50:25.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.693+0000 7f0d91600640 1 -- 172.21.15.115:0/4165769704 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0d8c019020 con 0x7f0d9415c0a0 2024-05-12T10:50:25.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.693+0000 7f0d91600640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0d7406f800 0x7f0d74071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:25.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.701+0000 7f0d91600640 1 -- 172.21.15.115:0/4165769704 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0d8c00a850 con 0x7f0d9415c0a0 2024-05-12T10:50:25.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.705+0000 7f0d99a00640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0d7406f800 0x7f0d74071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:25.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.705+0000 7f0d99a00640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0d7406f800 0x7f0d74071cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d8801f570 tx=0x7f0d880aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:25.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.705+0000 7f0d91600640 1 -- 172.21.15.115:0/4165769704 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0d8c020020 con 0x7f0d9415c0a0 2024-05-12T10:50:25.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.893+0000 7f37ffe00640 1 -- 172.21.15.115:0/941906260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f37d8005860 con 0x7f38000736a0 2024-05-12T10:50:25.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.893+0000 7f37f6a00640 1 -- 172.21.15.115:0/941906260 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37f8068940 con 0x7f38000736a0 2024-05-12T10:50:25.891 INFO:teuthology.orchestra.run.smithi115.stdout:60129542155 2024-05-12T10:50:25.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 -- 172.21.15.115:0/941906260 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f37e006f400 msgr2=0x7f37e00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f37e006f400 0x7f37e00718c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f37f000f860 tx=0x7f37f0011040 comp rx=0 tx=0).stop 2024-05-12T10:50:25.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 -- 172.21.15.115:0/941906260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38000736a0 msgr2=0x7f380014b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38000736a0 0x7f380014b670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f37f8014fd0 tx=0x7f37f80099d0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 -- 172.21.15.115:0/941906260 shutdown_connections 2024-05-12T10:50:25.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f37e006f400 0x7f37e00718c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3800151c60 0x7f38000c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38000736a0 0x7f380014b670 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 --2- 172.21.15.115:0/941906260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38000730a0 0x7f38000cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 -- 172.21.15.115:0/941906260 >> 172.21.15.115:0/941906260 conn(0x7f3800076630 msgr2=0x7f3800155b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 -- 172.21.15.115:0/941906260 shutdown_connections 2024-05-12T10:50:25.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.901+0000 7f37ffe00640 1 -- 172.21.15.115:0/941906260 wait complete. 2024-05-12T10:50:25.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.5 2024-05-12T10:50:25.929 DEBUG:teuthology.parallel:result is None 2024-05-12T10:50:25.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.973+0000 7f82d1200640 1 -- 172.21.15.115:0/2301115395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f82cc0c52f0 con 0x7f82cc073820 2024-05-12T10:50:25.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.973+0000 7f71fee00640 1 -- 172.21.15.115:0/1263865656 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f71f80c8a50 con 0x7f71f806ff50 2024-05-12T10:50:25.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.973+0000 7f82c2000640 1 -- 172.21.15.115:0/2301115395 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82bc018890 con 0x7f82cc073820 2024-05-12T10:50:25.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.973+0000 7f71efe00640 1 -- 172.21.15.115:0/1263865656 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71e405af70 con 0x7f71f806ff50 2024-05-12T10:50:25.969 INFO:teuthology.orchestra.run.smithi115.stdout:60129542154 2024-05-12T10:50:25.970 INFO:teuthology.orchestra.run.smithi115.stdout:60129542155 2024-05-12T10:50:25.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 -- 172.21.15.115:0/2301115395 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f82ac06f4d0 msgr2=0x7f82ac071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f82ac06f4d0 0x7f82ac071990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0ce490 tx=0x7f82b8008040 comp rx=0 tx=0).stop 2024-05-12T10:50:25.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 -- 172.21.15.115:0/2301115395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82cc073820 msgr2=0x7f82cc0c3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82cc073820 0x7f82cc0c3b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f82bc01d3c0 tx=0x7f82bc01bad0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 -- 172.21.15.115:0/2301115395 shutdown_connections 2024-05-12T10:50:25.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f82ac06f4d0 0x7f82ac071990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82cc152df0 0x7f82cc0cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82cc152a10 0x7f82cc0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 --2- 172.21.15.115:0/2301115395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82cc073820 0x7f82cc0c3b20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 -- 172.21.15.115:0/2301115395 >> 172.21.15.115:0/2301115395 conn(0x7f82cc076830 msgr2=0x7f82cc159000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 -- 172.21.15.115:0/2301115395 shutdown_connections 2024-05-12T10:50:25.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f82d1200640 1 -- 172.21.15.115:0/2301115395 wait complete. 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 -- 172.21.15.115:0/1263865656 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f71d806f4d0 msgr2=0x7f71d8071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f71d806f4d0 0x7f71d8071990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71f00b0000 tx=0x7f71f00a9000 comp rx=0 tx=0).stop 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 -- 172.21.15.115:0/1263865656 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71f806ff50 msgr2=0x7f71f8073580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71f806ff50 0x7f71f8073580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71e400c480 tx=0x7f71e400c940 comp rx=0 tx=0).stop 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 -- 172.21.15.115:0/1263865656 shutdown_connections 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f71d806f4d0 0x7f71d8071990 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71f00b0000 tx=0x7f71f00a9000 comp rx=0 tx=0).stop 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f81519b0 0x7f71f81f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71f8072230 0x7f71f814c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 --2- 172.21.15.115:0/1263865656 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71f806ff50 0x7f71f8073580 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 -- 172.21.15.115:0/1263865656 >> 172.21.15.115:0/1263865656 conn(0x7f71f8076430 msgr2=0x7f71f8145b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 -- 172.21.15.115:0/1263865656 shutdown_connections 2024-05-12T10:50:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.977+0000 7f71fee00640 1 -- 172.21.15.115:0/1263865656 wait complete. 2024-05-12T10:50:25.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.981+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f94740ca1c0 con 0x7f9474072420 2024-05-12T10:50:25.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.981+0000 7f946aa00640 1 -- 172.21.15.115:0/1956258009 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9460018870 con 0x7f9474072420 2024-05-12T10:50:25.979 INFO:teuthology.orchestra.run.smithi115.stdout:60129542155 2024-05-12T10:50:25.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.985+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f945406f450 msgr2=0x7f9454071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.985+0000 7f9479800640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f945406f450 0x7f9454071910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9464009e20 tx=0x7f9464009190 comp rx=0 tx=0).stop 2024-05-12T10:50:25.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.985+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9474072420 msgr2=0x7f94741f9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.985+0000 7f9479800640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9474072420 0x7f94741f9cb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f94600af000 tx=0x7f946001bab0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.985+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 shutdown_connections 2024-05-12T10:50:25.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.985+0000 7f9479800640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f945406f450 0x7f9454071910 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9464009e20 tx=0x7f9464009190 comp rx=0 tx=0).stop 2024-05-12T10:50:25.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.985+0000 7f9479800640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94740c9a70 0x7f94741597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.985+0000 7f9479800640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9474072420 0x7f94741f9cb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.985+0000 7f9479800640 1 --2- 172.21.15.115:0/1956258009 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94740688d0 0x7f947414b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.985+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 >> 172.21.15.115:0/1956258009 conn(0x7f9474076830 msgr2=0x7f9474073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.989+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 shutdown_connections 2024-05-12T10:50:25.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.989+0000 7f9479800640 1 -- 172.21.15.115:0/1956258009 wait complete. 2024-05-12T10:50:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.989+0000 7f3849000640 1 -- 172.21.15.115:0/4264747789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f381c005590 con 0x7f3844070900 2024-05-12T10:50:25.987 INFO:teuthology.orchestra.run.smithi115.stdout:60129542155 2024-05-12T10:50:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.989+0000 7f383b400640 1 -- 172.21.15.115:0/4264747789 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38300f62e0 con 0x7f3844070900 2024-05-12T10:50:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.993+0000 7f3849000640 1 -- 172.21.15.115:0/4264747789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f382406f450 msgr2=0x7f3824071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.993+0000 7f3849000640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f382406f450 0x7f3824071910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f384415fff0 tx=0x7f383c009040 comp rx=0 tx=0).stop 2024-05-12T10:50:25.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.993+0000 7f3849000640 1 -- 172.21.15.115:0/4264747789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3844070900 msgr2=0x7f38440cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:25.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.993+0000 7f3849000640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3844070900 0x7f38440cd560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3830019040 tx=0x7f383001ac70 comp rx=0 tx=0).stop 2024-05-12T10:50:25.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.993+0000 7f3849000640 1 -- 172.21.15.115:0/4264747789 shutdown_connections 2024-05-12T10:50:25.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.993+0000 7f3849000640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f382406f450 0x7f3824071910 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.993+0000 7f3849000640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38440c9a50 0x7f38440cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.993+0000 7f3849000640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3844070ce0 0x7f38440cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.993+0000 7f3849000640 1 --2- 172.21.15.115:0/4264747789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3844070900 0x7f38440cd560 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:25.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.993+0000 7f3849000640 1 -- 172.21.15.115:0/4264747789 >> 172.21.15.115:0/4264747789 conn(0x7f384406f1b0 msgr2=0x7f3844156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.997+0000 7f3849000640 1 -- 172.21.15.115:0/4264747789 shutdown_connections 2024-05-12T10:50:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:25.997+0000 7f3849000640 1 -- 172.21.15.115:0/4264747789 wait complete. 2024-05-12T10:50:25.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.7 2024-05-12T10:50:25.999 DEBUG:teuthology.parallel:result is None 2024-05-12T10:50:26.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.009+0000 7f2a22e00640 1 -- 172.21.15.115:0/2915676438 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f29f4005860 con 0x7f2a1c073820 2024-05-12T10:50:26.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.009+0000 7f2a13e00640 1 -- 172.21.15.115:0/2915676438 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2a0c0188b0 con 0x7f2a1c073820 2024-05-12T10:50:26.005 INFO:teuthology.orchestra.run.smithi115.stdout:60129542154 2024-05-12T10:50:26.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.6 2024-05-12T10:50:26.006 DEBUG:teuthology.parallel:result is None 2024-05-12T10:50:26.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 -- 172.21.15.115:0/2915676438 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f29fc06f400 msgr2=0x7f29fc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f29fc06f400 0x7f29fc0718c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c1594c0 tx=0x7f2a08009190 comp rx=0 tx=0).stop 2024-05-12T10:50:26.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 -- 172.21.15.115:0/2915676438 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c073820 msgr2=0x7f2a1c1f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c073820 0x7f2a1c1f57c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0af000 tx=0x7f2a0c01baf0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 -- 172.21.15.115:0/2915676438 shutdown_connections 2024-05-12T10:50:26.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f29fc06f400 0x7f29fc0718c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a1c152df0 0x7f2a1c150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c152a10 0x7f2a1c14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 --2- 172.21.15.115:0/2915676438 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a1c073820 0x7f2a1c1f57c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 -- 172.21.15.115:0/2915676438 >> 172.21.15.115:0/2915676438 conn(0x7f2a1c076830 msgr2=0x7f2a1c1510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:26.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 -- 172.21.15.115:0/2915676438 shutdown_connections 2024-05-12T10:50:26.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.013+0000 7f2a22e00640 1 -- 172.21.15.115:0/2915676438 wait complete. 2024-05-12T10:50:26.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.017+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff1e4005590 con 0x7ff1f0003a60 2024-05-12T10:50:26.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.1 2024-05-12T10:50:26.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.017+0000 7ff208c00640 1 -- 172.21.15.115:0/3916117925 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff2040ae030 con 0x7ff1f0003a60 2024-05-12T10:50:26.015 INFO:teuthology.orchestra.run.smithi115.stdout:60129542157 2024-05-12T10:50:26.015 DEBUG:teuthology.parallel:result is None 2024-05-12T10:50:26.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff1ec06f630 msgr2=0x7ff1ec071af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff1ec06f630 0x7ff1ec071af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff20c06e8a0 tx=0x7ff1f8008040 comp rx=0 tx=0).stop 2024-05-12T10:50:26.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1f0003a60 msgr2=0x7ff20c0c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1f0003a60 0x7ff20c0c5fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000c250 tx=0x7ff1f0005840 comp rx=0 tx=0).stop 2024-05-12T10:50:26.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 shutdown_connections 2024-05-12T10:50:26.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff1ec06f630 0x7ff1ec071af0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff20c158930 0x7ff20c157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff20c0c6790 0x7ff20c1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 --2- 172.21.15.115:0/3916117925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1f0003a60 0x7ff20c0c5fb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 >> 172.21.15.115:0/3916117925 conn(0x7ff20c073b70 msgr2=0x7ff20c1f5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:26.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 shutdown_connections 2024-05-12T10:50:26.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.021+0000 7ff213a00640 1 -- 172.21.15.115:0/3916117925 wait complete. 2024-05-12T10:50:26.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.0 2024-05-12T10:50:26.027 DEBUG:teuthology.parallel:result is None 2024-05-12T10:50:26.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 -- 172.21.15.115:0/4165769704 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0d70005590 con 0x7f0d9415c0a0 2024-05-12T10:50:26.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d91600640 1 -- 172.21.15.115:0/4165769704 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0d8c020020 con 0x7f0d9415c0a0 2024-05-12T10:50:26.036 INFO:teuthology.orchestra.run.smithi115.stdout:60129542155 2024-05-12T10:50:26.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2024-05-12T10:50:26.038 DEBUG:teuthology.parallel:result is None 2024-05-12T10:50:26.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 -- 172.21.15.115:0/4165769704 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0d7406f800 msgr2=0x7f0d74071cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0d7406f800 0x7f0d74071cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d8801f570 tx=0x7f0d880aa070 comp rx=0 tx=0).stop 2024-05-12T10:50:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 -- 172.21.15.115:0/4165769704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d9415c0a0 msgr2=0x7f0d941f0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d9415c0a0 0x7f0d941f0010 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c7b0 tx=0x7f0d8c00cc70 comp rx=0 tx=0).stop 2024-05-12T10:50:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 -- 172.21.15.115:0/4165769704 shutdown_connections 2024-05-12T10:50:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0d7406f800 0x7f0d74071cc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d9415c0a0 0x7f0d941f0010 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d94151fd0 0x7f0d941efad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 --2- 172.21.15.115:0/4165769704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d940c9630 0x7f0d941f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 -- 172.21.15.115:0/4165769704 >> 172.21.15.115:0/4165769704 conn(0x7f0d94070610 msgr2=0x7f0d940709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 -- 172.21.15.115:0/4165769704 shutdown_connections 2024-05-12T10:50:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.041+0000 7f0d9ae00640 1 -- 172.21.15.115:0/4165769704 wait complete. 2024-05-12T10:50:26.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.4 2024-05-12T10:50:26.046 DEBUG:teuthology.parallel:result is None 2024-05-12T10:50:26.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2024-05-12T10:50:26.058 DEBUG:teuthology.parallel:result is None 2024-05-12T10:50:26.059 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-12T10:50:26.059 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:50:26.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd97cc00640 1 Processor -- start 2024-05-12T10:50:26.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd97cc00640 1 -- start start 2024-05-12T10:50:26.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd97cc00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd97815cb30 0x7fd9780c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:26.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd97cc00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9780ca850 con 0x7fd978152a90 2024-05-12T10:50:26.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd97cc00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9780cab30 con 0x7fd9780c6560 2024-05-12T10:50:26.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd97cc00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fd9780c4f80 con 0x7fd97815cb30 2024-05-12T10:50:26.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd975e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd978152a90 0x7fd9781593b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53150/0 (socket says 172.21.15.115:53150) 2024-05-12T10:50:26.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd975e00640 1 -- 172.21.15.115:0/107720403 learned_addr learned my addr 172.21.15.115:0/107720403 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:26.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd975400640 1 --2- 172.21.15.115:0/107720403 >> v2:172.21.15.115:3300/0 conn(0x7fd97815cb30 0x7fd9780c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd974a00640 1 -- 172.21.15.115:0/107720403 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201687792 0 0) 0x7fd9780ca850 con 0x7fd978152a90 2024-05-12T10:50:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd974a00640 1 -- 172.21.15.115:0/107720403 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd95c003530 con 0x7fd978152a90 2024-05-12T10:50:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd975400640 1 -- 172.21.15.115:0/107720403 >> v1:172.21.15.134:6789/0 conn(0x7fd9780c6560 legacy=0x7fd9780c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd975400640 1 -- 172.21.15.115:0/107720403 >> v1:172.21.15.115:6789/0 conn(0x7fd978152a90 legacy=0x7fd9781593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.237+0000 7fd975400640 1 -- 172.21.15.115:0/107720403 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97815c050 con 0x7fd97815cb30 2024-05-12T10:50:26.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.241+0000 7fd975400640 1 --2- 172.21.15.115:0/107720403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97815cb30 0x7fd9780c4920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd9640097c0 tx=0x7fd96401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acef94d2966b7aed server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:26.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.241+0000 7fd974a00640 1 -- 172.21.15.115:0/107720403 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9640b0070 con 0x7fd97815cb30 2024-05-12T10:50:26.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.241+0000 7fd974a00640 1 -- 172.21.15.115:0/107720403 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9640ab600 con 0x7fd97815cb30 2024-05-12T10:50:26.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.241+0000 7fd974a00640 1 -- 172.21.15.115:0/107720403 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9640ab9b0 con 0x7fd97815cb30 2024-05-12T10:50:26.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.241+0000 7fd97cc00640 1 -- 172.21.15.115:0/107720403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97815cb30 msgr2=0x7fd9780c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.241+0000 7fd97cc00640 1 --2- 172.21.15.115:0/107720403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97815cb30 0x7fd9780c4920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd9640097c0 tx=0x7fd96401c4a0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.241+0000 7fd97cc00640 1 -- 172.21.15.115:0/107720403 shutdown_connections 2024-05-12T10:50:26.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.241+0000 7fd97cc00640 1 --2- 172.21.15.115:0/107720403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97815cb30 0x7fd9780c4920 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.241+0000 7fd97cc00640 1 -- 172.21.15.115:0/107720403 >> 172.21.15.115:0/107720403 conn(0x7fd9780681c0 msgr2=0x7fd9780685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:26.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.241+0000 7fd97cc00640 1 -- 172.21.15.115:0/107720403 shutdown_connections 2024-05-12T10:50:26.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.241+0000 7fd97cc00640 1 -- 172.21.15.115:0/107720403 wait complete. 2024-05-12T10:50:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd97cc00640 1 Processor -- start 2024-05-12T10:50:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd97cc00640 1 -- start start 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd97cc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9780c6560 0x7fd978148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd97cc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd978152a90 0x7fd9780cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd97cc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd97815cb30 0x7fd97814c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd97cc00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd978152ff0 con 0x7fd978152a90 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd97cc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd978152e70 con 0x7fd9780c6560 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd97cc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd978166ae0 con 0x7fd97815cb30 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd975400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd978152a90 0x7fd9780cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd975400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd978152a90 0x7fd9780cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53032/0 (socket says 172.21.15.115:53032) 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd975400640 1 -- 172.21.15.115:0/605938059 learned_addr learned my addr 172.21.15.115:0/605938059 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd975e00640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9780c6560 0x7fd978148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd976800640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd97815cb30 0x7fd97814c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd975400640 1 -- 172.21.15.115:0/605938059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd97815cb30 msgr2=0x7fd97814c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd975400640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd97815cb30 0x7fd97814c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd975400640 1 -- 172.21.15.115:0/605938059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9780c6560 msgr2=0x7fd978148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd975400640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9780c6560 0x7fd978148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd975400640 1 -- 172.21.15.115:0/605938059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd978148b90 con 0x7fd978152a90 2024-05-12T10:50:26.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd975400640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd978152a90 0x7fd9780cc9d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd9640ae040 tx=0x7fd96401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:26.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd96e000640 1 -- 172.21.15.115:0/605938059 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9640b0050 con 0x7fd978152a90 2024-05-12T10:50:26.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd96e000640 1 -- 172.21.15.115:0/605938059 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9640b1040 con 0x7fd978152a90 2024-05-12T10:50:26.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd96e000640 1 -- 172.21.15.115:0/605938059 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964006e20 con 0x7fd978152a90 2024-05-12T10:50:26.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd97cc00640 1 -- 172.21.15.115:0/605938059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9780cb660 con 0x7fd978152a90 2024-05-12T10:50:26.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.245+0000 7fd97cc00640 1 -- 172.21.15.115:0/605938059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9780cbef0 con 0x7fd978152a90 2024-05-12T10:50:26.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.249+0000 7fd97cc00640 1 -- 172.21.15.115:0/605938059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd978069730 con 0x7fd978152a90 2024-05-12T10:50:26.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.249+0000 7fd96e000640 1 -- 172.21.15.115:0/605938059 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd9640be060 con 0x7fd978152a90 2024-05-12T10:50:26.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.249+0000 7fd96e000640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd95806f430 0x7fd9580718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:26.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.249+0000 7fd96e000640 1 -- 172.21.15.115:0/605938059 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd964128f00 con 0x7fd978152a90 2024-05-12T10:50:26.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.249+0000 7fd975e00640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd95806f430 0x7fd9580718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:26.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.249+0000 7fd975e00640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd95806f430 0x7fd9580718f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd968005890 tx=0x7fd968009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:26.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.253+0000 7fd96e000640 1 -- 172.21.15.115:0/605938059 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd964016090 con 0x7fd978152a90 2024-05-12T10:50:26.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.409+0000 7fd97cc00640 1 -- 172.21.15.115:0/605938059 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd9780cbbe0 con 0x7fd95806f430 2024-05-12T10:50:26.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.417+0000 7fd96e000640 1 -- 172.21.15.115:0/605938059 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7fd968001c50 con 0x7fd95806f430 2024-05-12T10:50:26.416 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:26.418 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:50:26.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 -- 172.21.15.115:0/605938059 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd95806f430 msgr2=0x7fd9580718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd95806f430 0x7fd9580718f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd968005890 tx=0x7fd968009040 comp rx=0 tx=0).stop 2024-05-12T10:50:26.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 -- 172.21.15.115:0/605938059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd978152a90 msgr2=0x7fd9780cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd978152a90 0x7fd9780cc9d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd9640ae040 tx=0x7fd96401ace0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 -- 172.21.15.115:0/605938059 shutdown_connections 2024-05-12T10:50:26.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd95806f430 0x7fd9580718f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd97815cb30 0x7fd97814c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd978152a90 0x7fd9780cc9d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 --2- 172.21.15.115:0/605938059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9780c6560 0x7fd978148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 -- 172.21.15.115:0/605938059 >> 172.21.15.115:0/605938059 conn(0x7fd9780681c0 msgr2=0x7fd978163b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:26.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 -- 172.21.15.115:0/605938059 shutdown_connections 2024-05-12T10:50:26.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.421+0000 7fd97cc00640 1 -- 172.21.15.115:0/605938059 wait complete. 2024-05-12T10:50:26.436 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-05-12T10:50:25.759662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219524,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755196,"statfs":{"total":773094113280,"available":772869320704,"internally_reserved":0,"allocated":3448832,"data_stored":2075584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005923"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838171+0000","last_change":"2024-05-12T10:49:54.640093+0000","last_active":"2024-05-12T10:50:02.838171+0000","last_peered":"2024-05-12T10:50:02.838171+0000","last_clean":"2024-05-12T10:50:02.838171+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:50:02.838171+0000","last_undegraded":"2024-05-12T10:50:02.838171+0000","last_fullsized":"2024-05-12T10:50:02.838171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:07:41.639104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653116+0000","last_change":"2024-05-12T10:49:55.635928+0000","last_active":"2024-05-12T10:50:01.653116+0000","last_peered":"2024-05-12T10:50:01.653116+0000","last_clean":"2024-05-12T10:50:01.653116+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:50:01.653116+0000","last_undegraded":"2024-05-12T10:50:01.653116+0000","last_fullsized":"2024-05-12T10:50:01.653116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:41:30.909036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652376+0000","last_change":"2024-05-12T10:50:00.396417+0000","last_active":"2024-05-12T10:50:01.652376+0000","last_peered":"2024-05-12T10:50:01.652376+0000","last_clean":"2024-05-12T10:50:01.652376+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:50:01.652376+0000","last_undegraded":"2024-05-12T10:50:01.652376+0000","last_fullsized":"2024-05-12T10:50:01.652376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:27.287617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653306+0000","last_change":"2024-05-12T10:49:54.619268+0000","last_active":"2024-05-12T10:50:01.653306+0000","last_peered":"2024-05-12T10:50:01.653306+0000","last_clean":"2024-05-12T10:50:01.653306+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:50:01.653306+0000","last_undegraded":"2024-05-12T10:50:01.653306+0000","last_fullsized":"2024-05-12T10:50:01.653306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:50:34.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837930+0000","last_change":"2024-05-12T10:49:55.624986+0000","last_active":"2024-05-12T10:50:02.837930+0000","last_peered":"2024-05-12T10:50:02.837930+0000","last_clean":"2024-05-12T10:50:02.837930+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:50:02.837930+0000","last_undegraded":"2024-05-12T10:50:02.837930+0000","last_fullsized":"2024-05-12T10:50:02.837930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:03:47.220979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657155+0000","last_change":"2024-05-12T10:49:59.676139+0000","last_active":"2024-05-12T10:50:01.657155+0000","last_peered":"2024-05-12T10:50:01.657155+0000","last_clean":"2024-05-12T10:50:01.657155+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:50:01.657155+0000","last_undegraded":"2024-05-12T10:50:01.657155+0000","last_fullsized":"2024-05-12T10:50:01.657155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:24:15.396258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.918980+0000","last_change":"2024-05-12T10:49:54.645331+0000","last_active":"2024-05-12T10:50:02.918980+0000","last_peered":"2024-05-12T10:50:02.918980+0000","last_clean":"2024-05-12T10:50:02.918980+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:50:02.918980+0000","last_undegraded":"2024-05-12T10:50:02.918980+0000","last_fullsized":"2024-05-12T10:50:02.918980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:38:29.023589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658144+0000","last_change":"2024-05-12T10:49:55.642386+0000","last_active":"2024-05-12T10:50:01.658144+0000","last_peered":"2024-05-12T10:50:01.658144+0000","last_clean":"2024-05-12T10:50:01.658144+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:50:01.658144+0000","last_undegraded":"2024-05-12T10:50:01.658144+0000","last_fullsized":"2024-05-12T10:50:01.658144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:54:40.153070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657964+0000","last_change":"2024-05-12T10:49:59.679887+0000","last_active":"2024-05-12T10:50:01.657964+0000","last_peered":"2024-05-12T10:50:01.657964+0000","last_clean":"2024-05-12T10:50:01.657964+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:50:01.657964+0000","last_undegraded":"2024-05-12T10:50:01.657964+0000","last_fullsized":"2024-05-12T10:50:01.657964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:25:43.004918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919021+0000","last_change":"2024-05-12T10:49:54.659229+0000","last_active":"2024-05-12T10:50:02.919021+0000","last_peered":"2024-05-12T10:50:02.919021+0000","last_clean":"2024-05-12T10:50:02.919021+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:50:02.919021+0000","last_undegraded":"2024-05-12T10:50:02.919021+0000","last_fullsized":"2024-05-12T10:50:02.919021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:54:54.658165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660005+0000","last_change":"2024-05-12T10:49:55.642157+0000","last_active":"2024-05-12T10:50:01.660005+0000","last_peered":"2024-05-12T10:50:01.660005+0000","last_clean":"2024-05-12T10:50:01.660005+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:50:01.660005+0000","last_undegraded":"2024-05-12T10:50:01.660005+0000","last_fullsized":"2024-05-12T10:50:01.660005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:16.232731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658776+0000","last_change":"2024-05-12T10:49:59.663411+0000","last_active":"2024-05-12T10:50:01.658776+0000","last_peered":"2024-05-12T10:50:01.658776+0000","last_clean":"2024-05-12T10:50:01.658776+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:50:01.658776+0000","last_undegraded":"2024-05-12T10:50:01.658776+0000","last_fullsized":"2024-05-12T10:50:01.658776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:59.136704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075711+0000","last_change":"2024-05-12T10:49:55.646019+0000","last_active":"2024-05-12T10:50:02.075711+0000","last_peered":"2024-05-12T10:50:02.075711+0000","last_clean":"2024-05-12T10:50:02.075711+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:50:02.075711+0000","last_undegraded":"2024-05-12T10:50:02.075711+0000","last_fullsized":"2024-05-12T10:50:02.075711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:07.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919034+0000","last_change":"2024-05-12T10:49:54.642039+0000","last_active":"2024-05-12T10:50:02.919034+0000","last_peered":"2024-05-12T10:50:02.919034+0000","last_clean":"2024-05-12T10:50:02.919034+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:50:02.919034+0000","last_undegraded":"2024-05-12T10:50:02.919034+0000","last_fullsized":"2024-05-12T10:50:02.919034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:01.155569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660588+0000","last_change":"2024-05-12T10:49:59.660274+0000","last_active":"2024-05-12T10:50:01.660588+0000","last_peered":"2024-05-12T10:50:01.660588+0000","last_clean":"2024-05-12T10:50:01.660588+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:50:01.660588+0000","last_undegraded":"2024-05-12T10:50:01.660588+0000","last_fullsized":"2024-05-12T10:50:01.660588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:55:12.579645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652722+0000","last_change":"2024-05-12T10:49:55.618128+0000","last_active":"2024-05-12T10:50:01.652722+0000","last_peered":"2024-05-12T10:50:01.652722+0000","last_clean":"2024-05-12T10:50:01.652722+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:50:01.652722+0000","last_undegraded":"2024-05-12T10:50:01.652722+0000","last_fullsized":"2024-05-12T10:50:01.652722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:45.205117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915833+0000","last_change":"2024-05-12T10:49:54.619967+0000","last_active":"2024-05-12T10:50:02.915833+0000","last_peered":"2024-05-12T10:50:02.915833+0000","last_clean":"2024-05-12T10:50:02.915833+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:50:02.915833+0000","last_undegraded":"2024-05-12T10:50:02.915833+0000","last_fullsized":"2024-05-12T10:50:02.915833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:37:10.799631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659650+0000","last_change":"2024-05-12T10:49:59.681931+0000","last_active":"2024-05-12T10:50:01.659650+0000","last_peered":"2024-05-12T10:50:01.659650+0000","last_clean":"2024-05-12T10:50:01.659650+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:50:01.659650+0000","last_undegraded":"2024-05-12T10:50:01.659650+0000","last_fullsized":"2024-05-12T10:50:01.659650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:45:01.542628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652721+0000","last_change":"2024-05-12T10:49:55.615095+0000","last_active":"2024-05-12T10:50:01.652721+0000","last_peered":"2024-05-12T10:50:01.652721+0000","last_clean":"2024-05-12T10:50:01.652721+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:50:01.652721+0000","last_undegraded":"2024-05-12T10:50:01.652721+0000","last_fullsized":"2024-05-12T10:50:01.652721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:51:19.659941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916206+0000","last_change":"2024-05-12T10:49:54.639976+0000","last_active":"2024-05-12T10:50:02.916206+0000","last_peered":"2024-05-12T10:50:02.916206+0000","last_clean":"2024-05-12T10:50:02.916206+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:50:02.916206+0000","last_undegraded":"2024-05-12T10:50:02.916206+0000","last_fullsized":"2024-05-12T10:50:02.916206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:28:37.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916755+0000","last_change":"2024-05-12T10:50:00.390786+0000","last_active":"2024-05-12T10:50:02.916755+0000","last_peered":"2024-05-12T10:50:02.916755+0000","last_clean":"2024-05-12T10:50:02.916755+0000","last_became_active":"2024-05-12T10:50:00.390378+0000","last_became_peered":"2024-05-12T10:50:00.390378+0000","last_unstale":"2024-05-12T10:50:02.916755+0000","last_undegraded":"2024-05-12T10:50:02.916755+0000","last_fullsized":"2024-05-12T10:50:02.916755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:27:57.945259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658891+0000","last_change":"2024-05-12T10:49:55.622729+0000","last_active":"2024-05-12T10:50:01.658891+0000","last_peered":"2024-05-12T10:50:01.658891+0000","last_clean":"2024-05-12T10:50:01.658891+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:50:01.658891+0000","last_undegraded":"2024-05-12T10:50:01.658891+0000","last_fullsized":"2024-05-12T10:50:01.658891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:08:29.460684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919516+0000","last_change":"2024-05-12T10:49:54.639564+0000","last_active":"2024-05-12T10:50:02.919516+0000","last_peered":"2024-05-12T10:50:02.919516+0000","last_clean":"2024-05-12T10:50:02.919516+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:50:02.919516+0000","last_undegraded":"2024-05-12T10:50:02.919516+0000","last_fullsized":"2024-05-12T10:50:02.919516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:54:48.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.661417+0000","last_change":"2024-05-12T10:49:59.676220+0000","last_active":"2024-05-12T10:50:01.661417+0000","last_peered":"2024-05-12T10:50:01.661417+0000","last_clean":"2024-05-12T10:50:01.661417+0000","last_became_active":"2024-05-12T10:49:59.674835+0000","last_became_peered":"2024-05-12T10:49:59.674835+0000","last_unstale":"2024-05-12T10:50:01.661417+0000","last_undegraded":"2024-05-12T10:50:01.661417+0000","last_fullsized":"2024-05-12T10:50:01.661417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:55:03.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838015+0000","last_change":"2024-05-12T10:49:55.612744+0000","last_active":"2024-05-12T10:50:02.838015+0000","last_peered":"2024-05-12T10:50:02.838015+0000","last_clean":"2024-05-12T10:50:02.838015+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:50:02.838015+0000","last_undegraded":"2024-05-12T10:50:02.838015+0000","last_fullsized":"2024-05-12T10:50:02.838015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:05:06.274277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.077180+0000","last_change":"2024-05-12T10:49:54.643375+0000","last_active":"2024-05-12T10:50:02.077180+0000","last_peered":"2024-05-12T10:50:02.077180+0000","last_clean":"2024-05-12T10:50:02.077180+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:50:02.077180+0000","last_undegraded":"2024-05-12T10:50:02.077180+0000","last_fullsized":"2024-05-12T10:50:02.077180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:56:43.086871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658181+0000","last_change":"2024-05-12T10:50:00.393325+0000","last_active":"2024-05-12T10:50:01.658181+0000","last_peered":"2024-05-12T10:50:01.658181+0000","last_clean":"2024-05-12T10:50:01.658181+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:50:01.658181+0000","last_undegraded":"2024-05-12T10:50:01.658181+0000","last_fullsized":"2024-05-12T10:50:01.658181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:55.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653561+0000","last_change":"2024-05-12T10:49:55.629693+0000","last_active":"2024-05-12T10:50:01.653561+0000","last_peered":"2024-05-12T10:50:01.653561+0000","last_clean":"2024-05-12T10:50:01.653561+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:50:01.653561+0000","last_undegraded":"2024-05-12T10:50:01.653561+0000","last_fullsized":"2024-05-12T10:50:01.653561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:04:13.325079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915903+0000","last_change":"2024-05-12T10:49:54.629227+0000","last_active":"2024-05-12T10:50:02.915903+0000","last_peered":"2024-05-12T10:50:02.915903+0000","last_clean":"2024-05-12T10:50:02.915903+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:50:02.915903+0000","last_undegraded":"2024-05-12T10:50:02.915903+0000","last_fullsized":"2024-05-12T10:50:02.915903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:03.097527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652367+0000","last_change":"2024-05-12T10:50:00.396371+0000","last_active":"2024-05-12T10:50:01.652367+0000","last_peered":"2024-05-12T10:50:01.652367+0000","last_clean":"2024-05-12T10:50:01.652367+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:50:01.652367+0000","last_undegraded":"2024-05-12T10:50:01.652367+0000","last_fullsized":"2024-05-12T10:50:01.652367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:41:09.157859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916505+0000","last_change":"2024-05-12T10:49:55.612069+0000","last_active":"2024-05-12T10:50:02.916505+0000","last_peered":"2024-05-12T10:50:02.916505+0000","last_clean":"2024-05-12T10:50:02.916505+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:50:02.916505+0000","last_undegraded":"2024-05-12T10:50:02.916505+0000","last_fullsized":"2024-05-12T10:50:02.916505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:38.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921005+0000","last_change":"2024-05-12T10:49:54.639928+0000","last_active":"2024-05-12T10:50:02.921005+0000","last_peered":"2024-05-12T10:50:02.921005+0000","last_clean":"2024-05-12T10:50:02.921005+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:50:02.921005+0000","last_undegraded":"2024-05-12T10:50:02.921005+0000","last_fullsized":"2024-05-12T10:50:02.921005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:59.215089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837562+0000","last_change":"2024-05-12T10:50:00.383605+0000","last_active":"2024-05-12T10:50:02.837562+0000","last_peered":"2024-05-12T10:50:02.837562+0000","last_clean":"2024-05-12T10:50:02.837562+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:50:02.837562+0000","last_undegraded":"2024-05-12T10:50:02.837562+0000","last_fullsized":"2024-05-12T10:50:02.837562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:28.619988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660251+0000","last_change":"2024-05-12T10:49:55.621201+0000","last_active":"2024-05-12T10:50:01.660251+0000","last_peered":"2024-05-12T10:50:01.660251+0000","last_clean":"2024-05-12T10:50:01.660251+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:50:01.660251+0000","last_undegraded":"2024-05-12T10:50:01.660251+0000","last_fullsized":"2024-05-12T10:50:01.660251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:19:39.117790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916601+0000","last_change":"2024-05-12T10:49:54.620329+0000","last_active":"2024-05-12T10:50:02.916601+0000","last_peered":"2024-05-12T10:50:02.916601+0000","last_clean":"2024-05-12T10:50:02.916601+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:50:02.916601+0000","last_undegraded":"2024-05-12T10:50:02.916601+0000","last_fullsized":"2024-05-12T10:50:02.916601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:21:10.386830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916162+0000","last_change":"2024-05-12T10:49:59.655432+0000","last_active":"2024-05-12T10:50:02.916162+0000","last_peered":"2024-05-12T10:50:02.916162+0000","last_clean":"2024-05-12T10:50:02.916162+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:50:02.916162+0000","last_undegraded":"2024-05-12T10:50:02.916162+0000","last_fullsized":"2024-05-12T10:50:02.916162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:27:34.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658413+0000","last_change":"2024-05-12T10:49:55.628221+0000","last_active":"2024-05-12T10:50:01.658413+0000","last_peered":"2024-05-12T10:50:01.658413+0000","last_clean":"2024-05-12T10:50:01.658413+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:50:01.658413+0000","last_undegraded":"2024-05-12T10:50:01.658413+0000","last_fullsized":"2024-05-12T10:50:01.658413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:54.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659836+0000","last_change":"2024-05-12T10:49:54.652499+0000","last_active":"2024-05-12T10:50:01.659836+0000","last_peered":"2024-05-12T10:50:01.659836+0000","last_clean":"2024-05-12T10:50:01.659836+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:50:01.659836+0000","last_undegraded":"2024-05-12T10:50:01.659836+0000","last_fullsized":"2024-05-12T10:50:01.659836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:14:35.180779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916502+0000","last_change":"2024-05-12T10:49:59.676676+0000","last_active":"2024-05-12T10:50:02.916502+0000","last_peered":"2024-05-12T10:50:02.916502+0000","last_clean":"2024-05-12T10:50:02.916502+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:50:02.916502+0000","last_undegraded":"2024-05-12T10:50:02.916502+0000","last_fullsized":"2024-05-12T10:50:02.916502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:03:13.485130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916164+0000","last_change":"2024-05-12T10:49:55.610830+0000","last_active":"2024-05-12T10:50:02.916164+0000","last_peered":"2024-05-12T10:50:02.916164+0000","last_clean":"2024-05-12T10:50:02.916164+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:50:02.916164+0000","last_undegraded":"2024-05-12T10:50:02.916164+0000","last_fullsized":"2024-05-12T10:50:02.916164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:15.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101999+0000","last_change":"2024-05-12T10:49:54.609239+0000","last_active":"2024-05-12T10:50:02.101999+0000","last_peered":"2024-05-12T10:50:02.101999+0000","last_clean":"2024-05-12T10:50:02.101999+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:50:02.101999+0000","last_undegraded":"2024-05-12T10:50:02.101999+0000","last_fullsized":"2024-05-12T10:50:02.101999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:12:54.169428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916817+0000","last_change":"2024-05-12T10:49:59.656739+0000","last_active":"2024-05-12T10:50:02.916817+0000","last_peered":"2024-05-12T10:50:02.916817+0000","last_clean":"2024-05-12T10:50:02.916817+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:50:02.916817+0000","last_undegraded":"2024-05-12T10:50:02.916817+0000","last_fullsized":"2024-05-12T10:50:02.916817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:05.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837232+0000","last_change":"2024-05-12T10:49:55.626312+0000","last_active":"2024-05-12T10:50:02.837232+0000","last_peered":"2024-05-12T10:50:02.837232+0000","last_clean":"2024-05-12T10:50:02.837232+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:50:02.837232+0000","last_undegraded":"2024-05-12T10:50:02.837232+0000","last_fullsized":"2024-05-12T10:50:02.837232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:36.639971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919870+0000","last_change":"2024-05-12T10:49:54.640819+0000","last_active":"2024-05-12T10:50:02.919870+0000","last_peered":"2024-05-12T10:50:02.919870+0000","last_clean":"2024-05-12T10:50:02.919870+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:50:02.919870+0000","last_undegraded":"2024-05-12T10:50:02.919870+0000","last_fullsized":"2024-05-12T10:50:02.919870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:01.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837983+0000","last_change":"2024-05-12T10:50:00.384347+0000","last_active":"2024-05-12T10:50:02.837983+0000","last_peered":"2024-05-12T10:50:02.837983+0000","last_clean":"2024-05-12T10:50:02.837983+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:50:02.837983+0000","last_undegraded":"2024-05-12T10:50:02.837983+0000","last_fullsized":"2024-05-12T10:50:02.837983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:30.794704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652533+0000","last_change":"2024-05-12T10:49:55.627340+0000","last_active":"2024-05-12T10:50:01.652533+0000","last_peered":"2024-05-12T10:50:01.652533+0000","last_clean":"2024-05-12T10:50:01.652533+0000","last_became_active":"2024-05-12T10:49:55.627065+0000","last_became_peered":"2024-05-12T10:49:55.627065+0000","last_unstale":"2024-05-12T10:50:01.652533+0000","last_undegraded":"2024-05-12T10:50:01.652533+0000","last_fullsized":"2024-05-12T10:50:01.652533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:57:50.849518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658936+0000","last_change":"2024-05-12T10:49:54.648333+0000","last_active":"2024-05-12T10:50:01.658936+0000","last_peered":"2024-05-12T10:50:01.658936+0000","last_clean":"2024-05-12T10:50:01.658936+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:50:01.658936+0000","last_undegraded":"2024-05-12T10:50:01.658936+0000","last_fullsized":"2024-05-12T10:50:01.658936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:29.355444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920043+0000","last_change":"2024-05-12T10:49:45.547469+0000","last_active":"2024-05-12T10:50:02.920043+0000","last_peered":"2024-05-12T10:50:02.920043+0000","last_clean":"2024-05-12T10:50:02.920043+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:50:02.920043+0000","last_undegraded":"2024-05-12T10:50:02.920043+0000","last_fullsized":"2024-05-12T10:50:02.920043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_clean_scrub_stamp":"2024-05-12T10:49:43.953472+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:44:15.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076721+0000","last_change":"2024-05-12T10:50:00.399288+0000","last_active":"2024-05-12T10:50:02.076721+0000","last_peered":"2024-05-12T10:50:02.076721+0000","last_clean":"2024-05-12T10:50:02.076721+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:50:02.076721+0000","last_undegraded":"2024-05-12T10:50:02.076721+0000","last_fullsized":"2024-05-12T10:50:02.076721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:26.959086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920561+0000","last_change":"2024-05-12T10:49:55.639605+0000","last_active":"2024-05-12T10:50:02.920561+0000","last_peered":"2024-05-12T10:50:02.920561+0000","last_clean":"2024-05-12T10:50:02.920561+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:50:02.920561+0000","last_undegraded":"2024-05-12T10:50:02.920561+0000","last_fullsized":"2024-05-12T10:50:02.920561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:46:26.585195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102261+0000","last_change":"2024-05-12T10:49:54.654999+0000","last_active":"2024-05-12T10:50:02.102261+0000","last_peered":"2024-05-12T10:50:02.102261+0000","last_clean":"2024-05-12T10:50:02.102261+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:50:02.102261+0000","last_undegraded":"2024-05-12T10:50:02.102261+0000","last_fullsized":"2024-05-12T10:50:02.102261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:00:20.115739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076118+0000","last_change":"2024-05-12T10:50:00.393017+0000","last_active":"2024-05-12T10:50:02.076118+0000","last_peered":"2024-05-12T10:50:02.076118+0000","last_clean":"2024-05-12T10:50:02.076118+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:50:02.076118+0000","last_undegraded":"2024-05-12T10:50:02.076118+0000","last_fullsized":"2024-05-12T10:50:02.076118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:01:02.394572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658363+0000","last_change":"2024-05-12T10:49:55.623665+0000","last_active":"2024-05-12T10:50:01.658363+0000","last_peered":"2024-05-12T10:50:01.658363+0000","last_clean":"2024-05-12T10:50:01.658363+0000","last_became_active":"2024-05-12T10:49:55.623403+0000","last_became_peered":"2024-05-12T10:49:55.623403+0000","last_unstale":"2024-05-12T10:50:01.658363+0000","last_undegraded":"2024-05-12T10:50:01.658363+0000","last_fullsized":"2024-05-12T10:50:01.658363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:18:25.399664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915873+0000","last_change":"2024-05-12T10:49:54.628492+0000","last_active":"2024-05-12T10:50:02.915873+0000","last_peered":"2024-05-12T10:50:02.915873+0000","last_clean":"2024-05-12T10:50:02.915873+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:50:02.915873+0000","last_undegraded":"2024-05-12T10:50:02.915873+0000","last_fullsized":"2024-05-12T10:50:02.915873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:35:38.949401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837763+0000","last_change":"2024-05-12T10:49:59.657783+0000","last_active":"2024-05-12T10:50:02.837763+0000","last_peered":"2024-05-12T10:50:02.837763+0000","last_clean":"2024-05-12T10:50:02.837763+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:50:02.837763+0000","last_undegraded":"2024-05-12T10:50:02.837763+0000","last_fullsized":"2024-05-12T10:50:02.837763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:51:21.103458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921189+0000","last_change":"2024-05-12T10:49:55.646246+0000","last_active":"2024-05-12T10:50:02.921189+0000","last_peered":"2024-05-12T10:50:02.921189+0000","last_clean":"2024-05-12T10:50:02.921189+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:50:02.921189+0000","last_undegraded":"2024-05-12T10:50:02.921189+0000","last_fullsized":"2024-05-12T10:50:02.921189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:32.142128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102403+0000","last_change":"2024-05-12T10:49:54.610076+0000","last_active":"2024-05-12T10:50:02.102403+0000","last_peered":"2024-05-12T10:50:02.102403+0000","last_clean":"2024-05-12T10:50:02.102403+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:50:02.102403+0000","last_undegraded":"2024-05-12T10:50:02.102403+0000","last_fullsized":"2024-05-12T10:50:02.102403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:12:04.400894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657078+0000","last_change":"2024-05-12T10:50:00.386172+0000","last_active":"2024-05-12T10:50:01.657078+0000","last_peered":"2024-05-12T10:50:01.657078+0000","last_clean":"2024-05-12T10:50:01.657078+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:50:01.657078+0000","last_undegraded":"2024-05-12T10:50:01.657078+0000","last_fullsized":"2024-05-12T10:50:01.657078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:06:17.550197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920926+0000","last_change":"2024-05-12T10:49:55.646249+0000","last_active":"2024-05-12T10:50:02.920926+0000","last_peered":"2024-05-12T10:50:02.920926+0000","last_clean":"2024-05-12T10:50:02.920926+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:50:02.920926+0000","last_undegraded":"2024-05-12T10:50:02.920926+0000","last_fullsized":"2024-05-12T10:50:02.920926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:15.036675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660898+0000","last_change":"2024-05-12T10:49:54.621293+0000","last_active":"2024-05-12T10:50:01.660898+0000","last_peered":"2024-05-12T10:50:01.660898+0000","last_clean":"2024-05-12T10:50:01.660898+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:50:01.660898+0000","last_undegraded":"2024-05-12T10:50:01.660898+0000","last_fullsized":"2024-05-12T10:50:01.660898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:45:33.341215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657581+0000","last_change":"2024-05-12T10:49:59.673656+0000","last_active":"2024-05-12T10:50:01.657581+0000","last_peered":"2024-05-12T10:50:01.657581+0000","last_clean":"2024-05-12T10:50:01.657581+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:50:01.657581+0000","last_undegraded":"2024-05-12T10:50:01.657581+0000","last_fullsized":"2024-05-12T10:50:01.657581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:38.364434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919917+0000","last_change":"2024-05-12T10:49:55.646526+0000","last_active":"2024-05-12T10:50:02.919917+0000","last_peered":"2024-05-12T10:50:02.919917+0000","last_clean":"2024-05-12T10:50:02.919917+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:50:02.919917+0000","last_undegraded":"2024-05-12T10:50:02.919917+0000","last_fullsized":"2024-05-12T10:50:02.919917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:56:52.102442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101889+0000","last_change":"2024-05-12T10:49:54.617906+0000","last_active":"2024-05-12T10:50:02.101889+0000","last_peered":"2024-05-12T10:50:02.101889+0000","last_clean":"2024-05-12T10:50:02.101889+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:50:02.101889+0000","last_undegraded":"2024-05-12T10:50:02.101889+0000","last_fullsized":"2024-05-12T10:50:02.101889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:26:35.150963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837853+0000","last_change":"2024-05-12T10:49:59.671791+0000","last_active":"2024-05-12T10:50:02.837853+0000","last_peered":"2024-05-12T10:50:02.837853+0000","last_clean":"2024-05-12T10:50:02.837853+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:50:02.837853+0000","last_undegraded":"2024-05-12T10:50:02.837853+0000","last_fullsized":"2024-05-12T10:50:02.837853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:27.425708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076017+0000","last_change":"2024-05-12T10:49:55.637810+0000","last_active":"2024-05-12T10:50:02.076017+0000","last_peered":"2024-05-12T10:50:02.076017+0000","last_clean":"2024-05-12T10:50:02.076017+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:50:02.076017+0000","last_undegraded":"2024-05-12T10:50:02.076017+0000","last_fullsized":"2024-05-12T10:50:02.076017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:52.001497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076035+0000","last_change":"2024-05-12T10:49:54.637728+0000","last_active":"2024-05-12T10:50:02.076035+0000","last_peered":"2024-05-12T10:50:02.076035+0000","last_clean":"2024-05-12T10:50:02.076035+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:50:02.076035+0000","last_undegraded":"2024-05-12T10:50:02.076035+0000","last_fullsized":"2024-05-12T10:50:02.076035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:39.996419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653563+0000","last_change":"2024-05-12T10:50:00.383444+0000","last_active":"2024-05-12T10:50:01.653563+0000","last_peered":"2024-05-12T10:50:01.653563+0000","last_clean":"2024-05-12T10:50:01.653563+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:50:01.653563+0000","last_undegraded":"2024-05-12T10:50:01.653563+0000","last_fullsized":"2024-05-12T10:50:01.653563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:55:04.226848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920128+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:50:02.920128+0000","last_peered":"2024-05-12T10:50:02.920128+0000","last_clean":"2024-05-12T10:50:02.920128+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:50:02.920128+0000","last_undegraded":"2024-05-12T10:50:02.920128+0000","last_fullsized":"2024-05-12T10:50:02.920128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:15:58.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660087+0000","last_change":"2024-05-12T10:49:54.656814+0000","last_active":"2024-05-12T10:50:01.660087+0000","last_peered":"2024-05-12T10:50:01.660087+0000","last_clean":"2024-05-12T10:50:01.660087+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:50:01.660087+0000","last_undegraded":"2024-05-12T10:50:01.660087+0000","last_fullsized":"2024-05-12T10:50:01.660087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:26.660043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653232+0000","last_change":"2024-05-12T10:50:00.390308+0000","last_active":"2024-05-12T10:50:01.653232+0000","last_peered":"2024-05-12T10:50:01.653232+0000","last_clean":"2024-05-12T10:50:01.653232+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:50:01.653232+0000","last_undegraded":"2024-05-12T10:50:01.653232+0000","last_fullsized":"2024-05-12T10:50:01.653232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:43.650956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837442+0000","last_change":"2024-05-12T10:49:55.628907+0000","last_active":"2024-05-12T10:50:02.837442+0000","last_peered":"2024-05-12T10:50:02.837442+0000","last_clean":"2024-05-12T10:50:02.837442+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:50:02.837442+0000","last_undegraded":"2024-05-12T10:50:02.837442+0000","last_fullsized":"2024-05-12T10:50:02.837442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:13:50.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837019+0000","last_change":"2024-05-12T10:49:54.626002+0000","last_active":"2024-05-12T10:50:02.837019+0000","last_peered":"2024-05-12T10:50:02.837019+0000","last_clean":"2024-05-12T10:50:02.837019+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:50:02.837019+0000","last_undegraded":"2024-05-12T10:50:02.837019+0000","last_fullsized":"2024-05-12T10:50:02.837019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:19:19.976387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659867+0000","last_change":"2024-05-12T10:50:00.387192+0000","last_active":"2024-05-12T10:50:01.659867+0000","last_peered":"2024-05-12T10:50:01.659867+0000","last_clean":"2024-05-12T10:50:01.659867+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:50:01.659867+0000","last_undegraded":"2024-05-12T10:50:01.659867+0000","last_fullsized":"2024-05-12T10:50:01.659867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:15:23.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920487+0000","last_change":"2024-05-12T10:49:55.634551+0000","last_active":"2024-05-12T10:50:02.920487+0000","last_peered":"2024-05-12T10:50:02.920487+0000","last_clean":"2024-05-12T10:50:02.920487+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:50:02.920487+0000","last_undegraded":"2024-05-12T10:50:02.920487+0000","last_fullsized":"2024-05-12T10:50:02.920487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:10:52.477145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:09.379163+0000","last_change":"2024-05-12T10:49:54.634748+0000","last_active":"2024-05-12T10:50:09.379163+0000","last_peered":"2024-05-12T10:50:09.379163+0000","last_clean":"2024-05-12T10:50:09.379163+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:50:09.379163+0000","last_undegraded":"2024-05-12T10:50:09.379163+0000","last_fullsized":"2024-05-12T10:50:09.379163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:39:16.646133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916160+0000","last_change":"2024-05-12T10:49:59.671405+0000","last_active":"2024-05-12T10:50:02.916160+0000","last_peered":"2024-05-12T10:50:02.916160+0000","last_clean":"2024-05-12T10:50:02.916160+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:50:02.916160+0000","last_undegraded":"2024-05-12T10:50:02.916160+0000","last_fullsized":"2024-05-12T10:50:02.916160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:06:34.170753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659820+0000","last_change":"2024-05-12T10:49:55.634686+0000","last_active":"2024-05-12T10:50:01.659820+0000","last_peered":"2024-05-12T10:50:01.659820+0000","last_clean":"2024-05-12T10:50:01.659820+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:50:01.659820+0000","last_undegraded":"2024-05-12T10:50:01.659820+0000","last_fullsized":"2024-05-12T10:50:01.659820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:25:04.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915889+0000","last_change":"2024-05-12T10:49:54.656012+0000","last_active":"2024-05-12T10:50:02.915889+0000","last_peered":"2024-05-12T10:50:02.915889+0000","last_clean":"2024-05-12T10:50:02.915889+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:50:02.915889+0000","last_undegraded":"2024-05-12T10:50:02.915889+0000","last_fullsized":"2024-05-12T10:50:02.915889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:29.253250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658272+0000","last_change":"2024-05-12T10:49:59.672820+0000","last_active":"2024-05-12T10:50:01.658272+0000","last_peered":"2024-05-12T10:50:01.658272+0000","last_clean":"2024-05-12T10:50:01.658272+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:50:01.658272+0000","last_undegraded":"2024-05-12T10:50:01.658272+0000","last_fullsized":"2024-05-12T10:50:01.658272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:49:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838093+0000","last_change":"2024-05-12T10:49:55.620541+0000","last_active":"2024-05-12T10:50:02.838093+0000","last_peered":"2024-05-12T10:50:02.838093+0000","last_clean":"2024-05-12T10:50:02.838093+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:50:02.838093+0000","last_undegraded":"2024-05-12T10:50:02.838093+0000","last_fullsized":"2024-05-12T10:50:02.838093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:11.742829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660247+0000","last_change":"2024-05-12T10:49:54.651289+0000","last_active":"2024-05-12T10:50:01.660247+0000","last_peered":"2024-05-12T10:50:01.660247+0000","last_clean":"2024-05-12T10:50:01.660247+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:50:01.660247+0000","last_undegraded":"2024-05-12T10:50:01.660247+0000","last_fullsized":"2024-05-12T10:50:01.660247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:33:24.087763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652523+0000","last_change":"2024-05-12T10:49:59.670973+0000","last_active":"2024-05-12T10:50:01.652523+0000","last_peered":"2024-05-12T10:50:01.652523+0000","last_clean":"2024-05-12T10:50:01.652523+0000","last_became_active":"2024-05-12T10:49:59.670656+0000","last_became_peered":"2024-05-12T10:49:59.670656+0000","last_unstale":"2024-05-12T10:50:01.652523+0000","last_undegraded":"2024-05-12T10:50:01.652523+0000","last_fullsized":"2024-05-12T10:50:01.652523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:16:58.665403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659979+0000","last_change":"2024-05-12T10:49:55.626645+0000","last_active":"2024-05-12T10:50:01.659979+0000","last_peered":"2024-05-12T10:50:01.659979+0000","last_clean":"2024-05-12T10:50:01.659979+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:50:01.659979+0000","last_undegraded":"2024-05-12T10:50:01.659979+0000","last_fullsized":"2024-05-12T10:50:01.659979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:41.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076937+0000","last_change":"2024-05-12T10:49:54.654822+0000","last_active":"2024-05-12T10:50:02.076937+0000","last_peered":"2024-05-12T10:50:02.076937+0000","last_clean":"2024-05-12T10:50:02.076937+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:50:02.076937+0000","last_undegraded":"2024-05-12T10:50:02.076937+0000","last_fullsized":"2024-05-12T10:50:02.076937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:52:07.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652430+0000","last_change":"2024-05-12T10:50:00.396453+0000","last_active":"2024-05-12T10:50:01.652430+0000","last_peered":"2024-05-12T10:50:01.652430+0000","last_clean":"2024-05-12T10:50:01.652430+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:50:01.652430+0000","last_undegraded":"2024-05-12T10:50:01.652430+0000","last_fullsized":"2024-05-12T10:50:01.652430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:40.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837810+0000","last_change":"2024-05-12T10:50:00.390477+0000","last_active":"2024-05-12T10:50:02.837810+0000","last_peered":"2024-05-12T10:50:02.837810+0000","last_clean":"2024-05-12T10:50:02.837810+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:50:02.837810+0000","last_undegraded":"2024-05-12T10:50:02.837810+0000","last_fullsized":"2024-05-12T10:50:02.837810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:20:19.551216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916112+0000","last_change":"2024-05-12T10:49:55.619984+0000","last_active":"2024-05-12T10:50:02.916112+0000","last_peered":"2024-05-12T10:50:02.916112+0000","last_clean":"2024-05-12T10:50:02.916112+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:50:02.916112+0000","last_undegraded":"2024-05-12T10:50:02.916112+0000","last_fullsized":"2024-05-12T10:50:02.916112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:21:34.136203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657970+0000","last_change":"2024-05-12T10:49:54.656580+0000","last_active":"2024-05-12T10:50:01.657970+0000","last_peered":"2024-05-12T10:50:01.657970+0000","last_clean":"2024-05-12T10:50:01.657970+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:50:01.657970+0000","last_undegraded":"2024-05-12T10:50:01.657970+0000","last_fullsized":"2024-05-12T10:50:01.657970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:43:32.603999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076883+0000","last_change":"2024-05-12T10:49:59.681648+0000","last_active":"2024-05-12T10:50:02.076883+0000","last_peered":"2024-05-12T10:50:02.076883+0000","last_clean":"2024-05-12T10:50:02.076883+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:50:02.076883+0000","last_undegraded":"2024-05-12T10:50:02.076883+0000","last_fullsized":"2024-05-12T10:50:02.076883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:54.912836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652618+0000","last_change":"2024-05-12T10:49:55.617393+0000","last_active":"2024-05-12T10:50:01.652618+0000","last_peered":"2024-05-12T10:50:01.652618+0000","last_clean":"2024-05-12T10:50:01.652618+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:50:01.652618+0000","last_undegraded":"2024-05-12T10:50:01.652618+0000","last_fullsized":"2024-05-12T10:50:01.652618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:51.584695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652565+0000","last_change":"2024-05-12T10:49:54.637393+0000","last_active":"2024-05-12T10:50:01.652565+0000","last_peered":"2024-05-12T10:50:01.652565+0000","last_clean":"2024-05-12T10:50:01.652565+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:50:01.652565+0000","last_undegraded":"2024-05-12T10:50:01.652565+0000","last_fullsized":"2024-05-12T10:50:01.652565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:44:00.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076344+0000","last_change":"2024-05-12T10:49:54.636945+0000","last_active":"2024-05-12T10:50:02.076344+0000","last_peered":"2024-05-12T10:50:02.076344+0000","last_clean":"2024-05-12T10:50:02.076344+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:50:02.076344+0000","last_undegraded":"2024-05-12T10:50:02.076344+0000","last_fullsized":"2024-05-12T10:50:02.076344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:34:25.927458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837878+0000","last_change":"2024-05-12T10:49:55.627105+0000","last_active":"2024-05-12T10:50:02.837878+0000","last_peered":"2024-05-12T10:50:02.837878+0000","last_clean":"2024-05-12T10:50:02.837878+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:50:02.837878+0000","last_undegraded":"2024-05-12T10:50:02.837878+0000","last_fullsized":"2024-05-12T10:50:02.837878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:00:09.334541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102212+0000","last_change":"2024-05-12T10:49:59.659142+0000","last_active":"2024-05-12T10:50:02.102212+0000","last_peered":"2024-05-12T10:50:02.102212+0000","last_clean":"2024-05-12T10:50:02.102212+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:50:02.102212+0000","last_undegraded":"2024-05-12T10:50:02.102212+0000","last_fullsized":"2024-05-12T10:50:02.102212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:40.443593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652797+0000","last_change":"2024-05-12T10:49:54.632224+0000","last_active":"2024-05-12T10:50:01.652797+0000","last_peered":"2024-05-12T10:50:01.652797+0000","last_clean":"2024-05-12T10:50:01.652797+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:50:01.652797+0000","last_undegraded":"2024-05-12T10:50:01.652797+0000","last_fullsized":"2024-05-12T10:50:01.652797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:27:39.637678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659206+0000","last_change":"2024-05-12T10:49:55.633243+0000","last_active":"2024-05-12T10:50:01.659206+0000","last_peered":"2024-05-12T10:50:01.659206+0000","last_clean":"2024-05-12T10:50:01.659206+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:50:01.659206+0000","last_undegraded":"2024-05-12T10:50:01.659206+0000","last_fullsized":"2024-05-12T10:50:01.659206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:14.239020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652874+0000","last_change":"2024-05-12T10:49:59.655807+0000","last_active":"2024-05-12T10:50:01.652874+0000","last_peered":"2024-05-12T10:50:01.652874+0000","last_clean":"2024-05-12T10:50:01.652874+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:50:01.652874+0000","last_undegraded":"2024-05-12T10:50:01.652874+0000","last_fullsized":"2024-05-12T10:50:01.652874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:12.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075680+0000","last_change":"2024-05-12T10:49:55.637106+0000","last_active":"2024-05-12T10:50:02.075680+0000","last_peered":"2024-05-12T10:50:02.075680+0000","last_clean":"2024-05-12T10:50:02.075680+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:50:02.075680+0000","last_undegraded":"2024-05-12T10:50:02.075680+0000","last_fullsized":"2024-05-12T10:50:02.075680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:22:07.477677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101967+0000","last_change":"2024-05-12T10:49:55.618952+0000","last_active":"2024-05-12T10:50:02.101967+0000","last_peered":"2024-05-12T10:50:02.101967+0000","last_clean":"2024-05-12T10:50:02.101967+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:50:02.101967+0000","last_undegraded":"2024-05-12T10:50:02.101967+0000","last_fullsized":"2024-05-12T10:50:02.101967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:38:10.693066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659549+0000","last_change":"2024-05-12T10:49:55.623916+0000","last_active":"2024-05-12T10:50:01.659549+0000","last_peered":"2024-05-12T10:50:01.659549+0000","last_clean":"2024-05-12T10:50:01.659549+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:50:01.659549+0000","last_undegraded":"2024-05-12T10:50:01.659549+0000","last_fullsized":"2024-05-12T10:50:01.659549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:06:14.434631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837761+0000","last_change":"2024-05-12T10:49:55.620278+0000","last_active":"2024-05-12T10:50:02.837761+0000","last_peered":"2024-05-12T10:50:02.837761+0000","last_clean":"2024-05-12T10:50:02.837761+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:50:02.837761+0000","last_undegraded":"2024-05-12T10:50:02.837761+0000","last_fullsized":"2024-05-12T10:50:02.837761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:59.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653439+0000","last_change":"2024-05-12T10:49:55.626216+0000","last_active":"2024-05-12T10:50:01.653439+0000","last_peered":"2024-05-12T10:50:01.653439+0000","last_clean":"2024-05-12T10:50:01.653439+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:50:01.653439+0000","last_undegraded":"2024-05-12T10:50:01.653439+0000","last_fullsized":"2024-05-12T10:50:01.653439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:52:14.438331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916463+0000","last_change":"2024-05-12T10:49:55.622085+0000","last_active":"2024-05-12T10:50:02.916463+0000","last_peered":"2024-05-12T10:50:02.916463+0000","last_clean":"2024-05-12T10:50:02.916463+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:50:02.916463+0000","last_undegraded":"2024-05-12T10:50:02.916463+0000","last_fullsized":"2024-05-12T10:50:02.916463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:41:42.558506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076984+0000","last_change":"2024-05-12T10:49:55.635592+0000","last_active":"2024-05-12T10:50:02.076984+0000","last_peered":"2024-05-12T10:50:02.076984+0000","last_clean":"2024-05-12T10:50:02.076984+0000","last_became_active":"2024-05-12T10:49:55.635298+0000","last_became_peered":"2024-05-12T10:49:55.635298+0000","last_unstale":"2024-05-12T10:50:02.076984+0000","last_undegraded":"2024-05-12T10:50:02.076984+0000","last_fullsized":"2024-05-12T10:50:02.076984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:43:14.781372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653476+0000","last_change":"2024-05-12T10:49:55.626353+0000","last_active":"2024-05-12T10:50:01.653476+0000","last_peered":"2024-05-12T10:50:01.653476+0000","last_clean":"2024-05-12T10:50:01.653476+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:50:01.653476+0000","last_undegraded":"2024-05-12T10:50:01.653476+0000","last_fullsized":"2024-05-12T10:50:01.653476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:58.905284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657725+0000","last_change":"2024-05-12T10:49:55.621110+0000","last_active":"2024-05-12T10:50:01.657725+0000","last_peered":"2024-05-12T10:50:01.657725+0000","last_clean":"2024-05-12T10:50:01.657725+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:50:01.657725+0000","last_undegraded":"2024-05-12T10:50:01.657725+0000","last_fullsized":"2024-05-12T10:50:01.657725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:12:36.369923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652483+0000","last_change":"2024-05-12T10:49:55.626913+0000","last_active":"2024-05-12T10:50:01.652483+0000","last_peered":"2024-05-12T10:50:01.652483+0000","last_clean":"2024-05-12T10:50:01.652483+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:50:01.652483+0000","last_undegraded":"2024-05-12T10:50:01.652483+0000","last_fullsized":"2024-05-12T10:50:01.652483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:27:08.492294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659499+0000","last_change":"2024-05-12T10:49:55.629992+0000","last_active":"2024-05-12T10:50:01.659499+0000","last_peered":"2024-05-12T10:50:01.659499+0000","last_clean":"2024-05-12T10:50:01.659499+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:50:01.659499+0000","last_undegraded":"2024-05-12T10:50:01.659499+0000","last_fullsized":"2024-05-12T10:50:01.659499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:31.454363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837524+0000","last_change":"2024-05-12T10:49:55.620821+0000","last_active":"2024-05-12T10:50:02.837524+0000","last_peered":"2024-05-12T10:50:02.837524+0000","last_clean":"2024-05-12T10:50:02.837524+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:50:02.837524+0000","last_undegraded":"2024-05-12T10:50:02.837524+0000","last_fullsized":"2024-05-12T10:50:02.837524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:53.597215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076297+0000","last_change":"2024-05-12T10:49:55.646368+0000","last_active":"2024-05-12T10:50:02.076297+0000","last_peered":"2024-05-12T10:50:02.076297+0000","last_clean":"2024-05-12T10:50:02.076297+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:50:02.076297+0000","last_undegraded":"2024-05-12T10:50:02.076297+0000","last_fullsized":"2024-05-12T10:50:02.076297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:21:04.313921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920866+0000","last_change":"2024-05-12T10:49:55.633122+0000","last_active":"2024-05-12T10:50:02.920866+0000","last_peered":"2024-05-12T10:50:02.920866+0000","last_clean":"2024-05-12T10:50:02.920866+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:50:02.920866+0000","last_undegraded":"2024-05-12T10:50:02.920866+0000","last_fullsized":"2024-05-12T10:50:02.920866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:25:19.563648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102362+0000","last_change":"2024-05-12T10:49:55.635394+0000","last_active":"2024-05-12T10:50:02.102362+0000","last_peered":"2024-05-12T10:50:02.102362+0000","last_clean":"2024-05-12T10:50:02.102362+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:50:02.102362+0000","last_undegraded":"2024-05-12T10:50:02.102362+0000","last_fullsized":"2024-05-12T10:50:02.102362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:41:58.478292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660761+0000","last_change":"2024-05-12T10:49:55.626485+0000","last_active":"2024-05-12T10:50:01.660761+0000","last_peered":"2024-05-12T10:50:01.660761+0000","last_clean":"2024-05-12T10:50:01.660761+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:50:01.660761+0000","last_undegraded":"2024-05-12T10:50:01.660761+0000","last_fullsized":"2024-05-12T10:50:01.660761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:17.942339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657391+0000","last_change":"2024-05-12T10:49:55.618820+0000","last_active":"2024-05-12T10:50:01.657391+0000","last_peered":"2024-05-12T10:50:01.657391+0000","last_clean":"2024-05-12T10:50:01.657391+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:50:01.657391+0000","last_undegraded":"2024-05-12T10:50:01.657391+0000","last_fullsized":"2024-05-12T10:50:01.657391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:23:00.474438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916163+0000","last_change":"2024-05-12T10:49:55.626429+0000","last_active":"2024-05-12T10:50:02.916163+0000","last_peered":"2024-05-12T10:50:02.916163+0000","last_clean":"2024-05-12T10:50:02.916163+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:50:02.916163+0000","last_undegraded":"2024-05-12T10:50:02.916163+0000","last_fullsized":"2024-05-12T10:50:02.916163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:40:02.709729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837421+0000","last_change":"2024-05-12T10:49:55.612139+0000","last_active":"2024-05-12T10:50:02.837421+0000","last_peered":"2024-05-12T10:50:02.837421+0000","last_clean":"2024-05-12T10:50:02.837421+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:50:02.837421+0000","last_undegraded":"2024-05-12T10:50:02.837421+0000","last_fullsized":"2024-05-12T10:50:02.837421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:57:34.138392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652690+0000","last_change":"2024-05-12T10:49:55.631137+0000","last_active":"2024-05-12T10:50:01.652690+0000","last_peered":"2024-05-12T10:50:01.652690+0000","last_clean":"2024-05-12T10:50:01.652690+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:50:01.652690+0000","last_undegraded":"2024-05-12T10:50:01.652690+0000","last_fullsized":"2024-05-12T10:50:01.652690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:04.390314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659797+0000","last_change":"2024-05-12T10:49:55.643416+0000","last_active":"2024-05-12T10:50:01.659797+0000","last_peered":"2024-05-12T10:50:01.659797+0000","last_clean":"2024-05-12T10:50:01.659797+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:50:01.659797+0000","last_undegraded":"2024-05-12T10:50:01.659797+0000","last_fullsized":"2024-05-12T10:50:01.659797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:58.632966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076802+0000","last_change":"2024-05-12T10:49:55.635847+0000","last_active":"2024-05-12T10:50:02.076802+0000","last_peered":"2024-05-12T10:50:02.076802+0000","last_clean":"2024-05-12T10:50:02.076802+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:50:02.076802+0000","last_undegraded":"2024-05-12T10:50:02.076802+0000","last_fullsized":"2024-05-12T10:50:02.076802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:57:51.222099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076561+0000","last_change":"2024-05-12T10:49:55.641921+0000","last_active":"2024-05-12T10:50:02.076561+0000","last_peered":"2024-05-12T10:50:02.076561+0000","last_clean":"2024-05-12T10:50:02.076561+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:50:02.076561+0000","last_undegraded":"2024-05-12T10:50:02.076561+0000","last_fullsized":"2024-05-12T10:50:02.076561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:44:57.787358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921179+0000","last_change":"2024-05-12T10:49:55.635853+0000","last_active":"2024-05-12T10:50:02.921179+0000","last_peered":"2024-05-12T10:50:02.921179+0000","last_clean":"2024-05-12T10:50:02.921179+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:50:02.921179+0000","last_undegraded":"2024-05-12T10:50:02.921179+0000","last_fullsized":"2024-05-12T10:50:02.921179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:04:39.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652297+0000","last_change":"2024-05-12T10:49:55.620107+0000","last_active":"2024-05-12T10:50:01.652297+0000","last_peered":"2024-05-12T10:50:01.652297+0000","last_clean":"2024-05-12T10:50:01.652297+0000","last_became_active":"2024-05-12T10:49:55.619802+0000","last_became_peered":"2024-05-12T10:49:55.619802+0000","last_unstale":"2024-05-12T10:50:01.652297+0000","last_undegraded":"2024-05-12T10:50:01.652297+0000","last_fullsized":"2024-05-12T10:50:01.652297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:52:39.033778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920076+0000","last_change":"2024-05-12T10:49:55.629001+0000","last_active":"2024-05-12T10:50:02.920076+0000","last_peered":"2024-05-12T10:50:02.920076+0000","last_clean":"2024-05-12T10:50:02.920076+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:50:02.920076+0000","last_undegraded":"2024-05-12T10:50:02.920076+0000","last_fullsized":"2024-05-12T10:50:02.920076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:42:39.042271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659136+0000","last_change":"2024-05-12T10:49:55.625540+0000","last_active":"2024-05-12T10:50:01.659136+0000","last_peered":"2024-05-12T10:50:01.659136+0000","last_clean":"2024-05-12T10:50:01.659136+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:50:01.659136+0000","last_undegraded":"2024-05-12T10:50:01.659136+0000","last_fullsized":"2024-05-12T10:50:01.659136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:35.621918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919665+0000","last_change":"2024-05-12T10:49:55.633576+0000","last_active":"2024-05-12T10:50:02.919665+0000","last_peered":"2024-05-12T10:50:02.919665+0000","last_clean":"2024-05-12T10:50:02.919665+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:50:02.919665+0000","last_undegraded":"2024-05-12T10:50:02.919665+0000","last_fullsized":"2024-05-12T10:50:02.919665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:06:16.255147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657885+0000","last_change":"2024-05-12T10:49:55.624205+0000","last_active":"2024-05-12T10:50:01.657885+0000","last_peered":"2024-05-12T10:50:01.657885+0000","last_clean":"2024-05-12T10:50:01.657885+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:50:01.657885+0000","last_undegraded":"2024-05-12T10:50:01.657885+0000","last_fullsized":"2024-05-12T10:50:01.657885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:21.895269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837757+0000","last_change":"2024-05-12T10:49:55.610461+0000","last_active":"2024-05-12T10:50:02.837757+0000","last_peered":"2024-05-12T10:50:02.837757+0000","last_clean":"2024-05-12T10:50:02.837757+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:50:02.837757+0000","last_undegraded":"2024-05-12T10:50:02.837757+0000","last_fullsized":"2024-05-12T10:50:02.837757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:44.511895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916628+0000","last_change":"2024-05-12T10:49:55.608434+0000","last_active":"2024-05-12T10:50:02.916628+0000","last_peered":"2024-05-12T10:50:02.916628+0000","last_clean":"2024-05-12T10:50:02.916628+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:50:02.916628+0000","last_undegraded":"2024-05-12T10:50:02.916628+0000","last_fullsized":"2024-05-12T10:50:02.916628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:17.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920943+0000","last_change":"2024-05-12T10:49:55.639296+0000","last_active":"2024-05-12T10:50:02.920943+0000","last_peered":"2024-05-12T10:50:02.920943+0000","last_clean":"2024-05-12T10:50:02.920943+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:50:02.920943+0000","last_undegraded":"2024-05-12T10:50:02.920943+0000","last_fullsized":"2024-05-12T10:50:02.920943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:47:15.862328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":701646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":110786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:50:26.441 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:50:26.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.621+0000 7f4d10c00640 1 Processor -- start 2024-05-12T10:50:26.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.621+0000 7f4d10c00640 1 -- start start 2024-05-12T10:50:26.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d10c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d0c0713f0 0x7f4d0c15a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:26.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d10c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d0c0cb9f0 0x7f4d0c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:26.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d10c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c153fa0 con 0x7f4d0c153bc0 2024-05-12T10:50:26.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d10c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0c0ca350 con 0x7f4d0c0cb9f0 2024-05-12T10:50:26.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d10c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c0ca6d0 con 0x7f4d0c0713f0 2024-05-12T10:50:26.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d0b400640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4d0c153bc0 0x7f4d0c070980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:56224/0 (socket says 172.21.15.115:56224) 2024-05-12T10:50:26.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d0b400640 1 -- 172.21.15.115:0/1564381290 learned_addr learned my addr 172.21.15.115:0/1564381290 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:26.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d0aa00640 1 --2- 172.21.15.115:0/1564381290 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d0c0713f0 0x7f4d0c15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:26.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d0be00640 1 --2- 172.21.15.115:0/1564381290 >> v2:172.21.15.134:3300/0 conn(0x7f4d0c0cb9f0 0x7f4d0c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:26.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d0a000640 1 -- 172.21.15.115:0/1564381290 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216819701 0 0) 0x7f4d0c153fa0 con 0x7f4d0c153bc0 2024-05-12T10:50:26.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d0a000640 1 -- 172.21.15.115:0/1564381290 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf0003530 con 0x7f4d0c153bc0 2024-05-12T10:50:26.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d0aa00640 1 -- 172.21.15.115:0/1564381290 >> v2:172.21.15.134:3300/0 conn(0x7f4d0c0cb9f0 msgr2=0x7f4d0c0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:26.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d0aa00640 1 --2- 172.21.15.115:0/1564381290 >> v2:172.21.15.134:3300/0 conn(0x7f4d0c0cb9f0 0x7f4d0c0cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d0aa00640 1 -- 172.21.15.115:0/1564381290 >> v1:172.21.15.134:6789/0 conn(0x7f4d0c153bc0 legacy=0x7f4d0c070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d0aa00640 1 -- 172.21.15.115:0/1564381290 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c0ca9b0 con 0x7f4d0c0713f0 2024-05-12T10:50:26.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.625+0000 7f4d0be00640 1 --2- 172.21.15.115:0/1564381290 >> v2:172.21.15.134:3300/0 conn(0x7f4d0c0cb9f0 0x7f4d0c0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:26.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d0aa00640 1 --2- 172.21.15.115:0/1564381290 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d0c0713f0 0x7f4d0c15a330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80097c0 tx=0x7f4cf801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75154c0a3e131ae1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:26.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d0a000640 1 -- 172.21.15.115:0/1564381290 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80b1070 con 0x7f4d0c0713f0 2024-05-12T10:50:26.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d0a000640 1 -- 172.21.15.115:0/1564381290 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf80ac410 con 0x7f4d0c0713f0 2024-05-12T10:50:26.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d0a000640 1 -- 172.21.15.115:0/1564381290 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80ac7c0 con 0x7f4d0c0713f0 2024-05-12T10:50:26.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d10c00640 1 -- 172.21.15.115:0/1564381290 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d0c0713f0 msgr2=0x7f4d0c15a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d10c00640 1 --2- 172.21.15.115:0/1564381290 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d0c0713f0 0x7f4d0c15a330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80097c0 tx=0x7f4cf801c4a0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d10c00640 1 -- 172.21.15.115:0/1564381290 shutdown_connections 2024-05-12T10:50:26.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d10c00640 1 --2- 172.21.15.115:0/1564381290 >> v2:172.21.15.134:3300/0 conn(0x7f4d0c0cb9f0 0x7f4d0c0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d10c00640 1 --2- 172.21.15.115:0/1564381290 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d0c0713f0 0x7f4d0c15a330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d10c00640 1 -- 172.21.15.115:0/1564381290 >> 172.21.15.115:0/1564381290 conn(0x7f4d0c071e30 msgr2=0x7f4d0c072240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:26.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d10c00640 1 -- 172.21.15.115:0/1564381290 shutdown_connections 2024-05-12T10:50:26.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d10c00640 1 -- 172.21.15.115:0/1564381290 wait complete. 2024-05-12T10:50:26.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d10c00640 1 Processor -- start 2024-05-12T10:50:26.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.629+0000 7f4d10c00640 1 -- start start 2024-05-12T10:50:26.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d10c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c0713f0 0x7f4d0c0cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:26.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d10c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d0c0cb9f0 0x7f4d0c15acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:26.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d10c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d0c153bc0 0x7f4d0c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:26.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d10c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c071210 con 0x7f4d0c153bc0 2024-05-12T10:50:26.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d10c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c071090 con 0x7f4d0c0713f0 2024-05-12T10:50:26.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d10c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c166a30 con 0x7f4d0c0cb9f0 2024-05-12T10:50:26.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d0be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d0c153bc0 0x7f4d0c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d0be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d0c153bc0 0x7f4d0c14ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53036/0 (socket says 172.21.15.115:53036) 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d0be00640 1 -- 172.21.15.115:0/2909138489 learned_addr learned my addr 172.21.15.115:0/2909138489 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d0b400640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c0713f0 0x7f4d0c0cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d0aa00640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d0c0cb9f0 0x7f4d0c15acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d0be00640 1 -- 172.21.15.115:0/2909138489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d0c0cb9f0 msgr2=0x7f4d0c15acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d0be00640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d0c0cb9f0 0x7f4d0c15acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d0be00640 1 -- 172.21.15.115:0/2909138489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c0713f0 msgr2=0x7f4d0c0cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d0be00640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c0713f0 0x7f4d0c0cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d0be00640 1 -- 172.21.15.115:0/2909138489 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c15cd40 con 0x7f4d0c153bc0 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d0be00640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d0c153bc0 0x7f4d0c14ebc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009f00 tx=0x7f4d0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d03400640 1 -- 172.21.15.115:0/2909138489 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04018030 con 0x7f4d0c153bc0 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d03400640 1 -- 172.21.15.115:0/2909138489 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0400ce50 con 0x7f4d0c153bc0 2024-05-12T10:50:26.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d03400640 1 -- 172.21.15.115:0/2909138489 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04003bc0 con 0x7f4d0c153bc0 2024-05-12T10:50:26.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d10c00640 1 -- 172.21.15.115:0/2909138489 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c15cfe0 con 0x7f4d0c153bc0 2024-05-12T10:50:26.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d10c00640 1 -- 172.21.15.115:0/2909138489 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0c0cf420 con 0x7f4d0c153bc0 2024-05-12T10:50:26.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.633+0000 7f4d10c00640 1 -- 172.21.15.115:0/2909138489 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0c050750 con 0x7f4d0c153bc0 2024-05-12T10:50:26.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.637+0000 7f4d03400640 1 -- 172.21.15.115:0/2909138489 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4d0401b070 con 0x7f4d0c153bc0 2024-05-12T10:50:26.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.637+0000 7f4d03400640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4cec06f400 0x7f4cec0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:26.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.637+0000 7f4d03400640 1 -- 172.21.15.115:0/2909138489 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4d0408fee0 con 0x7f4d0c153bc0 2024-05-12T10:50:26.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.637+0000 7f4d0b400640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4cec06f400 0x7f4cec0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:26.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.637+0000 7f4d0b400640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4cec06f400 0x7f4cec0718c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc007a70 tx=0x7f4cfc0079c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:26.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.641+0000 7f4d03400640 1 -- 172.21.15.115:0/2909138489 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4d04010040 con 0x7f4d0c153bc0 2024-05-12T10:50:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.797+0000 7f4d10c00640 1 -- 172.21.15.115:0/2909138489 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d0c0c58a0 con 0x7f4cec06f400 2024-05-12T10:50:26.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.805+0000 7f4d03400640 1 -- 172.21.15.115:0/2909138489 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7f4d0c0c58a0 con 0x7f4cec06f400 2024-05-12T10:50:26.803 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:26.805 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:50:26.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 -- 172.21.15.115:0/2909138489 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4cec06f400 msgr2=0x7f4cec0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4cec06f400 0x7f4cec0718c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc007a70 tx=0x7f4cfc0079c0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 -- 172.21.15.115:0/2909138489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d0c153bc0 msgr2=0x7f4d0c14ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:26.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d0c153bc0 0x7f4d0c14ebc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009f00 tx=0x7f4d0400c490 comp rx=0 tx=0).stop 2024-05-12T10:50:26.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 -- 172.21.15.115:0/2909138489 shutdown_connections 2024-05-12T10:50:26.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4cec06f400 0x7f4cec0718c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d0c153bc0 0x7f4d0c14ebc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d0c0cb9f0 0x7f4d0c15acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 --2- 172.21.15.115:0/2909138489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c0713f0 0x7f4d0c0cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:26.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 -- 172.21.15.115:0/2909138489 >> 172.21.15.115:0/2909138489 conn(0x7f4d0c071e30 msgr2=0x7f4d0c151f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:26.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 -- 172.21.15.115:0/2909138489 shutdown_connections 2024-05-12T10:50:26.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:26.809+0000 7f4d10c00640 1 -- 172.21.15.115:0/2909138489 wait complete. 2024-05-12T10:50:26.823 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-05-12T10:50:25.759662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219524,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755196,"statfs":{"total":773094113280,"available":772869320704,"internally_reserved":0,"allocated":3448832,"data_stored":2075584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005923"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838171+0000","last_change":"2024-05-12T10:49:54.640093+0000","last_active":"2024-05-12T10:50:02.838171+0000","last_peered":"2024-05-12T10:50:02.838171+0000","last_clean":"2024-05-12T10:50:02.838171+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:50:02.838171+0000","last_undegraded":"2024-05-12T10:50:02.838171+0000","last_fullsized":"2024-05-12T10:50:02.838171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:07:41.639104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653116+0000","last_change":"2024-05-12T10:49:55.635928+0000","last_active":"2024-05-12T10:50:01.653116+0000","last_peered":"2024-05-12T10:50:01.653116+0000","last_clean":"2024-05-12T10:50:01.653116+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:50:01.653116+0000","last_undegraded":"2024-05-12T10:50:01.653116+0000","last_fullsized":"2024-05-12T10:50:01.653116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:41:30.909036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652376+0000","last_change":"2024-05-12T10:50:00.396417+0000","last_active":"2024-05-12T10:50:01.652376+0000","last_peered":"2024-05-12T10:50:01.652376+0000","last_clean":"2024-05-12T10:50:01.652376+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:50:01.652376+0000","last_undegraded":"2024-05-12T10:50:01.652376+0000","last_fullsized":"2024-05-12T10:50:01.652376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:27.287617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653306+0000","last_change":"2024-05-12T10:49:54.619268+0000","last_active":"2024-05-12T10:50:01.653306+0000","last_peered":"2024-05-12T10:50:01.653306+0000","last_clean":"2024-05-12T10:50:01.653306+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:50:01.653306+0000","last_undegraded":"2024-05-12T10:50:01.653306+0000","last_fullsized":"2024-05-12T10:50:01.653306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:50:34.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837930+0000","last_change":"2024-05-12T10:49:55.624986+0000","last_active":"2024-05-12T10:50:02.837930+0000","last_peered":"2024-05-12T10:50:02.837930+0000","last_clean":"2024-05-12T10:50:02.837930+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:50:02.837930+0000","last_undegraded":"2024-05-12T10:50:02.837930+0000","last_fullsized":"2024-05-12T10:50:02.837930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:03:47.220979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657155+0000","last_change":"2024-05-12T10:49:59.676139+0000","last_active":"2024-05-12T10:50:01.657155+0000","last_peered":"2024-05-12T10:50:01.657155+0000","last_clean":"2024-05-12T10:50:01.657155+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:50:01.657155+0000","last_undegraded":"2024-05-12T10:50:01.657155+0000","last_fullsized":"2024-05-12T10:50:01.657155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:24:15.396258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.918980+0000","last_change":"2024-05-12T10:49:54.645331+0000","last_active":"2024-05-12T10:50:02.918980+0000","last_peered":"2024-05-12T10:50:02.918980+0000","last_clean":"2024-05-12T10:50:02.918980+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:50:02.918980+0000","last_undegraded":"2024-05-12T10:50:02.918980+0000","last_fullsized":"2024-05-12T10:50:02.918980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:38:29.023589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658144+0000","last_change":"2024-05-12T10:49:55.642386+0000","last_active":"2024-05-12T10:50:01.658144+0000","last_peered":"2024-05-12T10:50:01.658144+0000","last_clean":"2024-05-12T10:50:01.658144+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:50:01.658144+0000","last_undegraded":"2024-05-12T10:50:01.658144+0000","last_fullsized":"2024-05-12T10:50:01.658144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:54:40.153070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657964+0000","last_change":"2024-05-12T10:49:59.679887+0000","last_active":"2024-05-12T10:50:01.657964+0000","last_peered":"2024-05-12T10:50:01.657964+0000","last_clean":"2024-05-12T10:50:01.657964+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:50:01.657964+0000","last_undegraded":"2024-05-12T10:50:01.657964+0000","last_fullsized":"2024-05-12T10:50:01.657964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:25:43.004918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919021+0000","last_change":"2024-05-12T10:49:54.659229+0000","last_active":"2024-05-12T10:50:02.919021+0000","last_peered":"2024-05-12T10:50:02.919021+0000","last_clean":"2024-05-12T10:50:02.919021+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:50:02.919021+0000","last_undegraded":"2024-05-12T10:50:02.919021+0000","last_fullsized":"2024-05-12T10:50:02.919021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:54:54.658165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660005+0000","last_change":"2024-05-12T10:49:55.642157+0000","last_active":"2024-05-12T10:50:01.660005+0000","last_peered":"2024-05-12T10:50:01.660005+0000","last_clean":"2024-05-12T10:50:01.660005+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:50:01.660005+0000","last_undegraded":"2024-05-12T10:50:01.660005+0000","last_fullsized":"2024-05-12T10:50:01.660005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:16.232731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658776+0000","last_change":"2024-05-12T10:49:59.663411+0000","last_active":"2024-05-12T10:50:01.658776+0000","last_peered":"2024-05-12T10:50:01.658776+0000","last_clean":"2024-05-12T10:50:01.658776+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:50:01.658776+0000","last_undegraded":"2024-05-12T10:50:01.658776+0000","last_fullsized":"2024-05-12T10:50:01.658776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:59.136704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075711+0000","last_change":"2024-05-12T10:49:55.646019+0000","last_active":"2024-05-12T10:50:02.075711+0000","last_peered":"2024-05-12T10:50:02.075711+0000","last_clean":"2024-05-12T10:50:02.075711+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:50:02.075711+0000","last_undegraded":"2024-05-12T10:50:02.075711+0000","last_fullsized":"2024-05-12T10:50:02.075711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:07.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919034+0000","last_change":"2024-05-12T10:49:54.642039+0000","last_active":"2024-05-12T10:50:02.919034+0000","last_peered":"2024-05-12T10:50:02.919034+0000","last_clean":"2024-05-12T10:50:02.919034+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:50:02.919034+0000","last_undegraded":"2024-05-12T10:50:02.919034+0000","last_fullsized":"2024-05-12T10:50:02.919034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:01.155569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660588+0000","last_change":"2024-05-12T10:49:59.660274+0000","last_active":"2024-05-12T10:50:01.660588+0000","last_peered":"2024-05-12T10:50:01.660588+0000","last_clean":"2024-05-12T10:50:01.660588+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:50:01.660588+0000","last_undegraded":"2024-05-12T10:50:01.660588+0000","last_fullsized":"2024-05-12T10:50:01.660588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:55:12.579645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652722+0000","last_change":"2024-05-12T10:49:55.618128+0000","last_active":"2024-05-12T10:50:01.652722+0000","last_peered":"2024-05-12T10:50:01.652722+0000","last_clean":"2024-05-12T10:50:01.652722+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:50:01.652722+0000","last_undegraded":"2024-05-12T10:50:01.652722+0000","last_fullsized":"2024-05-12T10:50:01.652722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:45.205117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915833+0000","last_change":"2024-05-12T10:49:54.619967+0000","last_active":"2024-05-12T10:50:02.915833+0000","last_peered":"2024-05-12T10:50:02.915833+0000","last_clean":"2024-05-12T10:50:02.915833+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:50:02.915833+0000","last_undegraded":"2024-05-12T10:50:02.915833+0000","last_fullsized":"2024-05-12T10:50:02.915833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:37:10.799631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659650+0000","last_change":"2024-05-12T10:49:59.681931+0000","last_active":"2024-05-12T10:50:01.659650+0000","last_peered":"2024-05-12T10:50:01.659650+0000","last_clean":"2024-05-12T10:50:01.659650+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:50:01.659650+0000","last_undegraded":"2024-05-12T10:50:01.659650+0000","last_fullsized":"2024-05-12T10:50:01.659650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:45:01.542628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652721+0000","last_change":"2024-05-12T10:49:55.615095+0000","last_active":"2024-05-12T10:50:01.652721+0000","last_peered":"2024-05-12T10:50:01.652721+0000","last_clean":"2024-05-12T10:50:01.652721+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:50:01.652721+0000","last_undegraded":"2024-05-12T10:50:01.652721+0000","last_fullsized":"2024-05-12T10:50:01.652721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:51:19.659941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916206+0000","last_change":"2024-05-12T10:49:54.639976+0000","last_active":"2024-05-12T10:50:02.916206+0000","last_peered":"2024-05-12T10:50:02.916206+0000","last_clean":"2024-05-12T10:50:02.916206+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:50:02.916206+0000","last_undegraded":"2024-05-12T10:50:02.916206+0000","last_fullsized":"2024-05-12T10:50:02.916206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:28:37.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916755+0000","last_change":"2024-05-12T10:50:00.390786+0000","last_active":"2024-05-12T10:50:02.916755+0000","last_peered":"2024-05-12T10:50:02.916755+0000","last_clean":"2024-05-12T10:50:02.916755+0000","last_became_active":"2024-05-12T10:50:00.390378+0000","last_became_peered":"2024-05-12T10:50:00.390378+0000","last_unstale":"2024-05-12T10:50:02.916755+0000","last_undegraded":"2024-05-12T10:50:02.916755+0000","last_fullsized":"2024-05-12T10:50:02.916755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:27:57.945259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658891+0000","last_change":"2024-05-12T10:49:55.622729+0000","last_active":"2024-05-12T10:50:01.658891+0000","last_peered":"2024-05-12T10:50:01.658891+0000","last_clean":"2024-05-12T10:50:01.658891+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:50:01.658891+0000","last_undegraded":"2024-05-12T10:50:01.658891+0000","last_fullsized":"2024-05-12T10:50:01.658891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:08:29.460684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919516+0000","last_change":"2024-05-12T10:49:54.639564+0000","last_active":"2024-05-12T10:50:02.919516+0000","last_peered":"2024-05-12T10:50:02.919516+0000","last_clean":"2024-05-12T10:50:02.919516+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:50:02.919516+0000","last_undegraded":"2024-05-12T10:50:02.919516+0000","last_fullsized":"2024-05-12T10:50:02.919516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:54:48.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.661417+0000","last_change":"2024-05-12T10:49:59.676220+0000","last_active":"2024-05-12T10:50:01.661417+0000","last_peered":"2024-05-12T10:50:01.661417+0000","last_clean":"2024-05-12T10:50:01.661417+0000","last_became_active":"2024-05-12T10:49:59.674835+0000","last_became_peered":"2024-05-12T10:49:59.674835+0000","last_unstale":"2024-05-12T10:50:01.661417+0000","last_undegraded":"2024-05-12T10:50:01.661417+0000","last_fullsized":"2024-05-12T10:50:01.661417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:55:03.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838015+0000","last_change":"2024-05-12T10:49:55.612744+0000","last_active":"2024-05-12T10:50:02.838015+0000","last_peered":"2024-05-12T10:50:02.838015+0000","last_clean":"2024-05-12T10:50:02.838015+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:50:02.838015+0000","last_undegraded":"2024-05-12T10:50:02.838015+0000","last_fullsized":"2024-05-12T10:50:02.838015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:05:06.274277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.077180+0000","last_change":"2024-05-12T10:49:54.643375+0000","last_active":"2024-05-12T10:50:02.077180+0000","last_peered":"2024-05-12T10:50:02.077180+0000","last_clean":"2024-05-12T10:50:02.077180+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:50:02.077180+0000","last_undegraded":"2024-05-12T10:50:02.077180+0000","last_fullsized":"2024-05-12T10:50:02.077180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:56:43.086871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658181+0000","last_change":"2024-05-12T10:50:00.393325+0000","last_active":"2024-05-12T10:50:01.658181+0000","last_peered":"2024-05-12T10:50:01.658181+0000","last_clean":"2024-05-12T10:50:01.658181+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:50:01.658181+0000","last_undegraded":"2024-05-12T10:50:01.658181+0000","last_fullsized":"2024-05-12T10:50:01.658181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:55.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653561+0000","last_change":"2024-05-12T10:49:55.629693+0000","last_active":"2024-05-12T10:50:01.653561+0000","last_peered":"2024-05-12T10:50:01.653561+0000","last_clean":"2024-05-12T10:50:01.653561+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:50:01.653561+0000","last_undegraded":"2024-05-12T10:50:01.653561+0000","last_fullsized":"2024-05-12T10:50:01.653561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:04:13.325079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915903+0000","last_change":"2024-05-12T10:49:54.629227+0000","last_active":"2024-05-12T10:50:02.915903+0000","last_peered":"2024-05-12T10:50:02.915903+0000","last_clean":"2024-05-12T10:50:02.915903+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:50:02.915903+0000","last_undegraded":"2024-05-12T10:50:02.915903+0000","last_fullsized":"2024-05-12T10:50:02.915903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:03.097527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652367+0000","last_change":"2024-05-12T10:50:00.396371+0000","last_active":"2024-05-12T10:50:01.652367+0000","last_peered":"2024-05-12T10:50:01.652367+0000","last_clean":"2024-05-12T10:50:01.652367+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:50:01.652367+0000","last_undegraded":"2024-05-12T10:50:01.652367+0000","last_fullsized":"2024-05-12T10:50:01.652367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:41:09.157859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916505+0000","last_change":"2024-05-12T10:49:55.612069+0000","last_active":"2024-05-12T10:50:02.916505+0000","last_peered":"2024-05-12T10:50:02.916505+0000","last_clean":"2024-05-12T10:50:02.916505+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:50:02.916505+0000","last_undegraded":"2024-05-12T10:50:02.916505+0000","last_fullsized":"2024-05-12T10:50:02.916505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:38.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921005+0000","last_change":"2024-05-12T10:49:54.639928+0000","last_active":"2024-05-12T10:50:02.921005+0000","last_peered":"2024-05-12T10:50:02.921005+0000","last_clean":"2024-05-12T10:50:02.921005+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:50:02.921005+0000","last_undegraded":"2024-05-12T10:50:02.921005+0000","last_fullsized":"2024-05-12T10:50:02.921005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:59.215089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837562+0000","last_change":"2024-05-12T10:50:00.383605+0000","last_active":"2024-05-12T10:50:02.837562+0000","last_peered":"2024-05-12T10:50:02.837562+0000","last_clean":"2024-05-12T10:50:02.837562+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:50:02.837562+0000","last_undegraded":"2024-05-12T10:50:02.837562+0000","last_fullsized":"2024-05-12T10:50:02.837562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:28.619988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660251+0000","last_change":"2024-05-12T10:49:55.621201+0000","last_active":"2024-05-12T10:50:01.660251+0000","last_peered":"2024-05-12T10:50:01.660251+0000","last_clean":"2024-05-12T10:50:01.660251+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:50:01.660251+0000","last_undegraded":"2024-05-12T10:50:01.660251+0000","last_fullsized":"2024-05-12T10:50:01.660251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:19:39.117790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916601+0000","last_change":"2024-05-12T10:49:54.620329+0000","last_active":"2024-05-12T10:50:02.916601+0000","last_peered":"2024-05-12T10:50:02.916601+0000","last_clean":"2024-05-12T10:50:02.916601+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:50:02.916601+0000","last_undegraded":"2024-05-12T10:50:02.916601+0000","last_fullsized":"2024-05-12T10:50:02.916601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:21:10.386830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916162+0000","last_change":"2024-05-12T10:49:59.655432+0000","last_active":"2024-05-12T10:50:02.916162+0000","last_peered":"2024-05-12T10:50:02.916162+0000","last_clean":"2024-05-12T10:50:02.916162+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:50:02.916162+0000","last_undegraded":"2024-05-12T10:50:02.916162+0000","last_fullsized":"2024-05-12T10:50:02.916162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:27:34.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658413+0000","last_change":"2024-05-12T10:49:55.628221+0000","last_active":"2024-05-12T10:50:01.658413+0000","last_peered":"2024-05-12T10:50:01.658413+0000","last_clean":"2024-05-12T10:50:01.658413+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:50:01.658413+0000","last_undegraded":"2024-05-12T10:50:01.658413+0000","last_fullsized":"2024-05-12T10:50:01.658413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:54.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659836+0000","last_change":"2024-05-12T10:49:54.652499+0000","last_active":"2024-05-12T10:50:01.659836+0000","last_peered":"2024-05-12T10:50:01.659836+0000","last_clean":"2024-05-12T10:50:01.659836+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:50:01.659836+0000","last_undegraded":"2024-05-12T10:50:01.659836+0000","last_fullsized":"2024-05-12T10:50:01.659836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:14:35.180779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916502+0000","last_change":"2024-05-12T10:49:59.676676+0000","last_active":"2024-05-12T10:50:02.916502+0000","last_peered":"2024-05-12T10:50:02.916502+0000","last_clean":"2024-05-12T10:50:02.916502+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:50:02.916502+0000","last_undegraded":"2024-05-12T10:50:02.916502+0000","last_fullsized":"2024-05-12T10:50:02.916502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:03:13.485130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916164+0000","last_change":"2024-05-12T10:49:55.610830+0000","last_active":"2024-05-12T10:50:02.916164+0000","last_peered":"2024-05-12T10:50:02.916164+0000","last_clean":"2024-05-12T10:50:02.916164+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:50:02.916164+0000","last_undegraded":"2024-05-12T10:50:02.916164+0000","last_fullsized":"2024-05-12T10:50:02.916164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:15.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101999+0000","last_change":"2024-05-12T10:49:54.609239+0000","last_active":"2024-05-12T10:50:02.101999+0000","last_peered":"2024-05-12T10:50:02.101999+0000","last_clean":"2024-05-12T10:50:02.101999+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:50:02.101999+0000","last_undegraded":"2024-05-12T10:50:02.101999+0000","last_fullsized":"2024-05-12T10:50:02.101999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:12:54.169428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916817+0000","last_change":"2024-05-12T10:49:59.656739+0000","last_active":"2024-05-12T10:50:02.916817+0000","last_peered":"2024-05-12T10:50:02.916817+0000","last_clean":"2024-05-12T10:50:02.916817+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:50:02.916817+0000","last_undegraded":"2024-05-12T10:50:02.916817+0000","last_fullsized":"2024-05-12T10:50:02.916817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:05.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837232+0000","last_change":"2024-05-12T10:49:55.626312+0000","last_active":"2024-05-12T10:50:02.837232+0000","last_peered":"2024-05-12T10:50:02.837232+0000","last_clean":"2024-05-12T10:50:02.837232+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:50:02.837232+0000","last_undegraded":"2024-05-12T10:50:02.837232+0000","last_fullsized":"2024-05-12T10:50:02.837232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:36.639971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919870+0000","last_change":"2024-05-12T10:49:54.640819+0000","last_active":"2024-05-12T10:50:02.919870+0000","last_peered":"2024-05-12T10:50:02.919870+0000","last_clean":"2024-05-12T10:50:02.919870+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:50:02.919870+0000","last_undegraded":"2024-05-12T10:50:02.919870+0000","last_fullsized":"2024-05-12T10:50:02.919870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:01.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837983+0000","last_change":"2024-05-12T10:50:00.384347+0000","last_active":"2024-05-12T10:50:02.837983+0000","last_peered":"2024-05-12T10:50:02.837983+0000","last_clean":"2024-05-12T10:50:02.837983+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:50:02.837983+0000","last_undegraded":"2024-05-12T10:50:02.837983+0000","last_fullsized":"2024-05-12T10:50:02.837983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:30.794704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652533+0000","last_change":"2024-05-12T10:49:55.627340+0000","last_active":"2024-05-12T10:50:01.652533+0000","last_peered":"2024-05-12T10:50:01.652533+0000","last_clean":"2024-05-12T10:50:01.652533+0000","last_became_active":"2024-05-12T10:49:55.627065+0000","last_became_peered":"2024-05-12T10:49:55.627065+0000","last_unstale":"2024-05-12T10:50:01.652533+0000","last_undegraded":"2024-05-12T10:50:01.652533+0000","last_fullsized":"2024-05-12T10:50:01.652533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:57:50.849518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658936+0000","last_change":"2024-05-12T10:49:54.648333+0000","last_active":"2024-05-12T10:50:01.658936+0000","last_peered":"2024-05-12T10:50:01.658936+0000","last_clean":"2024-05-12T10:50:01.658936+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:50:01.658936+0000","last_undegraded":"2024-05-12T10:50:01.658936+0000","last_fullsized":"2024-05-12T10:50:01.658936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:29.355444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920043+0000","last_change":"2024-05-12T10:49:45.547469+0000","last_active":"2024-05-12T10:50:02.920043+0000","last_peered":"2024-05-12T10:50:02.920043+0000","last_clean":"2024-05-12T10:50:02.920043+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:50:02.920043+0000","last_undegraded":"2024-05-12T10:50:02.920043+0000","last_fullsized":"2024-05-12T10:50:02.920043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_clean_scrub_stamp":"2024-05-12T10:49:43.953472+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:44:15.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076721+0000","last_change":"2024-05-12T10:50:00.399288+0000","last_active":"2024-05-12T10:50:02.076721+0000","last_peered":"2024-05-12T10:50:02.076721+0000","last_clean":"2024-05-12T10:50:02.076721+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:50:02.076721+0000","last_undegraded":"2024-05-12T10:50:02.076721+0000","last_fullsized":"2024-05-12T10:50:02.076721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:26.959086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920561+0000","last_change":"2024-05-12T10:49:55.639605+0000","last_active":"2024-05-12T10:50:02.920561+0000","last_peered":"2024-05-12T10:50:02.920561+0000","last_clean":"2024-05-12T10:50:02.920561+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:50:02.920561+0000","last_undegraded":"2024-05-12T10:50:02.920561+0000","last_fullsized":"2024-05-12T10:50:02.920561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:46:26.585195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102261+0000","last_change":"2024-05-12T10:49:54.654999+0000","last_active":"2024-05-12T10:50:02.102261+0000","last_peered":"2024-05-12T10:50:02.102261+0000","last_clean":"2024-05-12T10:50:02.102261+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:50:02.102261+0000","last_undegraded":"2024-05-12T10:50:02.102261+0000","last_fullsized":"2024-05-12T10:50:02.102261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:00:20.115739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076118+0000","last_change":"2024-05-12T10:50:00.393017+0000","last_active":"2024-05-12T10:50:02.076118+0000","last_peered":"2024-05-12T10:50:02.076118+0000","last_clean":"2024-05-12T10:50:02.076118+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:50:02.076118+0000","last_undegraded":"2024-05-12T10:50:02.076118+0000","last_fullsized":"2024-05-12T10:50:02.076118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:01:02.394572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658363+0000","last_change":"2024-05-12T10:49:55.623665+0000","last_active":"2024-05-12T10:50:01.658363+0000","last_peered":"2024-05-12T10:50:01.658363+0000","last_clean":"2024-05-12T10:50:01.658363+0000","last_became_active":"2024-05-12T10:49:55.623403+0000","last_became_peered":"2024-05-12T10:49:55.623403+0000","last_unstale":"2024-05-12T10:50:01.658363+0000","last_undegraded":"2024-05-12T10:50:01.658363+0000","last_fullsized":"2024-05-12T10:50:01.658363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:18:25.399664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915873+0000","last_change":"2024-05-12T10:49:54.628492+0000","last_active":"2024-05-12T10:50:02.915873+0000","last_peered":"2024-05-12T10:50:02.915873+0000","last_clean":"2024-05-12T10:50:02.915873+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:50:02.915873+0000","last_undegraded":"2024-05-12T10:50:02.915873+0000","last_fullsized":"2024-05-12T10:50:02.915873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:35:38.949401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837763+0000","last_change":"2024-05-12T10:49:59.657783+0000","last_active":"2024-05-12T10:50:02.837763+0000","last_peered":"2024-05-12T10:50:02.837763+0000","last_clean":"2024-05-12T10:50:02.837763+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:50:02.837763+0000","last_undegraded":"2024-05-12T10:50:02.837763+0000","last_fullsized":"2024-05-12T10:50:02.837763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:51:21.103458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921189+0000","last_change":"2024-05-12T10:49:55.646246+0000","last_active":"2024-05-12T10:50:02.921189+0000","last_peered":"2024-05-12T10:50:02.921189+0000","last_clean":"2024-05-12T10:50:02.921189+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:50:02.921189+0000","last_undegraded":"2024-05-12T10:50:02.921189+0000","last_fullsized":"2024-05-12T10:50:02.921189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:32.142128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102403+0000","last_change":"2024-05-12T10:49:54.610076+0000","last_active":"2024-05-12T10:50:02.102403+0000","last_peered":"2024-05-12T10:50:02.102403+0000","last_clean":"2024-05-12T10:50:02.102403+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:50:02.102403+0000","last_undegraded":"2024-05-12T10:50:02.102403+0000","last_fullsized":"2024-05-12T10:50:02.102403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:12:04.400894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657078+0000","last_change":"2024-05-12T10:50:00.386172+0000","last_active":"2024-05-12T10:50:01.657078+0000","last_peered":"2024-05-12T10:50:01.657078+0000","last_clean":"2024-05-12T10:50:01.657078+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:50:01.657078+0000","last_undegraded":"2024-05-12T10:50:01.657078+0000","last_fullsized":"2024-05-12T10:50:01.657078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:06:17.550197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920926+0000","last_change":"2024-05-12T10:49:55.646249+0000","last_active":"2024-05-12T10:50:02.920926+0000","last_peered":"2024-05-12T10:50:02.920926+0000","last_clean":"2024-05-12T10:50:02.920926+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:50:02.920926+0000","last_undegraded":"2024-05-12T10:50:02.920926+0000","last_fullsized":"2024-05-12T10:50:02.920926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:15.036675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660898+0000","last_change":"2024-05-12T10:49:54.621293+0000","last_active":"2024-05-12T10:50:01.660898+0000","last_peered":"2024-05-12T10:50:01.660898+0000","last_clean":"2024-05-12T10:50:01.660898+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:50:01.660898+0000","last_undegraded":"2024-05-12T10:50:01.660898+0000","last_fullsized":"2024-05-12T10:50:01.660898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:45:33.341215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657581+0000","last_change":"2024-05-12T10:49:59.673656+0000","last_active":"2024-05-12T10:50:01.657581+0000","last_peered":"2024-05-12T10:50:01.657581+0000","last_clean":"2024-05-12T10:50:01.657581+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:50:01.657581+0000","last_undegraded":"2024-05-12T10:50:01.657581+0000","last_fullsized":"2024-05-12T10:50:01.657581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:38.364434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919917+0000","last_change":"2024-05-12T10:49:55.646526+0000","last_active":"2024-05-12T10:50:02.919917+0000","last_peered":"2024-05-12T10:50:02.919917+0000","last_clean":"2024-05-12T10:50:02.919917+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:50:02.919917+0000","last_undegraded":"2024-05-12T10:50:02.919917+0000","last_fullsized":"2024-05-12T10:50:02.919917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:56:52.102442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101889+0000","last_change":"2024-05-12T10:49:54.617906+0000","last_active":"2024-05-12T10:50:02.101889+0000","last_peered":"2024-05-12T10:50:02.101889+0000","last_clean":"2024-05-12T10:50:02.101889+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:50:02.101889+0000","last_undegraded":"2024-05-12T10:50:02.101889+0000","last_fullsized":"2024-05-12T10:50:02.101889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:26:35.150963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837853+0000","last_change":"2024-05-12T10:49:59.671791+0000","last_active":"2024-05-12T10:50:02.837853+0000","last_peered":"2024-05-12T10:50:02.837853+0000","last_clean":"2024-05-12T10:50:02.837853+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:50:02.837853+0000","last_undegraded":"2024-05-12T10:50:02.837853+0000","last_fullsized":"2024-05-12T10:50:02.837853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:27.425708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076017+0000","last_change":"2024-05-12T10:49:55.637810+0000","last_active":"2024-05-12T10:50:02.076017+0000","last_peered":"2024-05-12T10:50:02.076017+0000","last_clean":"2024-05-12T10:50:02.076017+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:50:02.076017+0000","last_undegraded":"2024-05-12T10:50:02.076017+0000","last_fullsized":"2024-05-12T10:50:02.076017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:52.001497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076035+0000","last_change":"2024-05-12T10:49:54.637728+0000","last_active":"2024-05-12T10:50:02.076035+0000","last_peered":"2024-05-12T10:50:02.076035+0000","last_clean":"2024-05-12T10:50:02.076035+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:50:02.076035+0000","last_undegraded":"2024-05-12T10:50:02.076035+0000","last_fullsized":"2024-05-12T10:50:02.076035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:39.996419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653563+0000","last_change":"2024-05-12T10:50:00.383444+0000","last_active":"2024-05-12T10:50:01.653563+0000","last_peered":"2024-05-12T10:50:01.653563+0000","last_clean":"2024-05-12T10:50:01.653563+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:50:01.653563+0000","last_undegraded":"2024-05-12T10:50:01.653563+0000","last_fullsized":"2024-05-12T10:50:01.653563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:55:04.226848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920128+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:50:02.920128+0000","last_peered":"2024-05-12T10:50:02.920128+0000","last_clean":"2024-05-12T10:50:02.920128+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:50:02.920128+0000","last_undegraded":"2024-05-12T10:50:02.920128+0000","last_fullsized":"2024-05-12T10:50:02.920128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:15:58.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660087+0000","last_change":"2024-05-12T10:49:54.656814+0000","last_active":"2024-05-12T10:50:01.660087+0000","last_peered":"2024-05-12T10:50:01.660087+0000","last_clean":"2024-05-12T10:50:01.660087+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:50:01.660087+0000","last_undegraded":"2024-05-12T10:50:01.660087+0000","last_fullsized":"2024-05-12T10:50:01.660087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:26.660043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653232+0000","last_change":"2024-05-12T10:50:00.390308+0000","last_active":"2024-05-12T10:50:01.653232+0000","last_peered":"2024-05-12T10:50:01.653232+0000","last_clean":"2024-05-12T10:50:01.653232+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:50:01.653232+0000","last_undegraded":"2024-05-12T10:50:01.653232+0000","last_fullsized":"2024-05-12T10:50:01.653232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:43.650956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837442+0000","last_change":"2024-05-12T10:49:55.628907+0000","last_active":"2024-05-12T10:50:02.837442+0000","last_peered":"2024-05-12T10:50:02.837442+0000","last_clean":"2024-05-12T10:50:02.837442+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:50:02.837442+0000","last_undegraded":"2024-05-12T10:50:02.837442+0000","last_fullsized":"2024-05-12T10:50:02.837442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:13:50.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837019+0000","last_change":"2024-05-12T10:49:54.626002+0000","last_active":"2024-05-12T10:50:02.837019+0000","last_peered":"2024-05-12T10:50:02.837019+0000","last_clean":"2024-05-12T10:50:02.837019+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:50:02.837019+0000","last_undegraded":"2024-05-12T10:50:02.837019+0000","last_fullsized":"2024-05-12T10:50:02.837019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:19:19.976387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659867+0000","last_change":"2024-05-12T10:50:00.387192+0000","last_active":"2024-05-12T10:50:01.659867+0000","last_peered":"2024-05-12T10:50:01.659867+0000","last_clean":"2024-05-12T10:50:01.659867+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:50:01.659867+0000","last_undegraded":"2024-05-12T10:50:01.659867+0000","last_fullsized":"2024-05-12T10:50:01.659867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:15:23.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920487+0000","last_change":"2024-05-12T10:49:55.634551+0000","last_active":"2024-05-12T10:50:02.920487+0000","last_peered":"2024-05-12T10:50:02.920487+0000","last_clean":"2024-05-12T10:50:02.920487+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:50:02.920487+0000","last_undegraded":"2024-05-12T10:50:02.920487+0000","last_fullsized":"2024-05-12T10:50:02.920487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:10:52.477145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:09.379163+0000","last_change":"2024-05-12T10:49:54.634748+0000","last_active":"2024-05-12T10:50:09.379163+0000","last_peered":"2024-05-12T10:50:09.379163+0000","last_clean":"2024-05-12T10:50:09.379163+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:50:09.379163+0000","last_undegraded":"2024-05-12T10:50:09.379163+0000","last_fullsized":"2024-05-12T10:50:09.379163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:39:16.646133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916160+0000","last_change":"2024-05-12T10:49:59.671405+0000","last_active":"2024-05-12T10:50:02.916160+0000","last_peered":"2024-05-12T10:50:02.916160+0000","last_clean":"2024-05-12T10:50:02.916160+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:50:02.916160+0000","last_undegraded":"2024-05-12T10:50:02.916160+0000","last_fullsized":"2024-05-12T10:50:02.916160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:06:34.170753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659820+0000","last_change":"2024-05-12T10:49:55.634686+0000","last_active":"2024-05-12T10:50:01.659820+0000","last_peered":"2024-05-12T10:50:01.659820+0000","last_clean":"2024-05-12T10:50:01.659820+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:50:01.659820+0000","last_undegraded":"2024-05-12T10:50:01.659820+0000","last_fullsized":"2024-05-12T10:50:01.659820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:25:04.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915889+0000","last_change":"2024-05-12T10:49:54.656012+0000","last_active":"2024-05-12T10:50:02.915889+0000","last_peered":"2024-05-12T10:50:02.915889+0000","last_clean":"2024-05-12T10:50:02.915889+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:50:02.915889+0000","last_undegraded":"2024-05-12T10:50:02.915889+0000","last_fullsized":"2024-05-12T10:50:02.915889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:29.253250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658272+0000","last_change":"2024-05-12T10:49:59.672820+0000","last_active":"2024-05-12T10:50:01.658272+0000","last_peered":"2024-05-12T10:50:01.658272+0000","last_clean":"2024-05-12T10:50:01.658272+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:50:01.658272+0000","last_undegraded":"2024-05-12T10:50:01.658272+0000","last_fullsized":"2024-05-12T10:50:01.658272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:49:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838093+0000","last_change":"2024-05-12T10:49:55.620541+0000","last_active":"2024-05-12T10:50:02.838093+0000","last_peered":"2024-05-12T10:50:02.838093+0000","last_clean":"2024-05-12T10:50:02.838093+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:50:02.838093+0000","last_undegraded":"2024-05-12T10:50:02.838093+0000","last_fullsized":"2024-05-12T10:50:02.838093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:11.742829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660247+0000","last_change":"2024-05-12T10:49:54.651289+0000","last_active":"2024-05-12T10:50:01.660247+0000","last_peered":"2024-05-12T10:50:01.660247+0000","last_clean":"2024-05-12T10:50:01.660247+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:50:01.660247+0000","last_undegraded":"2024-05-12T10:50:01.660247+0000","last_fullsized":"2024-05-12T10:50:01.660247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:33:24.087763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652523+0000","last_change":"2024-05-12T10:49:59.670973+0000","last_active":"2024-05-12T10:50:01.652523+0000","last_peered":"2024-05-12T10:50:01.652523+0000","last_clean":"2024-05-12T10:50:01.652523+0000","last_became_active":"2024-05-12T10:49:59.670656+0000","last_became_peered":"2024-05-12T10:49:59.670656+0000","last_unstale":"2024-05-12T10:50:01.652523+0000","last_undegraded":"2024-05-12T10:50:01.652523+0000","last_fullsized":"2024-05-12T10:50:01.652523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:16:58.665403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659979+0000","last_change":"2024-05-12T10:49:55.626645+0000","last_active":"2024-05-12T10:50:01.659979+0000","last_peered":"2024-05-12T10:50:01.659979+0000","last_clean":"2024-05-12T10:50:01.659979+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:50:01.659979+0000","last_undegraded":"2024-05-12T10:50:01.659979+0000","last_fullsized":"2024-05-12T10:50:01.659979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:41.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076937+0000","last_change":"2024-05-12T10:49:54.654822+0000","last_active":"2024-05-12T10:50:02.076937+0000","last_peered":"2024-05-12T10:50:02.076937+0000","last_clean":"2024-05-12T10:50:02.076937+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:50:02.076937+0000","last_undegraded":"2024-05-12T10:50:02.076937+0000","last_fullsized":"2024-05-12T10:50:02.076937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:52:07.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652430+0000","last_change":"2024-05-12T10:50:00.396453+0000","last_active":"2024-05-12T10:50:01.652430+0000","last_peered":"2024-05-12T10:50:01.652430+0000","last_clean":"2024-05-12T10:50:01.652430+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:50:01.652430+0000","last_undegraded":"2024-05-12T10:50:01.652430+0000","last_fullsized":"2024-05-12T10:50:01.652430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:40.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837810+0000","last_change":"2024-05-12T10:50:00.390477+0000","last_active":"2024-05-12T10:50:02.837810+0000","last_peered":"2024-05-12T10:50:02.837810+0000","last_clean":"2024-05-12T10:50:02.837810+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:50:02.837810+0000","last_undegraded":"2024-05-12T10:50:02.837810+0000","last_fullsized":"2024-05-12T10:50:02.837810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:20:19.551216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916112+0000","last_change":"2024-05-12T10:49:55.619984+0000","last_active":"2024-05-12T10:50:02.916112+0000","last_peered":"2024-05-12T10:50:02.916112+0000","last_clean":"2024-05-12T10:50:02.916112+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:50:02.916112+0000","last_undegraded":"2024-05-12T10:50:02.916112+0000","last_fullsized":"2024-05-12T10:50:02.916112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:21:34.136203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657970+0000","last_change":"2024-05-12T10:49:54.656580+0000","last_active":"2024-05-12T10:50:01.657970+0000","last_peered":"2024-05-12T10:50:01.657970+0000","last_clean":"2024-05-12T10:50:01.657970+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:50:01.657970+0000","last_undegraded":"2024-05-12T10:50:01.657970+0000","last_fullsized":"2024-05-12T10:50:01.657970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:43:32.603999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076883+0000","last_change":"2024-05-12T10:49:59.681648+0000","last_active":"2024-05-12T10:50:02.076883+0000","last_peered":"2024-05-12T10:50:02.076883+0000","last_clean":"2024-05-12T10:50:02.076883+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:50:02.076883+0000","last_undegraded":"2024-05-12T10:50:02.076883+0000","last_fullsized":"2024-05-12T10:50:02.076883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:54.912836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652618+0000","last_change":"2024-05-12T10:49:55.617393+0000","last_active":"2024-05-12T10:50:01.652618+0000","last_peered":"2024-05-12T10:50:01.652618+0000","last_clean":"2024-05-12T10:50:01.652618+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:50:01.652618+0000","last_undegraded":"2024-05-12T10:50:01.652618+0000","last_fullsized":"2024-05-12T10:50:01.652618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:51.584695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652565+0000","last_change":"2024-05-12T10:49:54.637393+0000","last_active":"2024-05-12T10:50:01.652565+0000","last_peered":"2024-05-12T10:50:01.652565+0000","last_clean":"2024-05-12T10:50:01.652565+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:50:01.652565+0000","last_undegraded":"2024-05-12T10:50:01.652565+0000","last_fullsized":"2024-05-12T10:50:01.652565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:44:00.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076344+0000","last_change":"2024-05-12T10:49:54.636945+0000","last_active":"2024-05-12T10:50:02.076344+0000","last_peered":"2024-05-12T10:50:02.076344+0000","last_clean":"2024-05-12T10:50:02.076344+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:50:02.076344+0000","last_undegraded":"2024-05-12T10:50:02.076344+0000","last_fullsized":"2024-05-12T10:50:02.076344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:34:25.927458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837878+0000","last_change":"2024-05-12T10:49:55.627105+0000","last_active":"2024-05-12T10:50:02.837878+0000","last_peered":"2024-05-12T10:50:02.837878+0000","last_clean":"2024-05-12T10:50:02.837878+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:50:02.837878+0000","last_undegraded":"2024-05-12T10:50:02.837878+0000","last_fullsized":"2024-05-12T10:50:02.837878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:00:09.334541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102212+0000","last_change":"2024-05-12T10:49:59.659142+0000","last_active":"2024-05-12T10:50:02.102212+0000","last_peered":"2024-05-12T10:50:02.102212+0000","last_clean":"2024-05-12T10:50:02.102212+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:50:02.102212+0000","last_undegraded":"2024-05-12T10:50:02.102212+0000","last_fullsized":"2024-05-12T10:50:02.102212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:40.443593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652797+0000","last_change":"2024-05-12T10:49:54.632224+0000","last_active":"2024-05-12T10:50:01.652797+0000","last_peered":"2024-05-12T10:50:01.652797+0000","last_clean":"2024-05-12T10:50:01.652797+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:50:01.652797+0000","last_undegraded":"2024-05-12T10:50:01.652797+0000","last_fullsized":"2024-05-12T10:50:01.652797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:27:39.637678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659206+0000","last_change":"2024-05-12T10:49:55.633243+0000","last_active":"2024-05-12T10:50:01.659206+0000","last_peered":"2024-05-12T10:50:01.659206+0000","last_clean":"2024-05-12T10:50:01.659206+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:50:01.659206+0000","last_undegraded":"2024-05-12T10:50:01.659206+0000","last_fullsized":"2024-05-12T10:50:01.659206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:14.239020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652874+0000","last_change":"2024-05-12T10:49:59.655807+0000","last_active":"2024-05-12T10:50:01.652874+0000","last_peered":"2024-05-12T10:50:01.652874+0000","last_clean":"2024-05-12T10:50:01.652874+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:50:01.652874+0000","last_undegraded":"2024-05-12T10:50:01.652874+0000","last_fullsized":"2024-05-12T10:50:01.652874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:12.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075680+0000","last_change":"2024-05-12T10:49:55.637106+0000","last_active":"2024-05-12T10:50:02.075680+0000","last_peered":"2024-05-12T10:50:02.075680+0000","last_clean":"2024-05-12T10:50:02.075680+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:50:02.075680+0000","last_undegraded":"2024-05-12T10:50:02.075680+0000","last_fullsized":"2024-05-12T10:50:02.075680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:22:07.477677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101967+0000","last_change":"2024-05-12T10:49:55.618952+0000","last_active":"2024-05-12T10:50:02.101967+0000","last_peered":"2024-05-12T10:50:02.101967+0000","last_clean":"2024-05-12T10:50:02.101967+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:50:02.101967+0000","last_undegraded":"2024-05-12T10:50:02.101967+0000","last_fullsized":"2024-05-12T10:50:02.101967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:38:10.693066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659549+0000","last_change":"2024-05-12T10:49:55.623916+0000","last_active":"2024-05-12T10:50:01.659549+0000","last_peered":"2024-05-12T10:50:01.659549+0000","last_clean":"2024-05-12T10:50:01.659549+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:50:01.659549+0000","last_undegraded":"2024-05-12T10:50:01.659549+0000","last_fullsized":"2024-05-12T10:50:01.659549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:06:14.434631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837761+0000","last_change":"2024-05-12T10:49:55.620278+0000","last_active":"2024-05-12T10:50:02.837761+0000","last_peered":"2024-05-12T10:50:02.837761+0000","last_clean":"2024-05-12T10:50:02.837761+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:50:02.837761+0000","last_undegraded":"2024-05-12T10:50:02.837761+0000","last_fullsized":"2024-05-12T10:50:02.837761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:59.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653439+0000","last_change":"2024-05-12T10:49:55.626216+0000","last_active":"2024-05-12T10:50:01.653439+0000","last_peered":"2024-05-12T10:50:01.653439+0000","last_clean":"2024-05-12T10:50:01.653439+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:50:01.653439+0000","last_undegraded":"2024-05-12T10:50:01.653439+0000","last_fullsized":"2024-05-12T10:50:01.653439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:52:14.438331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916463+0000","last_change":"2024-05-12T10:49:55.622085+0000","last_active":"2024-05-12T10:50:02.916463+0000","last_peered":"2024-05-12T10:50:02.916463+0000","last_clean":"2024-05-12T10:50:02.916463+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:50:02.916463+0000","last_undegraded":"2024-05-12T10:50:02.916463+0000","last_fullsized":"2024-05-12T10:50:02.916463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:41:42.558506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076984+0000","last_change":"2024-05-12T10:49:55.635592+0000","last_active":"2024-05-12T10:50:02.076984+0000","last_peered":"2024-05-12T10:50:02.076984+0000","last_clean":"2024-05-12T10:50:02.076984+0000","last_became_active":"2024-05-12T10:49:55.635298+0000","last_became_peered":"2024-05-12T10:49:55.635298+0000","last_unstale":"2024-05-12T10:50:02.076984+0000","last_undegraded":"2024-05-12T10:50:02.076984+0000","last_fullsized":"2024-05-12T10:50:02.076984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:43:14.781372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653476+0000","last_change":"2024-05-12T10:49:55.626353+0000","last_active":"2024-05-12T10:50:01.653476+0000","last_peered":"2024-05-12T10:50:01.653476+0000","last_clean":"2024-05-12T10:50:01.653476+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:50:01.653476+0000","last_undegraded":"2024-05-12T10:50:01.653476+0000","last_fullsized":"2024-05-12T10:50:01.653476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:58.905284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657725+0000","last_change":"2024-05-12T10:49:55.621110+0000","last_active":"2024-05-12T10:50:01.657725+0000","last_peered":"2024-05-12T10:50:01.657725+0000","last_clean":"2024-05-12T10:50:01.657725+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:50:01.657725+0000","last_undegraded":"2024-05-12T10:50:01.657725+0000","last_fullsized":"2024-05-12T10:50:01.657725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:12:36.369923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652483+0000","last_change":"2024-05-12T10:49:55.626913+0000","last_active":"2024-05-12T10:50:01.652483+0000","last_peered":"2024-05-12T10:50:01.652483+0000","last_clean":"2024-05-12T10:50:01.652483+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:50:01.652483+0000","last_undegraded":"2024-05-12T10:50:01.652483+0000","last_fullsized":"2024-05-12T10:50:01.652483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:27:08.492294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659499+0000","last_change":"2024-05-12T10:49:55.629992+0000","last_active":"2024-05-12T10:50:01.659499+0000","last_peered":"2024-05-12T10:50:01.659499+0000","last_clean":"2024-05-12T10:50:01.659499+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:50:01.659499+0000","last_undegraded":"2024-05-12T10:50:01.659499+0000","last_fullsized":"2024-05-12T10:50:01.659499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:31.454363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837524+0000","last_change":"2024-05-12T10:49:55.620821+0000","last_active":"2024-05-12T10:50:02.837524+0000","last_peered":"2024-05-12T10:50:02.837524+0000","last_clean":"2024-05-12T10:50:02.837524+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:50:02.837524+0000","last_undegraded":"2024-05-12T10:50:02.837524+0000","last_fullsized":"2024-05-12T10:50:02.837524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:53.597215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076297+0000","last_change":"2024-05-12T10:49:55.646368+0000","last_active":"2024-05-12T10:50:02.076297+0000","last_peered":"2024-05-12T10:50:02.076297+0000","last_clean":"2024-05-12T10:50:02.076297+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:50:02.076297+0000","last_undegraded":"2024-05-12T10:50:02.076297+0000","last_fullsized":"2024-05-12T10:50:02.076297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:21:04.313921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920866+0000","last_change":"2024-05-12T10:49:55.633122+0000","last_active":"2024-05-12T10:50:02.920866+0000","last_peered":"2024-05-12T10:50:02.920866+0000","last_clean":"2024-05-12T10:50:02.920866+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:50:02.920866+0000","last_undegraded":"2024-05-12T10:50:02.920866+0000","last_fullsized":"2024-05-12T10:50:02.920866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:25:19.563648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102362+0000","last_change":"2024-05-12T10:49:55.635394+0000","last_active":"2024-05-12T10:50:02.102362+0000","last_peered":"2024-05-12T10:50:02.102362+0000","last_clean":"2024-05-12T10:50:02.102362+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:50:02.102362+0000","last_undegraded":"2024-05-12T10:50:02.102362+0000","last_fullsized":"2024-05-12T10:50:02.102362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:41:58.478292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660761+0000","last_change":"2024-05-12T10:49:55.626485+0000","last_active":"2024-05-12T10:50:01.660761+0000","last_peered":"2024-05-12T10:50:01.660761+0000","last_clean":"2024-05-12T10:50:01.660761+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:50:01.660761+0000","last_undegraded":"2024-05-12T10:50:01.660761+0000","last_fullsized":"2024-05-12T10:50:01.660761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:17.942339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657391+0000","last_change":"2024-05-12T10:49:55.618820+0000","last_active":"2024-05-12T10:50:01.657391+0000","last_peered":"2024-05-12T10:50:01.657391+0000","last_clean":"2024-05-12T10:50:01.657391+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:50:01.657391+0000","last_undegraded":"2024-05-12T10:50:01.657391+0000","last_fullsized":"2024-05-12T10:50:01.657391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:23:00.474438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916163+0000","last_change":"2024-05-12T10:49:55.626429+0000","last_active":"2024-05-12T10:50:02.916163+0000","last_peered":"2024-05-12T10:50:02.916163+0000","last_clean":"2024-05-12T10:50:02.916163+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:50:02.916163+0000","last_undegraded":"2024-05-12T10:50:02.916163+0000","last_fullsized":"2024-05-12T10:50:02.916163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:40:02.709729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837421+0000","last_change":"2024-05-12T10:49:55.612139+0000","last_active":"2024-05-12T10:50:02.837421+0000","last_peered":"2024-05-12T10:50:02.837421+0000","last_clean":"2024-05-12T10:50:02.837421+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:50:02.837421+0000","last_undegraded":"2024-05-12T10:50:02.837421+0000","last_fullsized":"2024-05-12T10:50:02.837421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:57:34.138392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652690+0000","last_change":"2024-05-12T10:49:55.631137+0000","last_active":"2024-05-12T10:50:01.652690+0000","last_peered":"2024-05-12T10:50:01.652690+0000","last_clean":"2024-05-12T10:50:01.652690+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:50:01.652690+0000","last_undegraded":"2024-05-12T10:50:01.652690+0000","last_fullsized":"2024-05-12T10:50:01.652690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:04.390314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659797+0000","last_change":"2024-05-12T10:49:55.643416+0000","last_active":"2024-05-12T10:50:01.659797+0000","last_peered":"2024-05-12T10:50:01.659797+0000","last_clean":"2024-05-12T10:50:01.659797+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:50:01.659797+0000","last_undegraded":"2024-05-12T10:50:01.659797+0000","last_fullsized":"2024-05-12T10:50:01.659797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:58.632966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076802+0000","last_change":"2024-05-12T10:49:55.635847+0000","last_active":"2024-05-12T10:50:02.076802+0000","last_peered":"2024-05-12T10:50:02.076802+0000","last_clean":"2024-05-12T10:50:02.076802+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:50:02.076802+0000","last_undegraded":"2024-05-12T10:50:02.076802+0000","last_fullsized":"2024-05-12T10:50:02.076802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:57:51.222099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076561+0000","last_change":"2024-05-12T10:49:55.641921+0000","last_active":"2024-05-12T10:50:02.076561+0000","last_peered":"2024-05-12T10:50:02.076561+0000","last_clean":"2024-05-12T10:50:02.076561+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:50:02.076561+0000","last_undegraded":"2024-05-12T10:50:02.076561+0000","last_fullsized":"2024-05-12T10:50:02.076561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:44:57.787358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921179+0000","last_change":"2024-05-12T10:49:55.635853+0000","last_active":"2024-05-12T10:50:02.921179+0000","last_peered":"2024-05-12T10:50:02.921179+0000","last_clean":"2024-05-12T10:50:02.921179+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:50:02.921179+0000","last_undegraded":"2024-05-12T10:50:02.921179+0000","last_fullsized":"2024-05-12T10:50:02.921179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:04:39.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652297+0000","last_change":"2024-05-12T10:49:55.620107+0000","last_active":"2024-05-12T10:50:01.652297+0000","last_peered":"2024-05-12T10:50:01.652297+0000","last_clean":"2024-05-12T10:50:01.652297+0000","last_became_active":"2024-05-12T10:49:55.619802+0000","last_became_peered":"2024-05-12T10:49:55.619802+0000","last_unstale":"2024-05-12T10:50:01.652297+0000","last_undegraded":"2024-05-12T10:50:01.652297+0000","last_fullsized":"2024-05-12T10:50:01.652297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:52:39.033778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920076+0000","last_change":"2024-05-12T10:49:55.629001+0000","last_active":"2024-05-12T10:50:02.920076+0000","last_peered":"2024-05-12T10:50:02.920076+0000","last_clean":"2024-05-12T10:50:02.920076+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:50:02.920076+0000","last_undegraded":"2024-05-12T10:50:02.920076+0000","last_fullsized":"2024-05-12T10:50:02.920076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:42:39.042271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659136+0000","last_change":"2024-05-12T10:49:55.625540+0000","last_active":"2024-05-12T10:50:01.659136+0000","last_peered":"2024-05-12T10:50:01.659136+0000","last_clean":"2024-05-12T10:50:01.659136+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:50:01.659136+0000","last_undegraded":"2024-05-12T10:50:01.659136+0000","last_fullsized":"2024-05-12T10:50:01.659136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:35.621918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919665+0000","last_change":"2024-05-12T10:49:55.633576+0000","last_active":"2024-05-12T10:50:02.919665+0000","last_peered":"2024-05-12T10:50:02.919665+0000","last_clean":"2024-05-12T10:50:02.919665+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:50:02.919665+0000","last_undegraded":"2024-05-12T10:50:02.919665+0000","last_fullsized":"2024-05-12T10:50:02.919665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:06:16.255147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657885+0000","last_change":"2024-05-12T10:49:55.624205+0000","last_active":"2024-05-12T10:50:01.657885+0000","last_peered":"2024-05-12T10:50:01.657885+0000","last_clean":"2024-05-12T10:50:01.657885+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:50:01.657885+0000","last_undegraded":"2024-05-12T10:50:01.657885+0000","last_fullsized":"2024-05-12T10:50:01.657885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:21.895269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837757+0000","last_change":"2024-05-12T10:49:55.610461+0000","last_active":"2024-05-12T10:50:02.837757+0000","last_peered":"2024-05-12T10:50:02.837757+0000","last_clean":"2024-05-12T10:50:02.837757+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:50:02.837757+0000","last_undegraded":"2024-05-12T10:50:02.837757+0000","last_fullsized":"2024-05-12T10:50:02.837757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:44.511895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916628+0000","last_change":"2024-05-12T10:49:55.608434+0000","last_active":"2024-05-12T10:50:02.916628+0000","last_peered":"2024-05-12T10:50:02.916628+0000","last_clean":"2024-05-12T10:50:02.916628+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:50:02.916628+0000","last_undegraded":"2024-05-12T10:50:02.916628+0000","last_fullsized":"2024-05-12T10:50:02.916628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:17.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920943+0000","last_change":"2024-05-12T10:49:55.639296+0000","last_active":"2024-05-12T10:50:02.920943+0000","last_peered":"2024-05-12T10:50:02.920943+0000","last_clean":"2024-05-12T10:50:02.920943+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:50:02.920943+0000","last_undegraded":"2024-05-12T10:50:02.920943+0000","last_fullsized":"2024-05-12T10:50:02.920943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:47:15.862328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":701646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":110786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:50:26.828 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-12T10:50:26.828 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-12T10:50:26.828 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-12T10:50:26.829 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-12T10:50:27.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0babc00640 1 Processor -- start 2024-05-12T10:50:27.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0babc00640 1 -- start start 2024-05-12T10:50:27.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0babc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba4159430 0x7f0ba40cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0babc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0ba415fc60 0x7f0ba40cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0babc00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba40c5050 con 0x7f0ba40c9fd0 2024-05-12T10:50:27.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0babc00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0ba40c5c20 con 0x7f0ba415fc60 2024-05-12T10:50:27.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0babc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0ba40c52f0 con 0x7f0ba4159430 2024-05-12T10:50:27.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0ba9200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba4159430 0x7f0ba40cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0ba9c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0ba415fc60 0x7f0ba40cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0ba9200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba4159430 0x7f0ba40cf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60418/0 (socket says 172.21.15.115:60418) 2024-05-12T10:50:27.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0ba9200640 1 -- 172.21.15.115:0/3398941974 learned_addr learned my addr 172.21.15.115:0/3398941974 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:27.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0ba3e00640 1 --1- 172.21.15.115:0/3398941974 >> v1:172.21.15.134:6789/0 conn(0x7f0ba40c9fd0 0x7f0ba415f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:56226/0 (socket says 172.21.15.115:56226) 2024-05-12T10:50:27.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0ba9200640 1 -- 172.21.15.115:0/3398941974 >> v2:172.21.15.134:3300/0 conn(0x7f0ba415fc60 msgr2=0x7f0ba40cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:27.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0ba9200640 1 --2- 172.21.15.115:0/3398941974 >> v2:172.21.15.134:3300/0 conn(0x7f0ba415fc60 0x7f0ba40cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0ba9200640 1 -- 172.21.15.115:0/3398941974 >> v1:172.21.15.134:6789/0 conn(0x7f0ba40c9fd0 legacy=0x7f0ba415f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.005+0000 7f0ba9200640 1 -- 172.21.15.115:0/3398941974 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba40c55d0 con 0x7f0ba4159430 2024-05-12T10:50:27.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0ba9200640 1 --2- 172.21.15.115:0/3398941974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba4159430 0x7f0ba40cf560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009870 tx=0x7f0b9801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fcce7c64bd75e37 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:27.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0ba3400640 1 -- 172.21.15.115:0/3398941974 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b980b5070 con 0x7f0ba4159430 2024-05-12T10:50:27.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0ba3400640 1 -- 172.21.15.115:0/3398941974 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b980a8a50 con 0x7f0ba4159430 2024-05-12T10:50:27.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0ba3400640 1 -- 172.21.15.115:0/3398941974 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b980a8e20 con 0x7f0ba4159430 2024-05-12T10:50:27.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0babc00640 1 -- 172.21.15.115:0/3398941974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba4159430 msgr2=0x7f0ba40cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0babc00640 1 --2- 172.21.15.115:0/3398941974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba4159430 0x7f0ba40cf560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009870 tx=0x7f0b9801ed50 comp rx=0 tx=0).stop 2024-05-12T10:50:27.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0babc00640 1 -- 172.21.15.115:0/3398941974 shutdown_connections 2024-05-12T10:50:27.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0babc00640 1 --2- 172.21.15.115:0/3398941974 >> v2:172.21.15.134:3300/0 conn(0x7f0ba415fc60 0x7f0ba40cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0babc00640 1 --2- 172.21.15.115:0/3398941974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba4159430 0x7f0ba40cf560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0babc00640 1 -- 172.21.15.115:0/3398941974 >> 172.21.15.115:0/3398941974 conn(0x7f0ba406c440 msgr2=0x7f0ba406c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:27.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0babc00640 1 -- 172.21.15.115:0/3398941974 shutdown_connections 2024-05-12T10:50:27.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.009+0000 7f0babc00640 1 -- 172.21.15.115:0/3398941974 wait complete. 2024-05-12T10:50:27.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0babc00640 1 Processor -- start 2024-05-12T10:50:27.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0babc00640 1 -- start start 2024-05-12T10:50:27.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0babc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba40c9fd0 0x7f0ba406eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0babc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba4159430 0x7f0ba41f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0babc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba415fc60 0x7f0ba41f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0babc00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba406d180 con 0x7f0ba4159430 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0babc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba40ca580 con 0x7f0ba40c9fd0 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0babc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0ba40cbcc0 con 0x7f0ba415fc60 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba3e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba4159430 0x7f0ba41f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba3e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba4159430 0x7f0ba41f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53046/0 (socket says 172.21.15.115:53046) 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba3e00640 1 -- 172.21.15.115:0/733687094 learned_addr learned my addr 172.21.15.115:0/733687094 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba9200640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba40c9fd0 0x7f0ba406eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba9c00640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba415fc60 0x7f0ba41f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba3e00640 1 -- 172.21.15.115:0/733687094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba415fc60 msgr2=0x7f0ba41f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba3e00640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba415fc60 0x7f0ba41f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba3e00640 1 -- 172.21.15.115:0/733687094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba40c9fd0 msgr2=0x7f0ba406eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba3e00640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba40c9fd0 0x7f0ba406eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba3e00640 1 -- 172.21.15.115:0/733687094 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba40c7980 con 0x7f0ba4159430 2024-05-12T10:50:27.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba3e00640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba4159430 0x7f0ba41f52d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000c4b0 tx=0x7f0b9000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:27.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba0c00640 1 -- 172.21.15.115:0/733687094 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90018070 con 0x7f0ba4159430 2024-05-12T10:50:27.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba0c00640 1 -- 172.21.15.115:0/733687094 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b90007480 con 0x7f0ba4159430 2024-05-12T10:50:27.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0ba0c00640 1 -- 172.21.15.115:0/733687094 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b900047f0 con 0x7f0ba4159430 2024-05-12T10:50:27.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0babc00640 1 -- 172.21.15.115:0/733687094 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba40b1380 con 0x7f0ba4159430 2024-05-12T10:50:27.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0babc00640 1 -- 172.21.15.115:0/733687094 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba41e59c0 con 0x7f0ba4159430 2024-05-12T10:50:27.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.013+0000 7f0babc00640 1 -- 172.21.15.115:0/733687094 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba40b18a0 con 0x7f0ba4159430 2024-05-12T10:50:27.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.017+0000 7f0ba0c00640 1 -- 172.21.15.115:0/733687094 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0b9001b070 con 0x7f0ba4159430 2024-05-12T10:50:27.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.017+0000 7f0ba0c00640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b8406f430 0x7f0b840718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.017+0000 7f0ba0c00640 1 -- 172.21.15.115:0/733687094 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0b9008e870 con 0x7f0ba4159430 2024-05-12T10:50:27.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.017+0000 7f0ba9200640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b8406f430 0x7f0b840718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.017+0000 7f0ba9200640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b8406f430 0x7f0b840718f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0b980b2000 tx=0x7f0b98009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:27.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.021+0000 7f0ba0c00640 1 -- 172.21.15.115:0/733687094 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0ba40b18a0 con 0x7f0ba4159430 2024-05-12T10:50:27.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.209+0000 7f0babc00640 1 -- 172.21.15.115:0/733687094 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0ba4069730 con 0x7f0ba4159430 2024-05-12T10:50:27.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0ba0c00640 1 -- 172.21.15.115:0/733687094 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0b9008ce20 con 0x7f0ba4159430 2024-05-12T10:50:27.208 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:27.208 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-12T10:50:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 -- 172.21.15.115:0/733687094 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b8406f430 msgr2=0x7f0b840718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b8406f430 0x7f0b840718f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0b980b2000 tx=0x7f0b98009040 comp rx=0 tx=0).stop 2024-05-12T10:50:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 -- 172.21.15.115:0/733687094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba4159430 msgr2=0x7f0ba41f52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba4159430 0x7f0ba41f52d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000c4b0 tx=0x7f0b9000c970 comp rx=0 tx=0).stop 2024-05-12T10:50:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 -- 172.21.15.115:0/733687094 shutdown_connections 2024-05-12T10:50:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b8406f430 0x7f0b840718f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ba415fc60 0x7f0ba41f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba4159430 0x7f0ba41f52d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 --2- 172.21.15.115:0/733687094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba40c9fd0 0x7f0ba406eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 -- 172.21.15.115:0/733687094 >> 172.21.15.115:0/733687094 conn(0x7f0ba406c440 msgr2=0x7f0ba4156140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 -- 172.21.15.115:0/733687094 shutdown_connections 2024-05-12T10:50:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.213+0000 7f0babc00640 1 -- 172.21.15.115:0/733687094 wait complete. 2024-05-12T10:50:27.229 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-12T10:50:27.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:50:27.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f9487a00640 1 Processor -- start 2024-05-12T10:50:27.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f9487a00640 1 -- start start 2024-05-12T10:50:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f9487a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f94800ca040 0x7f94800cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f9487a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94800cfaa0 0x7f94800cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f9487a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948015ab40 con 0x7f9480153de0 2024-05-12T10:50:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f9487a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f94800c4d00 con 0x7f94800ca040 2024-05-12T10:50:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f9487a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9480159ce0 con 0x7f94800cfaa0 2024-05-12T10:50:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f9485000640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9480153de0 0x7f94800c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53162/0 (socket says 172.21.15.115:53162) 2024-05-12T10:50:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f9485000640 1 -- 172.21.15.115:0/1564188436 learned_addr learned my addr 172.21.15.115:0/1564188436 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f947fe00640 1 --2- 172.21.15.115:0/1564188436 >> v2:172.21.15.134:3300/0 conn(0x7f94800ca040 0x7f94800cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.368 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f9485a00640 1 --2- 172.21.15.115:0/1564188436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94800cfaa0 0x7f94800cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.368 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f947f400640 1 -- 172.21.15.115:0/1564188436 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241495312 0 0) 0x7f948015ab40 con 0x7f9480153de0 2024-05-12T10:50:27.368 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f947f400640 1 -- 172.21.15.115:0/1564188436 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9464003530 con 0x7f9480153de0 2024-05-12T10:50:27.368 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f947fe00640 1 -- 172.21.15.115:0/1564188436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94800cfaa0 msgr2=0x7f94800cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:27.368 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f947fe00640 1 --2- 172.21.15.115:0/1564188436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94800cfaa0 0x7f94800cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.368 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f947f400640 1 -- 172.21.15.115:0/1564188436 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1157300119 0 0) 0x7f9464003530 con 0x7f9480153de0 2024-05-12T10:50:27.368 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f947fe00640 1 -- 172.21.15.115:0/1564188436 >> v1:172.21.15.115:6789/0 conn(0x7f9480153de0 legacy=0x7f94800c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.368 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f947fe00640 1 -- 172.21.15.115:0/1564188436 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9480159fc0 con 0x7f94800ca040 2024-05-12T10:50:27.368 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.369+0000 7f9485a00640 1 --2- 172.21.15.115:0/1564188436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94800cfaa0 0x7f94800cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:27.370 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f947fe00640 1 --2- 172.21.15.115:0/1564188436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94800ca040 0x7f94800cf560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f946c0097c0 tx=0x7f946c01ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ff68bc366e1ee7 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:27.370 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f947f400640 1 -- 172.21.15.115:0/1564188436 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c0b5070 con 0x7f94800ca040 2024-05-12T10:50:27.370 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f947f400640 1 -- 172.21.15.115:0/1564188436 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f946c0a85f0 con 0x7f94800ca040 2024-05-12T10:50:27.371 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f947f400640 1 -- 172.21.15.115:0/1564188436 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470001700 con 0x7f94800ca040 2024-05-12T10:50:27.371 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f9487a00640 1 -- 172.21.15.115:0/1564188436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94800ca040 msgr2=0x7f94800cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.371 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f9487a00640 1 --2- 172.21.15.115:0/1564188436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94800ca040 0x7f94800cf560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f946c0097c0 tx=0x7f946c01ebb0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.371 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f9487a00640 1 -- 172.21.15.115:0/1564188436 shutdown_connections 2024-05-12T10:50:27.371 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f9487a00640 1 --2- 172.21.15.115:0/1564188436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94800cfaa0 0x7f94800cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.372 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f9487a00640 1 --2- 172.21.15.115:0/1564188436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94800ca040 0x7f94800cf560 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.372 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f9487a00640 1 -- 172.21.15.115:0/1564188436 >> 172.21.15.115:0/1564188436 conn(0x7f948006c440 msgr2=0x7f948006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:27.372 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f9487a00640 1 -- 172.21.15.115:0/1564188436 shutdown_connections 2024-05-12T10:50:27.372 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.373+0000 7f9487a00640 1 -- 172.21.15.115:0/1564188436 wait complete. 2024-05-12T10:50:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9487a00640 1 Processor -- start 2024-05-12T10:50:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9487a00640 1 -- start start 2024-05-12T10:50:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9487a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94800ca040 0x7f94800b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9487a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94800cfaa0 0x7f94801f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9487a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9480153de0 0x7f94800cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9487a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f948015a860 con 0x7f94800ca040 2024-05-12T10:50:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9487a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f948015a580 con 0x7f9480153de0 2024-05-12T10:50:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9487a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f948006d0b0 con 0x7f94800cfaa0 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9485000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94800ca040 0x7f94800b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9485000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94800ca040 0x7f94800b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53052/0 (socket says 172.21.15.115:53052) 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9485000640 1 -- 172.21.15.115:0/1816484630 learned_addr learned my addr 172.21.15.115:0/1816484630 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f947fe00640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94800cfaa0 0x7f94801f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9485a00640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9480153de0 0x7f94800cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9485000640 1 -- 172.21.15.115:0/1816484630 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94800cfaa0 msgr2=0x7f94801f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9485000640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94800cfaa0 0x7f94801f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9485000640 1 -- 172.21.15.115:0/1816484630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9480153de0 msgr2=0x7f94800cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9485000640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9480153de0 0x7f94800cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9485000640 1 -- 172.21.15.115:0/1816484630 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94800cdf00 con 0x7f94800ca040 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9485000640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94800ca040 0x7f94800b47c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f947000c4e0 tx=0x7f947000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f947cc00640 1 -- 172.21.15.115:0/1816484630 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470017070 con 0x7f94800ca040 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f947cc00640 1 -- 172.21.15.115:0/1816484630 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9470005cf0 con 0x7f94800ca040 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9487a00640 1 -- 172.21.15.115:0/1816484630 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94800ce180 con 0x7f94800ca040 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f947cc00640 1 -- 172.21.15.115:0/1816484630 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470007310 con 0x7f94800ca040 2024-05-12T10:50:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.377+0000 7f9487a00640 1 -- 172.21.15.115:0/1816484630 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948006d920 con 0x7f94800ca040 2024-05-12T10:50:27.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.381+0000 7f9487a00640 1 -- 172.21.15.115:0/1816484630 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9480069730 con 0x7f94800ca040 2024-05-12T10:50:27.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.381+0000 7f947cc00640 1 -- 172.21.15.115:0/1816484630 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f947001a070 con 0x7f94800ca040 2024-05-12T10:50:27.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.381+0000 7f947cc00640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f946006f400 0x7f94600718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.381+0000 7f947cc00640 1 -- 172.21.15.115:0/1816484630 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f947008e8f0 con 0x7f94800ca040 2024-05-12T10:50:27.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.381+0000 7f947fe00640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f946006f400 0x7f94600718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.381+0000 7f947fe00640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f946006f400 0x7f94600718c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f946c0b2000 tx=0x7f946c0aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:27.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.385+0000 7f947cc00640 1 -- 172.21.15.115:0/1816484630 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f94800cdf00 con 0x7f94800ca040 2024-05-12T10:50:27.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.573+0000 7f9487a00640 1 -- 172.21.15.115:0/1816484630 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94800cf880 con 0x7f94800ca040 2024-05-12T10:50:27.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f947cc00640 1 -- 172.21.15.115:0/1816484630 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6883 (secure 0 0 0) 0x7f947005aee0 con 0x7f94800ca040 2024-05-12T10:50:27.572 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:27.572 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:24.769798+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4321,4309]},"id":1}]} 2024-05-12T10:50:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 13 2024-05-12T10:50:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 -- 172.21.15.115:0/1816484630 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f946006f400 msgr2=0x7f94600718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f946006f400 0x7f94600718c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f946c0b2000 tx=0x7f946c0aa070 comp rx=0 tx=0).stop 2024-05-12T10:50:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 -- 172.21.15.115:0/1816484630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94800ca040 msgr2=0x7f94800b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94800ca040 0x7f94800b47c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f947000c4e0 tx=0x7f947000c8e0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 -- 172.21.15.115:0/1816484630 shutdown_connections 2024-05-12T10:50:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f946006f400 0x7f94600718c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9480153de0 0x7f94800cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94800cfaa0 0x7f94801f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 --2- 172.21.15.115:0/1816484630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94800ca040 0x7f94800b47c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 -- 172.21.15.115:0/1816484630 >> 172.21.15.115:0/1816484630 conn(0x7f948006c440 msgr2=0x7f9480152500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 -- 172.21.15.115:0/1816484630 shutdown_connections 2024-05-12T10:50:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.577+0000 7f9487a00640 1 -- 172.21.15.115:0/1816484630 wait complete. 2024-05-12T10:50:27.593 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:50:27.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.733+0000 7f2d2a200640 1 Processor -- start 2024-05-12T10:50:27.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.733+0000 7f2d2a200640 1 -- start start 2024-05-12T10:50:27.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d2a200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d24159300 0x7f2d240c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d2a200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 0x7f2d240c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d2a200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d240ca5e0 con 0x7f2d2406d650 2024-05-12T10:50:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d2a200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2d240cf530 con 0x7f2d24159300 2024-05-12T10:50:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d2a200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2d240cf810 con 0x7f2d2415c7e0 2024-05-12T10:50:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d23e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 0x7f2d240c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d23400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d24159300 0x7f2d240c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d23e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 0x7f2d240c4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60456/0 (socket says 172.21.15.115:60456) 2024-05-12T10:50:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d23e00640 1 -- 172.21.15.115:0/3637758808 learned_addr learned my addr 172.21.15.115:0/3637758808 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:27.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d23e00640 1 -- 172.21.15.115:0/3637758808 >> v2:172.21.15.134:3300/0 conn(0x7f2d24159300 msgr2=0x7f2d240c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:27.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d23e00640 1 --2- 172.21.15.115:0/3637758808 >> v2:172.21.15.134:3300/0 conn(0x7f2d24159300 0x7f2d240c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d23e00640 1 -- 172.21.15.115:0/3637758808 >> v1:172.21.15.134:6789/0 conn(0x7f2d2406d650 legacy=0x7f2d2406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.737+0000 7f2d23e00640 1 -- 172.21.15.115:0/3637758808 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d240cfaf0 con 0x7f2d2415c7e0 2024-05-12T10:50:27.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d23e00640 1 --2- 172.21.15.115:0/3637758808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 0x7f2d240c4e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009e50 tx=0x7f2d1c01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=190cfbc5629732f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:27.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d22a00640 1 -- 172.21.15.115:0/3637758808 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0a5700 con 0x7f2d2415c7e0 2024-05-12T10:50:27.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d22a00640 1 -- 172.21.15.115:0/3637758808 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0a58a0 con 0x7f2d2415c7e0 2024-05-12T10:50:27.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d22a00640 1 -- 172.21.15.115:0/3637758808 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0a5c70 con 0x7f2d2415c7e0 2024-05-12T10:50:27.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d2a200640 1 -- 172.21.15.115:0/3637758808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 msgr2=0x7f2d240c4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d2a200640 1 --2- 172.21.15.115:0/3637758808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 0x7f2d240c4e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009e50 tx=0x7f2d1c01ca30 comp rx=0 tx=0).stop 2024-05-12T10:50:27.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d2a200640 1 -- 172.21.15.115:0/3637758808 shutdown_connections 2024-05-12T10:50:27.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d2a200640 1 --2- 172.21.15.115:0/3637758808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 0x7f2d240c4e40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d2a200640 1 --2- 172.21.15.115:0/3637758808 >> v2:172.21.15.134:3300/0 conn(0x7f2d24159300 0x7f2d240c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d2a200640 1 -- 172.21.15.115:0/3637758808 >> 172.21.15.115:0/3637758808 conn(0x7f2d2406c440 msgr2=0x7f2d2406c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:27.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d2a200640 1 -- 172.21.15.115:0/3637758808 shutdown_connections 2024-05-12T10:50:27.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d2a200640 1 -- 172.21.15.115:0/3637758808 wait complete. 2024-05-12T10:50:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d2a200640 1 Processor -- start 2024-05-12T10:50:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.741+0000 7f2d2a200640 1 -- start start 2024-05-12T10:50:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d2a200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d2406d650 0x7f2d24151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d2a200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d24159300 0x7f2d24152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d2a200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 0x7f2d24149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d2a200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2406e5d0 con 0x7f2d24159300 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d2a200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d240c5790 con 0x7f2d2406d650 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d2a200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2d2406e750 con 0x7f2d2415c7e0 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1aa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d24159300 0x7f2d24152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1aa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d24159300 0x7f2d24152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53060/0 (socket says 172.21.15.115:53060) 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1aa00640 1 -- 172.21.15.115:0/1830902016 learned_addr learned my addr 172.21.15.115:0/1830902016 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d23e00640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 0x7f2d24149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d23400640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d2406d650 0x7f2d24151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1aa00640 1 -- 172.21.15.115:0/1830902016 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 msgr2=0x7f2d24149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1aa00640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 0x7f2d24149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1aa00640 1 -- 172.21.15.115:0/1830902016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d2406d650 msgr2=0x7f2d24151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1aa00640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d2406d650 0x7f2d24151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1aa00640 1 -- 172.21.15.115:0/1830902016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2414f7c0 con 0x7f2d24159300 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1aa00640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d24159300 0x7f2d24152c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00c3c0 tx=0x7f2d0c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1be00640 1 -- 172.21.15.115:0/1830902016 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c017070 con 0x7f2d24159300 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1be00640 1 -- 172.21.15.115:0/1830902016 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0c0052d0 con 0x7f2d24159300 2024-05-12T10:50:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1be00640 1 -- 172.21.15.115:0/1830902016 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c0054c0 con 0x7f2d24159300 2024-05-12T10:50:27.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d2a200640 1 -- 172.21.15.115:0/1830902016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2414f9b0 con 0x7f2d24159300 2024-05-12T10:50:27.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d2a200640 1 -- 172.21.15.115:0/1830902016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2414f200 con 0x7f2d24159300 2024-05-12T10:50:27.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d2a200640 1 -- 172.21.15.115:0/1830902016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d24069730 con 0x7f2d24159300 2024-05-12T10:50:27.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.745+0000 7f2d1be00640 1 -- 172.21.15.115:0/1830902016 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2d0c01a070 con 0x7f2d24159300 2024-05-12T10:50:27.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.749+0000 7f2d1be00640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2d0006f400 0x7f2d000718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:27.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.749+0000 7f2d1be00640 1 -- 172.21.15.115:0/1830902016 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2d0c08e840 con 0x7f2d24159300 2024-05-12T10:50:27.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.749+0000 7f2d23400640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2d0006f400 0x7f2d000718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:27.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.749+0000 7f2d23400640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2d0006f400 0x7f2d000718c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009ac0 tx=0x7f2d14009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:27.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.753+0000 7f2d1be00640 1 -- 172.21.15.115:0/1830902016 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2d0c05ada0 con 0x7f2d24159300 2024-05-12T10:50:27.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 -- 172.21.15.115:0/1830902016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d2406f550 con 0x7f2d24159300 2024-05-12T10:50:27.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d1be00640 1 -- 172.21.15.115:0/1830902016 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6883 (secure 0 0 0) 0x7f2d0c05f0a0 con 0x7f2d24159300 2024-05-12T10:50:27.941 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:27.941 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:24.769798+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4321,4309]},"id":1}]} 2024-05-12T10:50:27.941 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 13 2024-05-12T10:50:27.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 -- 172.21.15.115:0/1830902016 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2d0006f400 msgr2=0x7f2d000718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2d0006f400 0x7f2d000718c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009ac0 tx=0x7f2d14009190 comp rx=0 tx=0).stop 2024-05-12T10:50:27.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 -- 172.21.15.115:0/1830902016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d24159300 msgr2=0x7f2d24152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:27.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d24159300 0x7f2d24152c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00c3c0 tx=0x7f2d0c00c880 comp rx=0 tx=0).stop 2024-05-12T10:50:27.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 -- 172.21.15.115:0/1830902016 shutdown_connections 2024-05-12T10:50:27.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2d0006f400 0x7f2d000718c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d2415c7e0 0x7f2d24149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d24159300 0x7f2d24152c80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 --2- 172.21.15.115:0/1830902016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d2406d650 0x7f2d24151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:27.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 -- 172.21.15.115:0/1830902016 >> 172.21.15.115:0/1830902016 conn(0x7f2d2406c440 msgr2=0x7f2d240afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:27.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 -- 172.21.15.115:0/1830902016 shutdown_connections 2024-05-12T10:50:27.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:27.945+0000 7f2d2a200640 1 -- 172.21.15.115:0/1830902016 wait complete. 2024-05-12T10:50:27.962 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:50:28.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f960c600640 1 Processor -- start 2024-05-12T10:50:28.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f960c600640 1 -- start start 2024-05-12T10:50:28.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f960c600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96040c7e20 0x7f96040c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f960c600640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96040c9400 con 0x7f96040c7680 2024-05-12T10:50:28.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f960c600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96040c8440 con 0x7f9604153940 2024-05-12T10:50:28.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f960c600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f96040c8200 con 0x7f96040c7e20 2024-05-12T10:50:28.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9609200640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f96040c7680 0x7f96040cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53176/0 (socket says 172.21.15.115:53176) 2024-05-12T10:50:28.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9609200640 1 -- 172.21.15.115:0/306410976 learned_addr learned my addr 172.21.15.115:0/306410976 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:28.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f960a600640 1 --2- 172.21.15.115:0/306410976 >> v2:172.21.15.134:3300/0 conn(0x7f96040c7e20 0x7f96040c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 670818032 0 0) 0x7f95f0001120 con 0x7f96040c7680 2024-05-12T10:50:28.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95ec003530 con 0x7f96040c7680 2024-05-12T10:50:28.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757312361 0 0) 0x7f96040c8440 con 0x7f9604153940 2024-05-12T10:50:28.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95f0001120 con 0x7f9604153940 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2841582137 0 0) 0x7f95ec003530 con 0x7f96040c7680 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 >> v2:172.21.15.134:3300/0 conn(0x7f96040c7e20 msgr2=0x7f96040c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 --2- 172.21.15.115:0/306410976 >> v2:172.21.15.134:3300/0 conn(0x7f96040c7e20 0x7f96040c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 >> v1:172.21.15.134:6789/0 conn(0x7f9604153940 legacy=0x7f960415a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96040c49c0 con 0x7f96040c7680 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f95f00018d0 con 0x7f96040c7680 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 >> v1:172.21.15.115:6789/0 conn(0x7f96040c7680 legacy=0x7f96040cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 --2- 172.21.15.115:0/306410976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec003c40 0x7f95ec004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 --2- 172.21.15.115:0/306410976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec004810 0x7f95ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 --2- 172.21.15.115:0/306410976 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec005220 0x7f95ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f96040c8200 con 0x7f95ec003c40 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec00c0a0 con 0x7f95ec004810 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.101+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f95ec00c2a0 con 0x7f95ec005220 2024-05-12T10:50:28.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f9609c00640 1 --2- 172.21.15.115:0/306410976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec003c40 0x7f95ec004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f9609200640 1 --2- 172.21.15.115:0/306410976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec004810 0x7f95ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f960a600640 1 --2- 172.21.15.115:0/306410976 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec005220 0x7f95ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f9609c00640 1 -- 172.21.15.115:0/306410976 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec005220 msgr2=0x7f95ec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:28.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f9609c00640 1 --2- 172.21.15.115:0/306410976 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec005220 0x7f95ec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f9609c00640 1 -- 172.21.15.115:0/306410976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec004810 msgr2=0x7f95ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:28.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f9609c00640 1 --2- 172.21.15.115:0/306410976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec004810 0x7f95ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f9609c00640 1 -- 172.21.15.115:0/306410976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec003530 con 0x7f95ec003c40 2024-05-12T10:50:28.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f960a600640 1 -- 172.21.15.115:0/306410976 reap_dead start 2024-05-12T10:50:28.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f9609c00640 1 --2- 172.21.15.115:0/306410976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec003c40 0x7f95ec004040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f95f8001930 tx=0x7f95f801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3385ab79cb63b76a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:28.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8001550 con 0x7f95ec003c40 2024-05-12T10:50:28.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f80052d0 con 0x7f95ec003c40 2024-05-12T10:50:28.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.105+0000 7f9603e00640 1 -- 172.21.15.115:0/306410976 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8007260 con 0x7f95ec003c40 2024-05-12T10:50:28.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 -- 172.21.15.115:0/306410976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec003c40 msgr2=0x7f95ec004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 --2- 172.21.15.115:0/306410976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec003c40 0x7f95ec004040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f95f8001930 tx=0x7f95f801ec50 comp rx=0 tx=0).stop 2024-05-12T10:50:28.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 -- 172.21.15.115:0/306410976 shutdown_connections 2024-05-12T10:50:28.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 --2- 172.21.15.115:0/306410976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec003c40 0x7f95ec004040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 -- 172.21.15.115:0/306410976 >> 172.21.15.115:0/306410976 conn(0x7f96040681c0 msgr2=0x7f96040685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:28.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 -- 172.21.15.115:0/306410976 shutdown_connections 2024-05-12T10:50:28.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 -- 172.21.15.115:0/306410976 wait complete. 2024-05-12T10:50:28.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 Processor -- start 2024-05-12T10:50:28.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 -- start start 2024-05-12T10:50:28.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec003c40 0x7f96040cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96041e4cd0 0x7f96041e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96041494c0 0x7f96041e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f96040c4f00 con 0x7f96041494c0 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96040c4c60 con 0x7f96041e4cd0 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960c600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9604159cb0 con 0x7f95ec003c40 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960a600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96041494c0 0x7f96041e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f9609c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec003c40 0x7f96040cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960a600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96041494c0 0x7f96041e3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53070/0 (socket says 172.21.15.115:53070) 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f9609c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec003c40 0x7f96040cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60492/0 (socket says 172.21.15.115:60492) 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960a600640 1 -- 172.21.15.115:0/1430439044 learned_addr learned my addr 172.21.15.115:0/1430439044 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f9609200640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96041e4cd0 0x7f96041e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960a600640 1 -- 172.21.15.115:0/1430439044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec003c40 msgr2=0x7f96040cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960a600640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec003c40 0x7f96040cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960a600640 1 -- 172.21.15.115:0/1430439044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96041e4cd0 msgr2=0x7f96041e36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960a600640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96041e4cd0 0x7f96041e36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960a600640 1 -- 172.21.15.115:0/1430439044 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96041e52e0 con 0x7f96041494c0 2024-05-12T10:50:28.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.109+0000 7f960a600640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96041494c0 0x7f96041e3c20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f96040caee0 tx=0x7f95fc00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:28.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.113+0000 7f9601600640 1 -- 172.21.15.115:0/1430439044 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00fd10 con 0x7f96041494c0 2024-05-12T10:50:28.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.113+0000 7f9601600640 1 -- 172.21.15.115:0/1430439044 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc01d070 con 0x7f96041494c0 2024-05-12T10:50:28.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.113+0000 7f9601600640 1 -- 172.21.15.115:0/1430439044 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc015670 con 0x7f96041494c0 2024-05-12T10:50:28.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.113+0000 7f960c600640 1 -- 172.21.15.115:0/1430439044 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96041480c0 con 0x7f96041494c0 2024-05-12T10:50:28.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.113+0000 7f960c600640 1 -- 172.21.15.115:0/1430439044 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96041e5970 con 0x7f96041494c0 2024-05-12T10:50:28.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.113+0000 7f960c600640 1 -- 172.21.15.115:0/1430439044 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9604069730 con 0x7f96041494c0 2024-05-12T10:50:28.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.113+0000 7f9601600640 1 -- 172.21.15.115:0/1430439044 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f95fc015810 con 0x7f96041494c0 2024-05-12T10:50:28.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.113+0000 7f9601600640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f95e406f430 0x7f95e40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.113+0000 7f9601600640 1 -- 172.21.15.115:0/1430439044 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f95fc08fe20 con 0x7f96041494c0 2024-05-12T10:50:28.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.113+0000 7f9609c00640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f95e406f430 0x7f95e40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.117+0000 7f9609c00640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f95e406f430 0x7f95e40718f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f95f80af000 tx=0x7f95f8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:28.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.117+0000 7f9601600640 1 -- 172.21.15.115:0/1430439044 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f95fc010040 con 0x7f96041494c0 2024-05-12T10:50:28.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.277+0000 7f960c600640 1 -- 172.21.15.115:0/1430439044 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96040caac0 con 0x7f96041494c0 2024-05-12T10:50:28.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.277+0000 7f9601600640 1 -- 172.21.15.115:0/1430439044 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18550 (secure 0 0 0) 0x7f95fc05c9c0 con 0x7f96041494c0 2024-05-12T10:50:28.275 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:28.275 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:01.648279+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:50:28.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 -- 172.21.15.115:0/1430439044 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f95e406f430 msgr2=0x7f95e40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f95e406f430 0x7f95e40718f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f95f80af000 tx=0x7f95f8009040 comp rx=0 tx=0).stop 2024-05-12T10:50:28.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 -- 172.21.15.115:0/1430439044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96041494c0 msgr2=0x7f96041e3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96041494c0 0x7f96041e3c20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f96040caee0 tx=0x7f95fc00f1b0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 -- 172.21.15.115:0/1430439044 shutdown_connections 2024-05-12T10:50:28.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f95e406f430 0x7f95e40718f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96041494c0 0x7f96041e3c20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96041e4cd0 0x7f96041e36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 --2- 172.21.15.115:0/1430439044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95ec003c40 0x7f96040cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 -- 172.21.15.115:0/1430439044 >> 172.21.15.115:0/1430439044 conn(0x7f96040681c0 msgr2=0x7f96040ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:28.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 -- 172.21.15.115:0/1430439044 shutdown_connections 2024-05-12T10:50:28.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.281+0000 7f960c600640 1 -- 172.21.15.115:0/1430439044 wait complete. 2024-05-12T10:50:28.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:50:28.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a7b600640 1 Processor -- start 2024-05-12T10:50:28.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a7b600640 1 -- start start 2024-05-12T10:50:28.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a7b600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a74073470 0x7f3a740cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a7b600640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7415bc90 con 0x7f3a740738b0 2024-05-12T10:50:28.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a7b600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7415bf10 con 0x7f3a74155f40 2024-05-12T10:50:28.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a7b600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7415c1f0 con 0x7f3a74073470 2024-05-12T10:50:28.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a79600640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3a740738b0 0x7f3a7415f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53184/0 (socket says 172.21.15.115:53184) 2024-05-12T10:50:28.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a79600640 1 -- 172.21.15.115:0/3237758198 learned_addr learned my addr 172.21.15.115:0/3237758198 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:28.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a73e00640 1 --2- 172.21.15.115:0/3237758198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a74073470 0x7f3a740cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a73400640 1 -- 172.21.15.115:0/3237758198 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034921530 0 0) 0x7f3a6c0014a0 con 0x7f3a740738b0 2024-05-12T10:50:28.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a73400640 1 -- 172.21.15.115:0/3237758198 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a5c003530 con 0x7f3a740738b0 2024-05-12T10:50:28.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a73400640 1 -- 172.21.15.115:0/3237758198 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 358431215 0 0) 0x7f3a7415bf10 con 0x7f3a74155f40 2024-05-12T10:50:28.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a73400640 1 -- 172.21.15.115:0/3237758198 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a6c0014a0 con 0x7f3a74155f40 2024-05-12T10:50:28.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a73e00640 1 -- 172.21.15.115:0/3237758198 >> v1:172.21.15.134:6789/0 conn(0x7f3a74155f40 legacy=0x7f3a740714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a73e00640 1 -- 172.21.15.115:0/3237758198 >> v1:172.21.15.115:6789/0 conn(0x7f3a740738b0 legacy=0x7f3a7415f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.437+0000 7f3a73e00640 1 -- 172.21.15.115:0/3237758198 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7415c4d0 con 0x7f3a74073470 2024-05-12T10:50:28.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.441+0000 7f3a73e00640 1 --2- 172.21.15.115:0/3237758198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a74073470 0x7f3a740cadc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a600097f0 tx=0x7f3a6001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6fd4f3164c2f7e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:28.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.441+0000 7f3a73400640 1 -- 172.21.15.115:0/3237758198 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a600ab5f0 con 0x7f3a74073470 2024-05-12T10:50:28.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.441+0000 7f3a73400640 1 -- 172.21.15.115:0/3237758198 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a600b0070 con 0x7f3a74073470 2024-05-12T10:50:28.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.441+0000 7f3a73400640 1 -- 172.21.15.115:0/3237758198 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a600ab9b0 con 0x7f3a74073470 2024-05-12T10:50:28.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.441+0000 7f3a7b600640 1 -- 172.21.15.115:0/3237758198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a74073470 msgr2=0x7f3a740cadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.441+0000 7f3a7b600640 1 --2- 172.21.15.115:0/3237758198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a74073470 0x7f3a740cadc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a600097f0 tx=0x7f3a6001c4e0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.441+0000 7f3a7b600640 1 -- 172.21.15.115:0/3237758198 shutdown_connections 2024-05-12T10:50:28.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.441+0000 7f3a7b600640 1 --2- 172.21.15.115:0/3237758198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a74073470 0x7f3a740cadc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.441+0000 7f3a7b600640 1 -- 172.21.15.115:0/3237758198 >> 172.21.15.115:0/3237758198 conn(0x7f3a74076890 msgr2=0x7f3a740681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:28.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.441+0000 7f3a7b600640 1 -- 172.21.15.115:0/3237758198 shutdown_connections 2024-05-12T10:50:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.441+0000 7f3a7b600640 1 -- 172.21.15.115:0/3237758198 wait complete. 2024-05-12T10:50:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a7b600640 1 Processor -- start 2024-05-12T10:50:28.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a7b600640 1 -- start start 2024-05-12T10:50:28.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a7b600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a74073470 0x7f3a740cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a7b600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a740738b0 0x7f3a7414c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a7b600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a74155f40 0x7f3a740cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a7b600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3a74169fb0 con 0x7f3a74155f40 2024-05-12T10:50:28.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a7b600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a740cb710 con 0x7f3a740738b0 2024-05-12T10:50:28.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a7b600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7416a130 con 0x7f3a74073470 2024-05-12T10:50:28.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a79600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a74155f40 0x7f3a740cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a78c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a74073470 0x7f3a740cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a79600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a74155f40 0x7f3a740cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53086/0 (socket says 172.21.15.115:53086) 2024-05-12T10:50:28.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a79600640 1 -- 172.21.15.115:0/643633141 learned_addr learned my addr 172.21.15.115:0/643633141 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:28.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a73e00640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a740738b0 0x7f3a7414c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a79600640 1 -- 172.21.15.115:0/643633141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a74073470 msgr2=0x7f3a740cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a79600640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a74073470 0x7f3a740cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a79600640 1 -- 172.21.15.115:0/643633141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a740738b0 msgr2=0x7f3a7414c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a79600640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a740738b0 0x7f3a7414c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a79600640 1 -- 172.21.15.115:0/643633141 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a740cf100 con 0x7f3a74155f40 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a73e00640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a740738b0 0x7f3a7414c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a79600640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a74155f40 0x7f3a740cc2a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c001fb0 tx=0x7f3a6c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a70c00640 1 -- 172.21.15.115:0/643633141 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c012400 con 0x7f3a74155f40 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a70c00640 1 -- 172.21.15.115:0/643633141 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6c0125c0 con 0x7f3a74155f40 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a70c00640 1 -- 172.21.15.115:0/643633141 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0129b0 con 0x7f3a74155f40 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a7b600640 1 -- 172.21.15.115:0/643633141 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a741f6360 con 0x7f3a74155f40 2024-05-12T10:50:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a7b600640 1 -- 172.21.15.115:0/643633141 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a741f7310 con 0x7f3a74155f40 2024-05-12T10:50:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.445+0000 7f3a7b600640 1 -- 172.21.15.115:0/643633141 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a741f7dd0 con 0x7f3a74155f40 2024-05-12T10:50:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.449+0000 7f3a70c00640 1 -- 172.21.15.115:0/643633141 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3a6c012b50 con 0x7f3a74155f40 2024-05-12T10:50:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.449+0000 7f3a70c00640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a5406f400 0x7f3a540718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.449+0000 7f3a70c00640 1 -- 172.21.15.115:0/643633141 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3a6c08fd70 con 0x7f3a74155f40 2024-05-12T10:50:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.449+0000 7f3a78c00640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a5406f400 0x7f3a540718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:28.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.449+0000 7f3a78c00640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a5406f400 0x7f3a540718c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3a68000c10 tx=0x7f3a68009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:28.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.453+0000 7f3a70c00640 1 -- 172.21.15.115:0/643633141 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3a741f7dd0 con 0x7f3a74155f40 2024-05-12T10:50:28.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.645+0000 7f3a7b600640 1 -- 172.21.15.115:0/643633141 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a74069730 con 0x7f3a74155f40 2024-05-12T10:50:28.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.645+0000 7f3a70c00640 1 -- 172.21.15.115:0/643633141 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6883 (secure 0 0 0) 0x7f3a7415bc90 con 0x7f3a74155f40 2024-05-12T10:50:28.642 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:28.642 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:24.769798+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4321,4309]},"id":1}]} 2024-05-12T10:50:28.643 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 13 2024-05-12T10:50:28.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 -- 172.21.15.115:0/643633141 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a5406f400 msgr2=0x7f3a540718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a5406f400 0x7f3a540718c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3a68000c10 tx=0x7f3a68009040 comp rx=0 tx=0).stop 2024-05-12T10:50:28.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 -- 172.21.15.115:0/643633141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a74155f40 msgr2=0x7f3a740cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:28.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a74155f40 0x7f3a740cc2a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c001fb0 tx=0x7f3a6c00a430 comp rx=0 tx=0).stop 2024-05-12T10:50:28.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 -- 172.21.15.115:0/643633141 shutdown_connections 2024-05-12T10:50:28.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a5406f400 0x7f3a540718c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a74155f40 0x7f3a740cc2a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a740738b0 0x7f3a7414c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 --2- 172.21.15.115:0/643633141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a74073470 0x7f3a740cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:28.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 -- 172.21.15.115:0/643633141 >> 172.21.15.115:0/643633141 conn(0x7f3a74076890 msgr2=0x7f3a740681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:28.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 -- 172.21.15.115:0/643633141 shutdown_connections 2024-05-12T10:50:28.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:28.649+0000 7f3a7b600640 1 -- 172.21.15.115:0/643633141 wait complete. 2024-05-12T10:50:29.267 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-12T10:49:54.988983+0000', 'modified': '2024-05-12T10:50:24.769798+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4321, 'mds_1': 4309, 'mds_2': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.115:6839/3194167246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 3194167246}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 3194167246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4309': {'gid': 4309, 'name': 'e', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.115:6837/4177777929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6835', 'nonce': 4177777929}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 4177777929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4321': {'gid': 4321, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6835/1447701149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 1447701149}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 1447701149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4321, 'qdb_cluster': [4321, 4309]} 2024-05-12T10:50:29.267 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4260:up:creating 2024-05-12T10:50:29.803 INFO:tasks.ceph.mds.b.smithi134.stderr:2024-05-12T10:50:29.808+0000 7f9f995f9640 -1 quiesce.mds.0 failed to decode message of type 1286 v1: End of buffer [buffer:2] 2024-05-12T10:50:30.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:50:30.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.417+0000 7f6346000640 1 Processor -- start 2024-05-12T10:50:30.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.417+0000 7f6346000640 1 -- start start 2024-05-12T10:50:30.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.417+0000 7f6346000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63400c9450 0x7f6340068250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:30.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.417+0000 7f6346000640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63400cb5e0 con 0x7f6340155d90 2024-05-12T10:50:30.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.417+0000 7f6346000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63401600e0 con 0x7f6340156170 2024-05-12T10:50:30.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.417+0000 7f6346000640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f63400cc4b0 con 0x7f63400c9450 2024-05-12T10:50:30.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.417+0000 7f6336a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63400c9450 0x7f6340068250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:30.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.417+0000 7f633f400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6340155d90 0x7f63400c8d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53192/0 (socket says 172.21.15.115:53192) 2024-05-12T10:50:30.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.417+0000 7f633f400640 1 -- 172.21.15.115:0/766826653 learned_addr learned my addr 172.21.15.115:0/766826653 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:30.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.417+0000 7f6336a00640 1 -- 172.21.15.115:0/766826653 >> v1:172.21.15.134:6789/0 conn(0x7f6340156170 legacy=0x7f634015f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:30.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f6336a00640 1 -- 172.21.15.115:0/766826653 >> v1:172.21.15.115:6789/0 conn(0x7f6340155d90 legacy=0x7f63400c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:30.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f6336a00640 1 -- 172.21.15.115:0/766826653 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63400cc700 con 0x7f63400c9450 2024-05-12T10:50:30.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f6336a00640 1 --2- 172.21.15.115:0/766826653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63400c9450 0x7f6340068250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f63280097c0 tx=0x7f632801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21522683ab7511fd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:30.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f633ea00640 1 -- 172.21.15.115:0/766826653 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63280b5070 con 0x7f63400c9450 2024-05-12T10:50:30.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f633ea00640 1 -- 172.21.15.115:0/766826653 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63280a8990 con 0x7f63400c9450 2024-05-12T10:50:30.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f633ea00640 1 -- 172.21.15.115:0/766826653 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63280a8d60 con 0x7f63400c9450 2024-05-12T10:50:30.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f6346000640 1 -- 172.21.15.115:0/766826653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63400c9450 msgr2=0x7f6340068250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:30.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f6346000640 1 --2- 172.21.15.115:0/766826653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63400c9450 0x7f6340068250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f63280097c0 tx=0x7f632801ec90 comp rx=0 tx=0).stop 2024-05-12T10:50:30.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f6346000640 1 -- 172.21.15.115:0/766826653 shutdown_connections 2024-05-12T10:50:30.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f6346000640 1 --2- 172.21.15.115:0/766826653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63400c9450 0x7f6340068250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:30.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f6346000640 1 -- 172.21.15.115:0/766826653 >> 172.21.15.115:0/766826653 conn(0x7f63400ca7a0 msgr2=0x7f63400cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:30.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f6346000640 1 -- 172.21.15.115:0/766826653 shutdown_connections 2024-05-12T10:50:30.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.421+0000 7f6346000640 1 -- 172.21.15.115:0/766826653 wait complete. 2024-05-12T10:50:30.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6346000640 1 Processor -- start 2024-05-12T10:50:30.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6346000640 1 -- start start 2024-05-12T10:50:30.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6346000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63400c9450 0x7f6340151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:30.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6346000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340155d90 0x7f634015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:30.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6346000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6340156170 0x7f634015e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:30.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6346000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f634015fa00 con 0x7f6340155d90 2024-05-12T10:50:30.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6346000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63400c8820 con 0x7f63400c9450 2024-05-12T10:50:30.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6346000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f634015fb80 con 0x7f6340156170 2024-05-12T10:50:30.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6336a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340155d90 0x7f634015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6336a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340155d90 0x7f634015e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53112/0 (socket says 172.21.15.115:53112) 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6336a00640 1 -- 172.21.15.115:0/3118572802 learned_addr learned my addr 172.21.15.115:0/3118572802 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f633f400640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63400c9450 0x7f6340151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f633fe00640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6340156170 0x7f634015e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6336a00640 1 -- 172.21.15.115:0/3118572802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6340156170 msgr2=0x7f634015e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6336a00640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6340156170 0x7f634015e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6336a00640 1 -- 172.21.15.115:0/3118572802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63400c9450 msgr2=0x7f6340151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6336a00640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63400c9450 0x7f6340151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6336a00640 1 -- 172.21.15.115:0/3118572802 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63400cb410 con 0x7f6340155d90 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f633fe00640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6340156170 0x7f634015e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6336a00640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340155d90 0x7f634015e3b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f632801b8a0 tx=0x7f632801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6337e00640 1 -- 172.21.15.115:0/3118572802 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63280bf070 con 0x7f6340155d90 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6337e00640 1 -- 172.21.15.115:0/3118572802 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63280b0920 con 0x7f6340155d90 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6346000640 1 -- 172.21.15.115:0/3118572802 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634014c460 con 0x7f6340155d90 2024-05-12T10:50:30.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6337e00640 1 -- 172.21.15.115:0/3118572802 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63280b5040 con 0x7f6340155d90 2024-05-12T10:50:30.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.425+0000 7f6346000640 1 -- 172.21.15.115:0/3118572802 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634014ca20 con 0x7f6340155d90 2024-05-12T10:50:30.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.429+0000 7f6346000640 1 -- 172.21.15.115:0/3118572802 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6340069730 con 0x7f6340155d90 2024-05-12T10:50:30.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.429+0000 7f6337e00640 1 -- 172.21.15.115:0/3118572802 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f63280c2070 con 0x7f6340155d90 2024-05-12T10:50:30.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.429+0000 7f6337e00640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 0x7f631c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:30.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.429+0000 7f6337e00640 1 -- 172.21.15.115:0/3118572802 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f632812beb0 con 0x7f6340155d90 2024-05-12T10:50:30.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.429+0000 7f633f400640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 0x7f631c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:30.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.429+0000 7f633f400640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 0x7f631c0718f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63300012f0 tx=0x7f6330009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:30.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.433+0000 7f6337e00640 1 -- 172.21.15.115:0/3118572802 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f63280187f0 con 0x7f6340155d90 2024-05-12T10:50:30.571 INFO:tasks.ceph.mds.b.smithi134.stderr:2024-05-12T10:50:30.576+0000 7f9f96df4640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-12T10:50:30.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 -- 172.21.15.115:0/3118572802 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f634006f970 con 0x7f6340155d90 2024-05-12T10:50:30.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6337e00640 1 -- 172.21.15.115:0/3118572802 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f63280f8a50 con 0x7f6340155d90 2024-05-12T10:50:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:30.621 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:50:30.621 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 -- 172.21.15.115:0/3118572802 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 msgr2=0x7f631c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 0x7f631c0718f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63300012f0 tx=0x7f6330009040 comp rx=0 tx=0).stop 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 -- 172.21.15.115:0/3118572802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340155d90 msgr2=0x7f634015e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340155d90 0x7f634015e3b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f632801b8a0 tx=0x7f632801ba30 comp rx=0 tx=0).stop 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 -- 172.21.15.115:0/3118572802 shutdown_connections 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 0x7f631c0718f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6340156170 0x7f634015e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340155d90 0x7f634015e3b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 --2- 172.21.15.115:0/3118572802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63400c9450 0x7f6340151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 -- 172.21.15.115:0/3118572802 >> 172.21.15.115:0/3118572802 conn(0x7f63400ca7a0 msgr2=0x7f63400c32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 -- 172.21.15.115:0/3118572802 shutdown_connections 2024-05-12T10:50:30.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:30.625+0000 7f6346000640 1 -- 172.21.15.115:0/3118572802 wait complete. 2024-05-12T10:50:31.245 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-12T10:49:54.988983+0000', 'modified': '2024-05-12T10:50:29.799298+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4321, 'mds_1': 4309, 'mds_2': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.115:6839/3194167246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 3194167246}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 3194167246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4309': {'gid': 4309, 'name': 'e', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.115:6837/4177777929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6835', 'nonce': 4177777929}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 4177777929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4321': {'gid': 4321, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6835/1447701149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 1447701149}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 1447701149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4321, 'qdb_cluster': [4260, 4309, 4321]} 2024-05-12T10:50:31.245 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-12T10:50:31.246 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-12T10:50:31.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.393+0000 7fa038000640 1 Processor -- start 2024-05-12T10:50:31.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.393+0000 7fa038000640 1 -- start start 2024-05-12T10:50:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.393+0000 7fa038000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa030152a10 0x7fa030159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.393+0000 7fa038000640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa03015be20 con 0x7fa030152df0 2024-05-12T10:50:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.393+0000 7fa038000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa030072cf0 con 0x7fa030073820 2024-05-12T10:50:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.393+0000 7fa038000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa030072fd0 con 0x7fa030152a10 2024-05-12T10:50:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.393+0000 7fa034c00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa030152df0 0x7fa030073d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53196/0 (socket says 172.21.15.115:53196) 2024-05-12T10:50:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.393+0000 7fa034c00640 1 -- 172.21.15.115:0/1568851302 learned_addr learned my addr 172.21.15.115:0/1568851302 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:31.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.393+0000 7fa035600640 1 --2- 172.21.15.115:0/1568851302 >> v2:172.21.15.134:3300/0 conn(0x7fa030152a10 0x7fa030159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251288071 0 0) 0x7fa03015be20 con 0x7fa030152df0 2024-05-12T10:50:31.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa018003530 con 0x7fa030152df0 2024-05-12T10:50:31.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396597220 0 0) 0x7fa030072cf0 con 0x7fa030073820 2024-05-12T10:50:31.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa03015be20 con 0x7fa030073820 2024-05-12T10:50:31.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3033184916 0 0) 0x7fa018003530 con 0x7fa030152df0 2024-05-12T10:50:31.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 >> v2:172.21.15.134:3300/0 conn(0x7fa030152a10 msgr2=0x7fa030159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:31.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 --2- 172.21.15.115:0/1568851302 >> v2:172.21.15.134:3300/0 conn(0x7fa030152a10 0x7fa030159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 >> v1:172.21.15.134:6789/0 conn(0x7fa030073820 legacy=0x7fa03015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:31.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0300c4990 con 0x7fa030152df0 2024-05-12T10:50:31.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fa01c001700 con 0x7fa030152df0 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 >> v1:172.21.15.115:6789/0 conn(0x7fa030152df0 legacy=0x7fa030073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 --2- 172.21.15.115:0/1568851302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa018003c40 0x7fa018004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 --2- 172.21.15.115:0/1568851302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa018004810 0x7fa018004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 --2- 172.21.15.115:0/1568851302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018005220 0x7fa01800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa030072fd0 con 0x7fa018005220 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa01800c0a0 con 0x7fa018003c40 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa01800c2a0 con 0x7fa018004810 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa036000640 1 --2- 172.21.15.115:0/1568851302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018005220 0x7fa01800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa035600640 1 --2- 172.21.15.115:0/1568851302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa018003c40 0x7fa018004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa034c00640 1 --2- 172.21.15.115:0/1568851302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa018004810 0x7fa018004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa036000640 1 -- 172.21.15.115:0/1568851302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa018004810 msgr2=0x7fa018004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa036000640 1 --2- 172.21.15.115:0/1568851302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa018004810 0x7fa018004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa036000640 1 -- 172.21.15.115:0/1568851302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa018003c40 msgr2=0x7fa018004040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:31.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa036000640 1 --2- 172.21.15.115:0/1568851302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa018003c40 0x7fa018004040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.397+0000 7fa036000640 1 -- 172.21.15.115:0/1568851302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa018003530 con 0x7fa018005220 2024-05-12T10:50:31.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa036000640 1 -- 172.21.15.115:0/1568851302 reap_dead start 2024-05-12T10:50:31.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa036000640 1 --2- 172.21.15.115:0/1568851302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018005220 0x7fa01800b9d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa0280020b0 tx=0x7fa02801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e113aff022beb34 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:31.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028001c50 con 0x7fa018005220 2024-05-12T10:50:31.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa028006d60 con 0x7fa018005220 2024-05-12T10:50:31.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa02fe00640 1 -- 172.21.15.115:0/1568851302 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028003ba0 con 0x7fa018005220 2024-05-12T10:50:31.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 -- 172.21.15.115:0/1568851302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018005220 msgr2=0x7fa01800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:31.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 --2- 172.21.15.115:0/1568851302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018005220 0x7fa01800b9d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa0280020b0 tx=0x7fa02801c920 comp rx=0 tx=0).stop 2024-05-12T10:50:31.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 -- 172.21.15.115:0/1568851302 shutdown_connections 2024-05-12T10:50:31.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 --2- 172.21.15.115:0/1568851302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018005220 0x7fa01800b9d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 -- 172.21.15.115:0/1568851302 >> 172.21.15.115:0/1568851302 conn(0x7fa030076830 msgr2=0x7fa0300681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:31.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 -- 172.21.15.115:0/1568851302 shutdown_connections 2024-05-12T10:50:31.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 -- 172.21.15.115:0/1568851302 wait complete. 2024-05-12T10:50:31.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 Processor -- start 2024-05-12T10:50:31.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 -- start start 2024-05-12T10:50:31.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa018005220 0x7fa0301e4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa030156cb0 0x7fa0301e2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0301599f0 0x7fa0300cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa0300c4f50 con 0x7fa0301599f0 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa030072b50 con 0x7fa030156cb0 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa038000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa030073460 con 0x7fa018005220 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.401+0000 7fa036000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0301599f0 0x7fa0300cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa036000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0301599f0 0x7fa0300cd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53138/0 (socket says 172.21.15.115:53138) 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa036000640 1 -- 172.21.15.115:0/1601552003 learned_addr learned my addr 172.21.15.115:0/1601552003 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa035600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa018005220 0x7fa0301e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa034c00640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa030156cb0 0x7fa0301e2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa036000640 1 -- 172.21.15.115:0/1601552003 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa018005220 msgr2=0x7fa0301e4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa036000640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa018005220 0x7fa0301e4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa036000640 1 -- 172.21.15.115:0/1601552003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa030156cb0 msgr2=0x7fa0301e2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa036000640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa030156cb0 0x7fa0301e2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa036000640 1 -- 172.21.15.115:0/1601552003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0301e5d60 con 0x7fa0301599f0 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa036000640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0301599f0 0x7fa0300cd5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa02801b020 tx=0x7fa018005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:31.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa02d600640 1 -- 172.21.15.115:0/1601552003 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0280bc070 con 0x7fa0301599f0 2024-05-12T10:50:31.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa02d600640 1 -- 172.21.15.115:0/1601552003 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa028006b60 con 0x7fa0301599f0 2024-05-12T10:50:31.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa038000640 1 -- 172.21.15.115:0/1601552003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa030158660 con 0x7fa0301599f0 2024-05-12T10:50:31.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa02d600640 1 -- 172.21.15.115:0/1601552003 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028001c50 con 0x7fa0301599f0 2024-05-12T10:50:31.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa038000640 1 -- 172.21.15.115:0/1601552003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa030158380 con 0x7fa0301599f0 2024-05-12T10:50:31.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.405+0000 7fa02d600640 1 -- 172.21.15.115:0/1601552003 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa0280bf070 con 0x7fa0301599f0 2024-05-12T10:50:31.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa02d600640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa01006f430 0x7fa0100718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa02d600640 1 -- 172.21.15.115:0/1601552003 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa028128bd0 con 0x7fa0301599f0 2024-05-12T10:50:31.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa035600640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa01006f430 0x7fa0100718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 Processor -- start 2024-05-12T10:50:31.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 -- start start 2024-05-12T10:50:31.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa035600640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa01006f430 0x7fa0100718f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa024009b60 tx=0x7fa024009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:31.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996518a0 0x55da99651c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da996525a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da99652ae0 0x55da9965cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55da994f7600 con 0x55da996518a0 2024-05-12T10:50:31.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55da99412720 con 0x55da99652ae0 2024-05-12T10:50:31.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55da99460070 con 0x55da996521c0 2024-05-12T10:50:31.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa035600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996518a0 0x55da99651c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa035600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996518a0 0x55da99651c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53140/0 (socket says 172.21.15.115:53140) 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa035600640 1 -- 172.21.15.115:0/3090560459 learned_addr learned my addr 172.21.15.115:0/3090560459 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa034c00640 1 --2- 172.21.15.115:0/3090560459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da996525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa036000640 1 --2- 172.21.15.115:0/3090560459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da99652ae0 0x55da9965cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa035600640 1 -- 172.21.15.115:0/3090560459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 msgr2=0x55da996525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa035600640 1 --2- 172.21.15.115:0/3090560459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da996525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa035600640 1 -- 172.21.15.115:0/3090560459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da99652ae0 msgr2=0x55da9965cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa035600640 1 --2- 172.21.15.115:0/3090560459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da99652ae0 0x55da9965cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa035600640 1 -- 172.21.15.115:0/3090560459 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da995f4080 con 0x55da996518a0 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa035600640 1 --2- 172.21.15.115:0/3090560459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996518a0 0x55da99651c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa024009140 tx=0x7fa024017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c505ed07fc04f6e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa022000640 1 -- 172.21.15.115:0/3090560459 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02401b070 con 0x55da996518a0 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa022000640 1 -- 172.21.15.115:0/3090560459 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa024004020 con 0x55da996518a0 2024-05-12T10:50:31.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa022000640 1 -- 172.21.15.115:0/3090560459 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0240043f0 con 0x55da996518a0 2024-05-12T10:50:31.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3090560459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996518a0 msgr2=0x55da99651c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:31.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/3090560459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996518a0 0x55da99651c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa024009140 tx=0x7fa024017000 comp rx=0 tx=0).stop 2024-05-12T10:50:31.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3090560459 shutdown_connections 2024-05-12T10:50:31.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/3090560459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da99652ae0 0x55da9965cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/3090560459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da996525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/3090560459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996518a0 0x55da99651c80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3090560459 >> 172.21.15.115:0/3090560459 conn(0x55da9964d650 msgr2=0x55da9964fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:31.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3090560459 shutdown_connections 2024-05-12T10:50:31.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3090560459 wait complete. 2024-05-12T10:50:31.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.409+0000 7fa03b4f9000 1 -- start start 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 1 Processor -- start 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da996518a0 0x55da99615e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da99616350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da99652ae0 0x55da99611130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55da9945c030 con 0x55da99652ae0 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55da99418ea0 con 0x55da996518a0 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55da993ffc70 con 0x55da996521c0 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 10 client.0 _ll_register_callbacks cb 0x55da995fbe40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa036000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da99652ae0 0x55da99611130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa036000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da99652ae0 0x55da99611130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53144/0 (socket says 172.21.15.115:53144) 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa036000640 1 -- 172.21.15.115:0/1288731262 learned_addr learned my addr 172.21.15.115:0/1288731262 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa034c00640 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da99616350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa035600640 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da996518a0 0x55da99615e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa036000640 1 -- 172.21.15.115:0/1288731262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 msgr2=0x55da99616350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:31.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa036000640 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da99616350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa036000640 1 -- 172.21.15.115:0/1288731262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da996518a0 msgr2=0x55da99615e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa036000640 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da996518a0 0x55da99615e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa036000640 1 -- 172.21.15.115:0/1288731262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da9950a6d0 con 0x55da99652ae0 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa036000640 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da99652ae0 0x55da99611130 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa0280f2250 tx=0x7fa0280f5600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24a8ccd2f9c5e54 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa016a00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa016a00640 1 -- 172.21.15.115:0/1288731262 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028124060 con 0x55da99652ae0 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa016a00640 1 -- 172.21.15.115:0/1288731262 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa028005710 con 0x55da99652ae0 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 1 -- 172.21.15.115:0/1288731262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa024004020 con 0x55da99652ae0 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa016a00640 1 -- 172.21.15.115:0/1288731262 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fa028113050 con 0x55da99652ae0 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 10 client.4668 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 1 -- 172.21.15.115:0/1288731262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55da99506680 con 0x55da99652ae0 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa016a00640 1 -- 172.21.15.115:0/1288731262 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa024004020 con 0x55da99652ae0 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa016a00640 1 -- 172.21.15.115:0/1288731262 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fa0280f0950 con 0x55da99652ae0 2024-05-12T10:50:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 10 client.4668 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 10 client.4668 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-12T10:50:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 20 client.4668 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x55da99665290 0x55da99667680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 4 client.4668 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:50:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa03b4f9000 1 -- 172.21.15.115:0/1288731262 --> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da993f8bc0 con 0x55da99665290 2024-05-12T10:50:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa035600640 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x55da99665290 0x55da99667680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa016a00640 10 client.4668 ms_handle_connect on v2:172.21.15.115:6836/3194167246 2024-05-12T10:50:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:31.413+0000 7fa035600640 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x55da99665290 0x55da99667680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1df01d0b8645a82f server_cookie=3f5db31743bb8f97 in_seq=0 out_seq=0 2024-05-12T10:50:34.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.804+0000 7fa016a00640 1 -- 172.21.15.115:0/1288731262 <== mds.2 v2:172.21.15.115:6836/3194167246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55da993f8bc0 con 0x55da99665290 2024-05-12T10:50:34.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.804+0000 7fa016a00640 10 client.4668 handle_command_reply: tid=0 2024-05-12T10:50:34.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 1 client.4668 shutdown 2024-05-12T10:50:34.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 1 -- 172.21.15.115:0/1288731262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da99652ae0 msgr2=0x55da99611130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:34.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da99652ae0 0x55da99611130 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa0280f2250 tx=0x7fa0280f5600 comp rx=0 tx=0).stop 2024-05-12T10:50:34.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 1 -- 172.21.15.115:0/1288731262 shutdown_connections 2024-05-12T10:50:34.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x55da99665290 0x55da99667680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da99652ae0 0x55da99611130 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da99616350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/1288731262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da996518a0 0x55da99615e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa016a00640 0 client.4668 ms_handle_reset on v2:172.21.15.115:6836/3194167246 2024-05-12T10:50:34.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 1 -- 172.21.15.115:0/1288731262 >> 172.21.15.115:0/1288731262 conn(0x55da9964d650 msgr2=0x55da9964fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:34.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 1 -- 172.21.15.115:0/1288731262 shutdown_connections 2024-05-12T10:50:34.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 1 -- 172.21.15.115:0/1288731262 wait complete. 2024-05-12T10:50:34.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.808+0000 7fa03b4f9000 20 client.4668 trim_cache size 0 max 16384 2024-05-12T10:50:34.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa03b4f9000 1 Processor -- start 2024-05-12T10:50:34.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa03b4f9000 1 -- start start 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da9964d650 0x55da99650e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da996518a0 0x55da9964c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da9964c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa0301fea40 con 0x55da9964d650 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa0301fddd0 con 0x55da996518a0 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa0301fe3f0 con 0x55da996521c0 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa035600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da9964d650 0x55da99650e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa035600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da9964d650 0x55da99650e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60766/0 (socket says 172.21.15.115:60766) 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa035600640 1 -- 172.21.15.115:0/4059320826 learned_addr learned my addr 172.21.15.115:0/4059320826 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa034c00640 1 --2- 172.21.15.115:0/4059320826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da996518a0 0x55da9964c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa036000640 1 --2- 172.21.15.115:0/4059320826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da9964c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:34.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa035600640 1 -- 172.21.15.115:0/4059320826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 msgr2=0x55da9964c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:34.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa035600640 1 --2- 172.21.15.115:0/4059320826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da9964c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa035600640 1 -- 172.21.15.115:0/4059320826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da996518a0 msgr2=0x55da9964c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:34.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa035600640 1 --2- 172.21.15.115:0/4059320826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da996518a0 0x55da9964c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa035600640 1 -- 172.21.15.115:0/4059320826 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da99616780 con 0x55da9964d650 2024-05-12T10:50:34.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa034c00640 1 --2- 172.21.15.115:0/4059320826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da996518a0 0x55da9964c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:34.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa035600640 1 --2- 172.21.15.115:0/4059320826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da9964d650 0x55da99650e70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa024027000 tx=0x7fa02401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1290a20960f47fd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:34.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa021600640 1 -- 172.21.15.115:0/4059320826 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02401b040 con 0x55da9964d650 2024-05-12T10:50:34.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa021600640 1 -- 172.21.15.115:0/4059320826 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa024038e50 con 0x55da9964d650 2024-05-12T10:50:34.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.828+0000 7fa021600640 1 -- 172.21.15.115:0/4059320826 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02402a8c0 con 0x55da9964d650 2024-05-12T10:50:34.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 -- 172.21.15.115:0/4059320826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da9964d650 msgr2=0x55da99650e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:34.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/4059320826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da9964d650 0x55da99650e70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa024027000 tx=0x7fa02401c000 comp rx=0 tx=0).stop 2024-05-12T10:50:34.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 -- 172.21.15.115:0/4059320826 shutdown_connections 2024-05-12T10:50:34.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/4059320826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996521c0 0x55da9964c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/4059320826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da996518a0 0x55da9964c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/4059320826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da9964d650 0x55da99650e70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 -- 172.21.15.115:0/4059320826 >> 172.21.15.115:0/4059320826 conn(0x55da99610af0 msgr2=0x55da99614de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:34.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 -- 172.21.15.115:0/4059320826 shutdown_connections 2024-05-12T10:50:34.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 -- 172.21.15.115:0/4059320826 wait complete. 2024-05-12T10:50:34.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 -- start start 2024-05-12T10:50:34.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 Processor -- start 2024-05-12T10:50:34.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da9964d650 0x55da996c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:34.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996518a0 0x55da996c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:34.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996521c0 0x55da996686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:34.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55da9945c030 con 0x55da996521c0 2024-05-12T10:50:34.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55da994646a0 con 0x55da9964d650 2024-05-12T10:50:34.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55da993f57b0 con 0x55da996518a0 2024-05-12T10:50:34.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 10 client.0 _ll_register_callbacks cb 0x7fa028001810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:34.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa036000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996521c0 0x55da996686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:34.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa036000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996521c0 0x55da996686d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60770/0 (socket says 172.21.15.115:60770) 2024-05-12T10:50:34.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa036000640 1 -- 172.21.15.115:0/3239123041 learned_addr learned my addr 172.21.15.115:0/3239123041 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:34.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa035600640 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da9964d650 0x55da996c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:34.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa034c00640 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996518a0 0x55da996c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:34.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa036000640 1 -- 172.21.15.115:0/3239123041 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996518a0 msgr2=0x55da996c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa036000640 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996518a0 0x55da996c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa036000640 1 -- 172.21.15.115:0/3239123041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da9964d650 msgr2=0x55da996c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa036000640 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da9964d650 0x55da996c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa036000640 1 -- 172.21.15.115:0/3239123041 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da99439ad0 con 0x55da996521c0 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa036000640 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996521c0 0x55da996686d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0280f4ce0 tx=0x7fa0280f8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2dd0ba4d0de97f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa016a00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa016a00640 1 -- 172.21.15.115:0/3239123041 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0280f4930 con 0x55da996521c0 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa016a00640 1 -- 172.21.15.115:0/3239123041 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa02811dde0 con 0x55da996521c0 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.832+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3239123041 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa024038e50 con 0x55da996521c0 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa016a00640 1 -- 172.21.15.115:0/3239123041 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fa028124020 con 0x55da996521c0 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 10 client.4674 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3239123041 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55da99438e20 con 0x55da996521c0 2024-05-12T10:50:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa016a00640 1 -- 172.21.15.115:0/3239123041 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa024038e50 con 0x55da996521c0 2024-05-12T10:50:34.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa016a00640 1 -- 172.21.15.115:0/3239123041 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fa028104030 con 0x55da996521c0 2024-05-12T10:50:34.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 10 client.4674 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:34.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 10 client.4674 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-12T10:50:34.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 20 client.4674 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:34.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x55da99652ae0 0x55da99668fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:34.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 4 client.4674 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T10:50:34.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3239123041 --> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] -- command(tid 0: {"prefix": "status"}) -- 0x55da9946dc80 con 0x55da99652ae0 2024-05-12T10:50:34.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa035600640 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x55da99652ae0 0x55da99668fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:34.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa035600640 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x55da99652ae0 0x55da99668fd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=88ebdf8247907991 server_cookie=d125f997e3b654f6 in_seq=0 out_seq=0 2024-05-12T10:50:34.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa016a00640 10 client.4674 ms_handle_connect on v2:172.21.15.115:6836/3194167246 2024-05-12T10:50:34.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa016a00640 1 -- 172.21.15.115:0/3239123041 <== mds.2 v2:172.21.15.115:6836/3194167246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55da9946dc80 con 0x55da99652ae0 2024-05-12T10:50:34.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa016a00640 10 client.4674 handle_command_reply: tid=0 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 client.4674 shutdown 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3239123041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996521c0 msgr2=0x55da996686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996521c0 0x55da996686d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0280f4ce0 tx=0x7fa0280f8000 comp rx=0 tx=0).stop 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3239123041 shutdown_connections 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x55da99652ae0 0x55da99668fd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55da996521c0 0x55da996686d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55da996518a0 0x55da996c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 --2- 172.21.15.115:0/3239123041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da9964d650 0x55da996c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa016a00640 0 client.4674 ms_handle_reset on v2:172.21.15.115:6836/3194167246 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3239123041 >> 172.21.15.115:0/3239123041 conn(0x55da99610af0 msgr2=0x55da99614de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3239123041 shutdown_connections 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 1 -- 172.21.15.115:0/3239123041 wait complete. 2024-05-12T10:50:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa03b4f9000 20 client.4674 trim_cache size 0 max 16384 2024-05-12T10:50:34.838 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:50:34.838 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "afd333ea-2e10-495a-8d22-6858d0930293", 2024-05-12T10:50:34.838 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 2, 2024-05-12T10:50:34.838 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 4260, 2024-05-12T10:50:34.838 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2024-05-12T10:50:34.838 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2024-05-12T10:50:34.838 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2024-05-12T10:50:34.838 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 10.063685139, 2024-05-12T10:50:34.838 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 14, 2024-05-12T10:50:34.838 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 26, 2024-05-12T10:50:34.839 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 26, 2024-05-12T10:50:34.839 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 45.286085278000002 2024-05-12T10:50:34.839 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:50:34.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 -- 172.21.15.115:0/1601552003 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa01006f430 msgr2=0x7fa0100718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:34.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa01006f430 0x7fa0100718f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa024009b60 tx=0x7fa024009190 comp rx=0 tx=0).stop 2024-05-12T10:50:34.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 -- 172.21.15.115:0/1601552003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0301599f0 msgr2=0x7fa0300cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0301599f0 0x7fa0300cd5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa02801b020 tx=0x7fa018005840 comp rx=0 tx=0).stop 2024-05-12T10:50:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 -- 172.21.15.115:0/1601552003 shutdown_connections 2024-05-12T10:50:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fa01006f430 0x7fa0100718f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0301599f0 0x7fa0300cd5a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa030156cb0 0x7fa0301e2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 --2- 172.21.15.115:0/1601552003 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa018005220 0x7fa0301e4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 -- 172.21.15.115:0/1601552003 >> 172.21.15.115:0/1601552003 conn(0x7fa030076830 msgr2=0x7fa0301e37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 -- 172.21.15.115:0/1601552003 shutdown_connections 2024-05-12T10:50:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:34.836+0000 7fa038000640 1 -- 172.21.15.115:0/1601552003 wait complete. 2024-05-12T10:50:34.858 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-12T10:50:34.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.000+0000 7f4f56400640 1 Processor -- start 2024-05-12T10:50:35.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f56400640 1 -- start start 2024-05-12T10:50:35.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f56400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4f50155e00 0x7f4f500cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f56400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f501561e0 0x7f4f5006c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f56400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f500687e0 con 0x7f4f500cc370 2024-05-12T10:50:35.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f56400640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f4f500cbeb0 con 0x7f4f501561e0 2024-05-12T10:50:35.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f56400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f4f500cc950 con 0x7f4f50155e00 2024-05-12T10:50:35.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f46a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f501561e0 0x7f4f5006c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f46a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f501561e0 0x7f4f5006c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60778/0 (socket says 172.21.15.115:60778) 2024-05-12T10:50:35.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f46a00640 1 -- 172.21.15.115:0/3380273411 learned_addr learned my addr 172.21.15.115:0/3380273411 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f4f400640 1 --2- 172.21.15.115:0/3380273411 >> v2:172.21.15.134:3300/0 conn(0x7f4f50155e00 0x7f4f500cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f46a00640 1 -- 172.21.15.115:0/3380273411 >> v2:172.21.15.134:3300/0 conn(0x7f4f50155e00 msgr2=0x7f4f500cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f46a00640 1 --2- 172.21.15.115:0/3380273411 >> v2:172.21.15.134:3300/0 conn(0x7f4f50155e00 0x7f4f500cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f46a00640 1 -- 172.21.15.115:0/3380273411 >> v1:172.21.15.134:6789/0 conn(0x7f4f500cc370 legacy=0x7f4f5015f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.004+0000 7f4f46a00640 1 -- 172.21.15.115:0/3380273411 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f500ccc10 con 0x7f4f501561e0 2024-05-12T10:50:35.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f46a00640 1 --2- 172.21.15.115:0/3380273411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f501561e0 0x7f4f5006c440 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4f5006d030 tx=0x7f4f3801eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18baaed82d6faf1a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f4ea00640 1 -- 172.21.15.115:0/3380273411 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f380b5070 con 0x7f4f501561e0 2024-05-12T10:50:35.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f4ea00640 1 -- 172.21.15.115:0/3380273411 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f380a87f0 con 0x7f4f501561e0 2024-05-12T10:50:35.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f4ea00640 1 -- 172.21.15.115:0/3380273411 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f380a8bc0 con 0x7f4f501561e0 2024-05-12T10:50:35.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f56400640 1 -- 172.21.15.115:0/3380273411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f501561e0 msgr2=0x7f4f5006c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f56400640 1 --2- 172.21.15.115:0/3380273411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f501561e0 0x7f4f5006c440 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4f5006d030 tx=0x7f4f3801eb30 comp rx=0 tx=0).stop 2024-05-12T10:50:35.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f56400640 1 -- 172.21.15.115:0/3380273411 shutdown_connections 2024-05-12T10:50:35.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f56400640 1 --2- 172.21.15.115:0/3380273411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f501561e0 0x7f4f5006c440 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f56400640 1 --2- 172.21.15.115:0/3380273411 >> v2:172.21.15.134:3300/0 conn(0x7f4f50155e00 0x7f4f500cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f56400640 1 -- 172.21.15.115:0/3380273411 >> 172.21.15.115:0/3380273411 conn(0x7f4f500cdb70 msgr2=0x7f4f500cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f56400640 1 -- 172.21.15.115:0/3380273411 shutdown_connections 2024-05-12T10:50:35.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.008+0000 7f4f56400640 1 -- 172.21.15.115:0/3380273411 wait complete. 2024-05-12T10:50:35.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f56400640 1 Processor -- start 2024-05-12T10:50:35.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f56400640 1 -- start start 2024-05-12T10:50:35.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f56400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500cc370 0x7f4f501f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f56400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50155e00 0x7f4f50159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f56400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f501561e0 0x7f4f501577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f56400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4f500cd4b0 con 0x7f4f500cc370 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f56400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f500cd1d0 con 0x7f4f50155e00 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f56400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4f500cd790 con 0x7f4f501561e0 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f4f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500cc370 0x7f4f501f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f4f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500cc370 0x7f4f501f2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60790/0 (socket says 172.21.15.115:60790) 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f4f400640 1 -- 172.21.15.115:0/3203786071 learned_addr learned my addr 172.21.15.115:0/3203786071 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f46a00640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50155e00 0x7f4f50159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f4fe00640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f501561e0 0x7f4f501577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f4f400640 1 -- 172.21.15.115:0/3203786071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f501561e0 msgr2=0x7f4f501577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f4f400640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f501561e0 0x7f4f501577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f4f400640 1 -- 172.21.15.115:0/3203786071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50155e00 msgr2=0x7f4f50159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f4f400640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50155e00 0x7f4f50159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f4f400640 1 -- 172.21.15.115:0/3203786071 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f50156810 con 0x7f4f500cc370 2024-05-12T10:50:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f4fe00640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f501561e0 0x7f4f501577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:35.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f4f400640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500cc370 0x7f4f501f2630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000d830 tx=0x7f4f4000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f47e00640 1 -- 172.21.15.115:0/3203786071 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4000b6c0 con 0x7f4f500cc370 2024-05-12T10:50:35.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f47e00640 1 -- 172.21.15.115:0/3203786071 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f40019070 con 0x7f4f500cc370 2024-05-12T10:50:35.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f56400640 1 -- 172.21.15.115:0/3203786071 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f50156af0 con 0x7f4f500cc370 2024-05-12T10:50:35.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f47e00640 1 -- 172.21.15.115:0/3203786071 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4000ba60 con 0x7f4f500cc370 2024-05-12T10:50:35.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.012+0000 7f4f56400640 1 -- 172.21.15.115:0/3203786071 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f50158970 con 0x7f4f500cc370 2024-05-12T10:50:35.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f47e00640 1 -- 172.21.15.115:0/3203786071 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4f4001e460 con 0x7f4f500cc370 2024-05-12T10:50:35.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f47e00640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4f2c06f430 0x7f4f2c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f59984000 1 Processor -- start 2024-05-12T10:50:35.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f47e00640 1 -- 172.21.15.115:0/3203786071 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4f4008fbf0 con 0x7f4f500cc370 2024-05-12T10:50:35.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f46a00640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4f2c06f430 0x7f4f2c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f59984000 1 -- start start 2024-05-12T10:50:35.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f46a00640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4f2c06f430 0x7f4f2c0718f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f380b2000 tx=0x7f4f380aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f59984000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966bd8a0 0x5621966bdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f59984000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x5621966be5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f59984000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966beae0 0x5621966c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f59984000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562196563600 con 0x5621966be1c0 2024-05-12T10:50:35.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f59984000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56219647e720 con 0x5621966beae0 2024-05-12T10:50:35.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f59984000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5621964cc070 con 0x5621966bd8a0 2024-05-12T10:50:35.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f46a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x5621966be5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f46a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x5621966be5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60806/0 (socket says 172.21.15.115:60806) 2024-05-12T10:50:35.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f46a00640 1 -- 172.21.15.115:0/1449466368 learned_addr learned my addr 172.21.15.115:0/1449466368 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f4f400640 1 --2- 172.21.15.115:0/1449466368 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966bd8a0 0x5621966bdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f4fe00640 1 --2- 172.21.15.115:0/1449466368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966beae0 0x5621966c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f46a00640 1 -- 172.21.15.115:0/1449466368 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966bd8a0 msgr2=0x5621966bdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f46a00640 1 --2- 172.21.15.115:0/1449466368 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966bd8a0 0x5621966bdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f46a00640 1 -- 172.21.15.115:0/1449466368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966beae0 msgr2=0x5621966c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f46a00640 1 --2- 172.21.15.115:0/1449466368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966beae0 0x5621966c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f46a00640 1 -- 172.21.15.115:0/1449466368 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562196660080 con 0x5621966be1c0 2024-05-12T10:50:35.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.016+0000 7f4f4fe00640 1 --2- 172.21.15.115:0/1449466368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966beae0 0x5621966c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:35.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f46a00640 1 --2- 172.21.15.115:0/1449466368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x5621966be5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4f3801d1e0 tx=0x7f4f38004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fca7d554eac6412 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f3fe00640 1 -- 172.21.15.115:0/1449466368 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f380cc070 con 0x5621966be1c0 2024-05-12T10:50:35.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f3fe00640 1 -- 172.21.15.115:0/1449466368 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f380c7470 con 0x5621966be1c0 2024-05-12T10:50:35.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f3fe00640 1 -- 172.21.15.115:0/1449466368 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f380b5040 con 0x5621966be1c0 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 -- 172.21.15.115:0/1449466368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 msgr2=0x5621966be5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 --2- 172.21.15.115:0/1449466368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x5621966be5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4f3801d1e0 tx=0x7f4f38004740 comp rx=0 tx=0).stop 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 -- 172.21.15.115:0/1449466368 shutdown_connections 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 --2- 172.21.15.115:0/1449466368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966beae0 0x5621966c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 --2- 172.21.15.115:0/1449466368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x5621966be5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 --2- 172.21.15.115:0/1449466368 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966bd8a0 0x5621966bdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 -- 172.21.15.115:0/1449466368 >> 172.21.15.115:0/1449466368 conn(0x5621966b9650 msgr2=0x5621966bba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 -- 172.21.15.115:0/1449466368 shutdown_connections 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 -- 172.21.15.115:0/1449466368 wait complete. 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 -- start start 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 Processor -- start 2024-05-12T10:50:35.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966bd8a0 0x562196681de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x562196682320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966beae0 0x56219667d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5621964c8030 con 0x5621966be1c0 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562196484ea0 con 0x5621966beae0 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x56219646bc70 con 0x5621966bd8a0 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f59984000 10 client.0 _ll_register_callbacks cb 0x562196667e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f46a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x562196682320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f46a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x562196682320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60812/0 (socket says 172.21.15.115:60812) 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f46a00640 1 -- 172.21.15.115:0/1485728100 learned_addr learned my addr 172.21.15.115:0/1485728100 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f4f400640 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966bd8a0 0x562196681de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f4fe00640 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966beae0 0x56219667d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f46a00640 1 -- 172.21.15.115:0/1485728100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966bd8a0 msgr2=0x562196681de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f46a00640 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966bd8a0 0x562196681de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f46a00640 1 -- 172.21.15.115:0/1485728100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966beae0 msgr2=0x56219667d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f46a00640 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966beae0 0x56219667d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.020+0000 7f4f46a00640 1 -- 172.21.15.115:0/1485728100 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621965766d0 con 0x5621966be1c0 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f46a00640 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x562196682320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f3801d1e0 tx=0x7f4f3801d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf4dbfce15b730e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f3cc00640 1 -- 172.21.15.115:0/1485728100 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f380cc070 con 0x5621966be1c0 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 -- 172.21.15.115:0/1485728100 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f380c7470 con 0x5621966be1c0 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f3cc00640 1 -- 172.21.15.115:0/1485728100 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4f380c7b90 con 0x5621966be1c0 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f3cc00640 1 -- 172.21.15.115:0/1485728100 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f4f380b5040 con 0x5621966be1c0 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 10 client.4686 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 -- 172.21.15.115:0/1485728100 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562196572680 con 0x5621966be1c0 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f3cc00640 1 -- 172.21.15.115:0/1485728100 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f380c7470 con 0x5621966be1c0 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f3cc00640 1 -- 172.21.15.115:0/1485728100 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f4f380bd6f0 con 0x5621966be1c0 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 10 client.4686 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:35.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 10 client.4686 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-12T10:50:35.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 20 client.4686 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:35.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5621966d1290 0x5621966d3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 4 client.4686 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:50:35.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 -- 172.21.15.115:0/1485728100 --> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562196464bc0 con 0x5621966d1290 2024-05-12T10:50:35.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f4f400640 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5621966d1290 0x5621966d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f4f400640 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5621966d1290 0x5621966d3680 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d569a59ac04b9b34 server_cookie=8faf445e38a83c19 in_seq=0 out_seq=0 2024-05-12T10:50:35.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f3cc00640 10 client.4686 ms_handle_connect on v2:172.21.15.115:6835/4177777929 2024-05-12T10:50:35.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f3cc00640 1 -- 172.21.15.115:0/1485728100 <== mds.1 v2:172.21.15.115:6835/4177777929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562196464bc0 con 0x5621966d1290 2024-05-12T10:50:35.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f3cc00640 10 client.4686 handle_command_reply: tid=0 2024-05-12T10:50:35.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 client.4686 shutdown 2024-05-12T10:50:35.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 -- 172.21.15.115:0/1485728100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 msgr2=0x562196682320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x562196682320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f3801d1e0 tx=0x7f4f3801d370 comp rx=0 tx=0).stop 2024-05-12T10:50:35.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 -- 172.21.15.115:0/1485728100 shutdown_connections 2024-05-12T10:50:35.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5621966d1290 0x5621966d3680 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966beae0 0x56219667d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966be1c0 0x562196682320 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f3cc00640 0 client.4686 ms_handle_reset on v2:172.21.15.115:6835/4177777929 2024-05-12T10:50:35.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 --2- 172.21.15.115:0/1485728100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966bd8a0 0x562196681de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 -- 172.21.15.115:0/1485728100 >> 172.21.15.115:0/1485728100 conn(0x5621966b9650 msgr2=0x5621966bba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 -- 172.21.15.115:0/1485728100 shutdown_connections 2024-05-12T10:50:35.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 1 -- 172.21.15.115:0/1485728100 wait complete. 2024-05-12T10:50:35.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.024+0000 7f4f59984000 20 client.4686 trim_cache size 0 max 16384 2024-05-12T10:50:35.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 Processor -- start 2024-05-12T10:50:35.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 -- start start 2024-05-12T10:50:35.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966b9650 0x5621966bce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966bd8a0 0x5621966b8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966be1c0 0x5621966b8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4f501f5b50 con 0x5621966bd8a0 2024-05-12T10:50:35.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f501fe010 con 0x5621966be1c0 2024-05-12T10:50:35.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5621964cb380 con 0x5621966b9650 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f46a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966bd8a0 0x5621966b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f46a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966bd8a0 0x5621966b8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60828/0 (socket says 172.21.15.115:60828) 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f46a00640 1 -- 172.21.15.115:0/297772931 learned_addr learned my addr 172.21.15.115:0/297772931 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f4fe00640 1 --2- 172.21.15.115:0/297772931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966be1c0 0x5621966b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f4f400640 1 --2- 172.21.15.115:0/297772931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966b9650 0x5621966bce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f46a00640 1 -- 172.21.15.115:0/297772931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966b9650 msgr2=0x5621966bce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f46a00640 1 --2- 172.21.15.115:0/297772931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966b9650 0x5621966bce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f46a00640 1 -- 172.21.15.115:0/297772931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966be1c0 msgr2=0x5621966b8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f46a00640 1 --2- 172.21.15.115:0/297772931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966be1c0 0x5621966b8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f46a00640 1 -- 172.21.15.115:0/297772931 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621964a5ad0 con 0x5621966bd8a0 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f46a00640 1 --2- 172.21.15.115:0/297772931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966bd8a0 0x5621966b8450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f3801eb70 tx=0x7f4f3800b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abf81fd7ae10b56 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f3f400640 1 -- 172.21.15.115:0/297772931 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3801ce20 con 0x5621966bd8a0 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f3f400640 1 -- 172.21.15.115:0/297772931 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f380bdbf0 con 0x5621966bd8a0 2024-05-12T10:50:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f3f400640 1 -- 172.21.15.115:0/297772931 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f380c7c10 con 0x5621966bd8a0 2024-05-12T10:50:35.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 -- 172.21.15.115:0/297772931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966bd8a0 msgr2=0x5621966b8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 --2- 172.21.15.115:0/297772931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966bd8a0 0x5621966b8450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f3801eb70 tx=0x7f4f3800b050 comp rx=0 tx=0).stop 2024-05-12T10:50:35.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 -- 172.21.15.115:0/297772931 shutdown_connections 2024-05-12T10:50:35.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 --2- 172.21.15.115:0/297772931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966be1c0 0x5621966b8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 --2- 172.21.15.115:0/297772931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966bd8a0 0x5621966b8450 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 --2- 172.21.15.115:0/297772931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966b9650 0x5621966bce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 -- 172.21.15.115:0/297772931 >> 172.21.15.115:0/297772931 conn(0x56219667cac0 msgr2=0x562196680db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 -- 172.21.15.115:0/297772931 shutdown_connections 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.044+0000 7f4f59984000 1 -- 172.21.15.115:0/297772931 wait complete. 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 -- start start 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 Processor -- start 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966b9650 0x562196732d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966bd8a0 0x562196733260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966be1c0 0x5621966d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5621964a2380 con 0x5621966b9650 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5621964c8030 con 0x5621966bd8a0 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562196586d60 con 0x5621966be1c0 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 10 client.0 _ll_register_callbacks cb 0x7f4f380ca070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f4f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966b9650 0x562196732d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f4f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966b9650 0x562196732d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60844/0 (socket says 172.21.15.115:60844) 2024-05-12T10:50:35.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f4f400640 1 -- 172.21.15.115:0/346084820 learned_addr learned my addr 172.21.15.115:0/346084820 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f46a00640 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966bd8a0 0x562196733260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f4fe00640 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966be1c0 0x5621966d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f4f400640 1 -- 172.21.15.115:0/346084820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966be1c0 msgr2=0x5621966d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f4f400640 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966be1c0 0x5621966d46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f4f400640 1 -- 172.21.15.115:0/346084820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966bd8a0 msgr2=0x562196733260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f4f400640 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966bd8a0 0x562196733260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f4f400640 1 -- 172.21.15.115:0/346084820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621964a4e20 con 0x5621966b9650 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f46a00640 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966bd8a0 0x562196733260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f4f400640 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966b9650 0x562196732d20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000d800 tx=0x7f4f4005bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e2ef45a20b24a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f3cc00640 1 -- 172.21.15.115:0/346084820 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f400602b0 con 0x5621966b9650 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f3cc00640 1 -- 172.21.15.115:0/346084820 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4f4005b380 con 0x5621966b9650 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 -- 172.21.15.115:0/346084820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f380bdbf0 con 0x5621966b9650 2024-05-12T10:50:35.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f3cc00640 1 -- 172.21.15.115:0/346084820 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f4f400604d0 con 0x5621966b9650 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 10 client.4692 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 -- 172.21.15.115:0/346084820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56219654c4c0 con 0x5621966b9650 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f3cc00640 1 -- 172.21.15.115:0/346084820 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f380bdbf0 con 0x5621966b9650 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f3cc00640 1 -- 172.21.15.115:0/346084820 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f4f40013070 con 0x5621966b9650 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 10 client.4692 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 10 client.4692 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 20 client.4692 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5621966beae0 0x5621966d5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 4 client.4692 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 -- 172.21.15.115:0/346084820 --> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] -- command(tid 0: {"prefix": "status"}) -- 0x5621964d9c80 con 0x5621966beae0 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f46a00640 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5621966beae0 0x5621966d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f46a00640 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5621966beae0 0x5621966d5440 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd9d5a10d4ccaf server_cookie=6bc69a87487d76d1 in_seq=0 out_seq=0 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f3cc00640 10 client.4692 ms_handle_connect on v2:172.21.15.115:6835/4177777929 2024-05-12T10:50:35.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f3cc00640 1 -- 172.21.15.115:0/346084820 <== mds.1 v2:172.21.15.115:6835/4177777929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5621964d9c80 con 0x5621966beae0 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f3cc00640 10 client.4692 handle_command_reply: tid=0 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.048+0000 7f4f59984000 1 client.4692 shutdown 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f59984000 1 -- 172.21.15.115:0/346084820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966b9650 msgr2=0x562196732d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f59984000 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966b9650 0x562196732d20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000d800 tx=0x7f4f4005bd60 comp rx=0 tx=0).stop 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f59984000 1 -- 172.21.15.115:0/346084820 shutdown_connections 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f59984000 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5621966beae0 0x5621966d5440 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f59984000 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621966be1c0 0x5621966d46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f59984000 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621966bd8a0 0x562196733260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f3cc00640 0 client.4692 ms_handle_reset on v2:172.21.15.115:6835/4177777929 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f59984000 1 --2- 172.21.15.115:0/346084820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5621966b9650 0x562196732d20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f59984000 1 -- 172.21.15.115:0/346084820 >> 172.21.15.115:0/346084820 conn(0x56219667cac0 msgr2=0x562196680db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f59984000 1 -- 172.21.15.115:0/346084820 shutdown_connections 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f59984000 1 -- 172.21.15.115:0/346084820 wait complete. 2024-05-12T10:50:35.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f59984000 20 client.4692 trim_cache size 0 max 16384 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "afd333ea-2e10-495a-8d22-6858d0930293", 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 1, 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 4309, 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 16.325427859000001, 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 14, 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 26, 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 26, 2024-05-12T10:50:35.055 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 45.501923638999997 2024-05-12T10:50:35.056 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:50:35.056 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 -- 172.21.15.115:0/3203786071 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4f2c06f430 msgr2=0x7f4f2c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.056 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4f2c06f430 0x7f4f2c0718f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f380b2000 tx=0x7f4f380aa070 comp rx=0 tx=0).stop 2024-05-12T10:50:35.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 -- 172.21.15.115:0/3203786071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500cc370 msgr2=0x7f4f501f2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500cc370 0x7f4f501f2630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000d830 tx=0x7f4f4000dcf0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 -- 172.21.15.115:0/3203786071 shutdown_connections 2024-05-12T10:50:35.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4f2c06f430 0x7f4f2c0718f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f501561e0 0x7f4f501577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f50155e00 0x7f4f50159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 --2- 172.21.15.115:0/3203786071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500cc370 0x7f4f501f2630 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 -- 172.21.15.115:0/3203786071 >> 172.21.15.115:0/3203786071 conn(0x7f4f500cdb70 msgr2=0x7f4f500c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 -- 172.21.15.115:0/3203786071 shutdown_connections 2024-05-12T10:50:35.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.052+0000 7f4f56400640 1 -- 172.21.15.115:0/3203786071 wait complete. 2024-05-12T10:50:35.067 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-12T10:50:35.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.204+0000 7f86eae00640 1 Processor -- start 2024-05-12T10:50:35.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86eae00640 1 -- start start 2024-05-12T10:50:35.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86eae00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86e40cf7c0 0x7f86e40ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86eae00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40cfba0 0x7f86e406c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86eae00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f86e40717d0 0x7f86e4158f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86eae00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f86e406cbc0 con 0x7f86e40717d0 2024-05-12T10:50:35.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86eae00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f86e40b2290 con 0x7f86e40cf7c0 2024-05-12T10:50:35.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86eae00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f86e415c880 con 0x7f86e40cfba0 2024-05-12T10:50:35.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86ea400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f86e40717d0 0x7f86e4158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86ea400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f86e40717d0 0x7f86e4158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60848/0 (socket says 172.21.15.115:60848) 2024-05-12T10:50:35.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86ea400640 1 -- 172.21.15.115:0/3069667788 learned_addr learned my addr 172.21.15.115:0/3069667788 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86e9a00640 1 --2- 172.21.15.115:0/3069667788 >> v2:172.21.15.134:3300/0 conn(0x7f86e40cf7c0 0x7f86e40ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86e9000640 1 --2- 172.21.15.115:0/3069667788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40cfba0 0x7f86e406c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86ea400640 1 -- 172.21.15.115:0/3069667788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40cfba0 msgr2=0x7f86e406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86ea400640 1 --2- 172.21.15.115:0/3069667788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40cfba0 0x7f86e406c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86ea400640 1 -- 172.21.15.115:0/3069667788 >> v2:172.21.15.134:3300/0 conn(0x7f86e40cf7c0 msgr2=0x7f86e40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86ea400640 1 --2- 172.21.15.115:0/3069667788 >> v2:172.21.15.134:3300/0 conn(0x7f86e40cf7c0 0x7f86e40ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86ea400640 1 -- 172.21.15.115:0/3069667788 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e415cb60 con 0x7f86e40717d0 2024-05-12T10:50:35.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.208+0000 7f86e9a00640 1 --2- 172.21.15.115:0/3069667788 >> v2:172.21.15.134:3300/0 conn(0x7f86e40cf7c0 0x7f86e40ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86ea400640 1 --2- 172.21.15.115:0/3069667788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86e40717d0 0x7f86e4158f10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f86e406e620 tx=0x7f86dc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2799d70b2bac7de server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86e3e00640 1 -- 172.21.15.115:0/3069667788 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0b5070 con 0x7f86e40717d0 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86e3e00640 1 -- 172.21.15.115:0/3069667788 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc0a89d0 con 0x7f86e40717d0 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86e3e00640 1 -- 172.21.15.115:0/3069667788 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0a8da0 con 0x7f86e40717d0 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86eae00640 1 -- 172.21.15.115:0/3069667788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86e40717d0 msgr2=0x7f86e4158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86eae00640 1 --2- 172.21.15.115:0/3069667788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86e40717d0 0x7f86e4158f10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f86e406e620 tx=0x7f86dc01ed10 comp rx=0 tx=0).stop 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86eae00640 1 -- 172.21.15.115:0/3069667788 shutdown_connections 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86eae00640 1 --2- 172.21.15.115:0/3069667788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86e40717d0 0x7f86e4158f10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86eae00640 1 --2- 172.21.15.115:0/3069667788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40cfba0 0x7f86e406c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86eae00640 1 --2- 172.21.15.115:0/3069667788 >> v2:172.21.15.134:3300/0 conn(0x7f86e40cf7c0 0x7f86e40ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86eae00640 1 -- 172.21.15.115:0/3069667788 >> 172.21.15.115:0/3069667788 conn(0x7f86e4076830 msgr2=0x7f86e40681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86eae00640 1 -- 172.21.15.115:0/3069667788 shutdown_connections 2024-05-12T10:50:35.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86eae00640 1 -- 172.21.15.115:0/3069667788 wait complete. 2024-05-12T10:50:35.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86eae00640 1 Processor -- start 2024-05-12T10:50:35.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.212+0000 7f86eae00640 1 -- start start 2024-05-12T10:50:35.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86eae00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40717d0 0x7f86e41f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86eae00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86e40cf7c0 0x7f86e41e20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86eae00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86e40cfba0 0x7f86e40b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86eae00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f86e40b1f50 con 0x7f86e40cf7c0 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86eae00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4070ef0 con 0x7f86e40cfba0 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86eae00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f86e40712a0 con 0x7f86e40717d0 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e9000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86e40cf7c0 0x7f86e41e20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e9000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86e40cf7c0 0x7f86e41e20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60852/0 (socket says 172.21.15.115:60852) 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e9000640 1 -- 172.21.15.115:0/2015654738 learned_addr learned my addr 172.21.15.115:0/2015654738 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86ea400640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86e40cfba0 0x7f86e40b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e9a00640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40717d0 0x7f86e41f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e9000640 1 -- 172.21.15.115:0/2015654738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40717d0 msgr2=0x7f86e41f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e9000640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40717d0 0x7f86e41f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e9000640 1 -- 172.21.15.115:0/2015654738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86e40cfba0 msgr2=0x7f86e40b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e9000640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86e40cfba0 0x7f86e40b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e9000640 1 -- 172.21.15.115:0/2015654738 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e40afb20 con 0x7f86e40cf7c0 2024-05-12T10:50:35.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e9000640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86e40cf7c0 0x7f86e41e20e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f86d000d830 tx=0x7f86d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e1600640 1 -- 172.21.15.115:0/2015654738 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d000b6c0 con 0x7f86e40cf7c0 2024-05-12T10:50:35.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e1600640 1 -- 172.21.15.115:0/2015654738 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d0019070 con 0x7f86e40cf7c0 2024-05-12T10:50:35.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86eae00640 1 -- 172.21.15.115:0/2015654738 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e40afe00 con 0x7f86e40cf7c0 2024-05-12T10:50:35.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86e1600640 1 -- 172.21.15.115:0/2015654738 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d000ba60 con 0x7f86e40cf7c0 2024-05-12T10:50:35.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.216+0000 7f86eae00640 1 -- 172.21.15.115:0/2015654738 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e41e7af0 con 0x7f86e40cf7c0 2024-05-12T10:50:35.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86e1600640 1 -- 172.21.15.115:0/2015654738 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f86d001e460 con 0x7f86e40cf7c0 2024-05-12T10:50:35.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86e1600640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f86c406f400 0x7f86c40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86e1600640 1 -- 172.21.15.115:0/2015654738 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f86d008fd80 con 0x7f86e40cf7c0 2024-05-12T10:50:35.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86e9a00640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f86c406f400 0x7f86c40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ef803000 1 Processor -- start 2024-05-12T10:50:35.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ef803000 1 -- start start 2024-05-12T10:50:35.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86e9a00640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f86c406f400 0x7f86c40718c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009a00 tx=0x7f86d80039a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ef803000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b0758a0 0x56103b075c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ef803000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0761c0 0x56103b0765a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ef803000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b076ae0 0x56103b080b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ef803000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56103af1b600 con 0x56103b076ae0 2024-05-12T10:50:35.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ef803000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56103ae36720 con 0x56103b0761c0 2024-05-12T10:50:35.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ef803000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x56103ae84070 con 0x56103b0758a0 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ea400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b076ae0 0x56103b080b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ea400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b076ae0 0x56103b080b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60862/0 (socket says 172.21.15.115:60862) 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ea400640 1 -- 172.21.15.115:0/4144599999 learned_addr learned my addr 172.21.15.115:0/4144599999 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86e9000640 1 --2- 172.21.15.115:0/4144599999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0761c0 0x56103b0765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86e9a00640 1 --2- 172.21.15.115:0/4144599999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b0758a0 0x56103b075c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ea400640 1 -- 172.21.15.115:0/4144599999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b0758a0 msgr2=0x56103b075c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ea400640 1 --2- 172.21.15.115:0/4144599999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b0758a0 0x56103b075c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ea400640 1 -- 172.21.15.115:0/4144599999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0761c0 msgr2=0x56103b0765a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ea400640 1 --2- 172.21.15.115:0/4144599999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0761c0 0x56103b0765a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ea400640 1 -- 172.21.15.115:0/4144599999 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56103b018080 con 0x56103b076ae0 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86ea400640 1 --2- 172.21.15.115:0/4144599999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b076ae0 0x56103b080b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0b3040 tx=0x7f86dc0aa070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8084e60728226265 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86d6000640 1 -- 172.21.15.115:0/4144599999 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0c0070 con 0x56103b076ae0 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86d6000640 1 -- 172.21.15.115:0/4144599999 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc0a8b90 con 0x56103b076ae0 2024-05-12T10:50:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.220+0000 7f86d6000640 1 -- 172.21.15.115:0/4144599999 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0b5040 con 0x56103b076ae0 2024-05-12T10:50:35.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 -- 172.21.15.115:0/4144599999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b076ae0 msgr2=0x56103b080b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 --2- 172.21.15.115:0/4144599999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b076ae0 0x56103b080b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0b3040 tx=0x7f86dc0aa070 comp rx=0 tx=0).stop 2024-05-12T10:50:35.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 -- 172.21.15.115:0/4144599999 shutdown_connections 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 --2- 172.21.15.115:0/4144599999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b076ae0 0x56103b080b30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 --2- 172.21.15.115:0/4144599999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0761c0 0x56103b0765a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 --2- 172.21.15.115:0/4144599999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b0758a0 0x56103b075c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 -- 172.21.15.115:0/4144599999 >> 172.21.15.115:0/4144599999 conn(0x56103b071650 msgr2=0x56103b073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 -- 172.21.15.115:0/4144599999 shutdown_connections 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 -- 172.21.15.115:0/4144599999 wait complete. 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 -- start start 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 Processor -- start 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0758a0 0x56103b039de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0761c0 0x56103b03a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b076ae0 0x56103b035100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56103ae80030 con 0x56103b0761c0 2024-05-12T10:50:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56103ae3cea0 con 0x56103b0758a0 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x56103ae23c70 con 0x56103b076ae0 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 10 client.0 _ll_register_callbacks cb 0x56103b01fe40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86e9000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0761c0 0x56103b03a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86e9000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0761c0 0x56103b03a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60866/0 (socket says 172.21.15.115:60866) 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86e9000640 1 -- 172.21.15.115:0/1270253991 learned_addr learned my addr 172.21.15.115:0/1270253991 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86e9a00640 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0758a0 0x56103b039de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ea400640 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b076ae0 0x56103b035100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86e9000640 1 -- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b076ae0 msgr2=0x56103b035100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86e9000640 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b076ae0 0x56103b035100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86e9000640 1 -- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0758a0 msgr2=0x56103b039de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86e9000640 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0758a0 0x56103b039de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86e9000640 1 -- 172.21.15.115:0/1270253991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56103af2e6d0 con 0x56103b0761c0 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86e9000640 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0761c0 0x56103b03a320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f86d000d800 tx=0x7f86d00586d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c611f0d7ef718219 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86caa00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86caa00640 1 -- 172.21.15.115:0/1270253991 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0075030 con 0x56103b0761c0 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86caa00640 1 -- 172.21.15.115:0/1270253991 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f86d005b5f0 con 0x56103b0761c0 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 -- 172.21.15.115:0/1270253991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86dc0a8b90 con 0x56103b0761c0 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86caa00640 1 -- 172.21.15.115:0/1270253991 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f86d0060540 con 0x56103b0761c0 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 10 client.4704 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 1 -- 172.21.15.115:0/1270253991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56103af2a680 con 0x56103b0761c0 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86caa00640 1 -- 172.21.15.115:0/1270253991 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc0a8b90 con 0x56103b0761c0 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86caa00640 1 -- 172.21.15.115:0/1270253991 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f86d0013070 con 0x56103b0761c0 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 10 client.4704 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.224+0000 7f86ef803000 10 client.4704 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 20 client.4704 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x56103b089290 0x56103b08b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 4 client.4704 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:50:35.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 -- 172.21.15.115:0/1270253991 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56103ae1cbc0 con 0x56103b089290 2024-05-12T10:50:35.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86e9a00640 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x56103b089290 0x56103b08b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86e9a00640 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x56103b089290 0x56103b08b680 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b734d43b007a81 server_cookie=bb854744680174d7 in_seq=0 out_seq=0 2024-05-12T10:50:35.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86caa00640 10 client.4704 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:35.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86caa00640 1 -- 172.21.15.115:0/1270253991 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56103ae1cbc0 con 0x56103b089290 2024-05-12T10:50:35.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86caa00640 10 client.4704 handle_command_reply: tid=0 2024-05-12T10:50:35.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 client.4704 shutdown 2024-05-12T10:50:35.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 -- 172.21.15.115:0/1270253991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0761c0 msgr2=0x56103b03a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0761c0 0x56103b03a320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f86d000d800 tx=0x7f86d00586d0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 -- 172.21.15.115:0/1270253991 shutdown_connections 2024-05-12T10:50:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b076ae0 0x56103b035100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0761c0 0x56103b03a320 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x56103b089290 0x56103b08b680 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 --2- 172.21.15.115:0/1270253991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0758a0 0x56103b039de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86caa00640 0 client.4704 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 -- 172.21.15.115:0/1270253991 >> 172.21.15.115:0/1270253991 conn(0x56103b071650 msgr2=0x56103b073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 -- 172.21.15.115:0/1270253991 shutdown_connections 2024-05-12T10:50:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 1 -- 172.21.15.115:0/1270253991 wait complete. 2024-05-12T10:50:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.228+0000 7f86ef803000 20 client.4704 trim_cache size 0 max 16384 2024-05-12T10:50:35.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86ef803000 1 Processor -- start 2024-05-12T10:50:35.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86ef803000 1 -- start start 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86ef803000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b071650 0x56103b074e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86ef803000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86ef803000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b0761c0 0x56103b070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86ef803000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f86e41fe300 con 0x56103b0758a0 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86ef803000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4152480 con 0x56103b071650 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86ef803000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f86e41fde70 con 0x56103b0761c0 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86e9000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86e9000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60882/0 (socket says 172.21.15.115:60882) 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86e9000640 1 -- 172.21.15.115:0/1203895076 learned_addr learned my addr 172.21.15.115:0/1203895076 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86e9a00640 1 --2- 172.21.15.115:0/1203895076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b071650 0x56103b074e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86ea400640 1 --2- 172.21.15.115:0/1203895076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b0761c0 0x56103b070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86e9000640 1 -- 172.21.15.115:0/1203895076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b0761c0 msgr2=0x56103b070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86e9000640 1 --2- 172.21.15.115:0/1203895076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b0761c0 0x56103b070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86e9000640 1 -- 172.21.15.115:0/1203895076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b071650 msgr2=0x56103b074e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86e9000640 1 --2- 172.21.15.115:0/1203895076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b071650 0x56103b074e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86e9000640 1 -- 172.21.15.115:0/1203895076 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56103ae5dad0 con 0x56103b0758a0 2024-05-12T10:50:35.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86e9000640 1 --2- 172.21.15.115:0/1203895076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b070450 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86d0006f10 tx=0x7f86d0020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ace6b7f60ce819 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86d5600640 1 -- 172.21.15.115:0/1203895076 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0075040 con 0x56103b0758a0 2024-05-12T10:50:35.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86d5600640 1 -- 172.21.15.115:0/1203895076 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d005c890 con 0x56103b0758a0 2024-05-12T10:50:35.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86d5600640 1 -- 172.21.15.115:0/1203895076 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d005b900 con 0x56103b0758a0 2024-05-12T10:50:35.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86ef803000 1 -- 172.21.15.115:0/1203895076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 msgr2=0x56103b070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.248+0000 7f86ef803000 1 --2- 172.21.15.115:0/1203895076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b070450 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86d0006f10 tx=0x7f86d0020070 comp rx=0 tx=0).stop 2024-05-12T10:50:35.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 -- 172.21.15.115:0/1203895076 shutdown_connections 2024-05-12T10:50:35.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 --2- 172.21.15.115:0/1203895076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b0761c0 0x56103b070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 --2- 172.21.15.115:0/1203895076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b070450 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 --2- 172.21.15.115:0/1203895076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b071650 0x56103b074e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 -- 172.21.15.115:0/1203895076 >> 172.21.15.115:0/1203895076 conn(0x56103b034ac0 msgr2=0x56103b038db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 -- 172.21.15.115:0/1203895076 shutdown_connections 2024-05-12T10:50:35.258 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 -- 172.21.15.115:0/1203895076 wait complete. 2024-05-12T10:50:35.258 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 -- start start 2024-05-12T10:50:35.258 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 Processor -- start 2024-05-12T10:50:35.258 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b071650 0x56103b0ead20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.258 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b0eb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.258 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0761c0 0x56103b08c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.258 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56103ae197b0 con 0x56103b0758a0 2024-05-12T10:50:35.258 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56103ae886a0 con 0x56103b0761c0 2024-05-12T10:50:35.259 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x56103ae277b0 con 0x56103b071650 2024-05-12T10:50:35.259 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 10 client.0 _ll_register_callbacks cb 0x7f86d00046d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:35.259 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b0eb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.259 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b0eb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60890/0 (socket says 172.21.15.115:60890) 2024-05-12T10:50:35.259 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9000640 1 -- 172.21.15.115:0/2649867687 learned_addr learned my addr 172.21.15.115:0/2649867687 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.259 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ea400640 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0761c0 0x56103b08c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.259 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9a00640 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b071650 0x56103b0ead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9000640 1 -- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b071650 msgr2=0x56103b0ead20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9000640 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b071650 0x56103b0ead20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9000640 1 -- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0761c0 msgr2=0x56103b08c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9000640 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0761c0 0x56103b08c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9000640 1 -- 172.21.15.115:0/2649867687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56103ae5ce20 con 0x56103b0758a0 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9a00640 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b071650 0x56103b0ead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9000640 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b0eb260 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f86d00604b0 tx=0x7f86d008dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4456444ee5e536e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86caa00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86caa00640 1 -- 172.21.15.115:0/2649867687 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0080060 con 0x56103b0758a0 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86caa00640 1 -- 172.21.15.115:0/2649867687 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f86d005ae60 con 0x56103b0758a0 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 -- 172.21.15.115:0/2649867687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86d005c890 con 0x56103b0758a0 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86caa00640 1 -- 172.21.15.115:0/2649867687 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f86d0075040 con 0x56103b0758a0 2024-05-12T10:50:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 10 client.4710 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 -- 172.21.15.115:0/2649867687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56103af044c0 con 0x56103b0758a0 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86caa00640 1 -- 172.21.15.115:0/2649867687 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d005c890 con 0x56103b0758a0 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86caa00640 1 -- 172.21.15.115:0/2649867687 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f86d005b060 con 0x56103b0758a0 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 10 client.4710 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 10 client.4710 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 20 client.4710 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x56103b076ae0 0x56103b08d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 4 client.4710 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86ef803000 1 -- 172.21.15.115:0/2649867687 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "status"}) -- 0x56103ae91c80 con 0x56103b076ae0 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.252+0000 7f86e9a00640 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x56103b076ae0 0x56103b08d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86e9a00640 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x56103b076ae0 0x56103b08d060 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6eefd1ccc9e1c48 server_cookie=f262ada98f67ba42 in_seq=0 out_seq=0 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86caa00640 10 client.4710 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86caa00640 1 -- 172.21.15.115:0/2649867687 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56103ae91c80 con 0x56103b076ae0 2024-05-12T10:50:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86caa00640 10 client.4710 handle_command_reply: tid=0 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 1 client.4710 shutdown 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 1 -- 172.21.15.115:0/2649867687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 msgr2=0x56103b0eb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b0eb260 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f86d00604b0 tx=0x7f86d008dda0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 1 -- 172.21.15.115:0/2649867687 shutdown_connections 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x56103b076ae0 0x56103b08d060 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56103b0761c0 0x56103b08c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56103b0758a0 0x56103b0eb260 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 1 --2- 172.21.15.115:0/2649867687 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56103b071650 0x56103b0ead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86caa00640 0 client.4710 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 1 -- 172.21.15.115:0/2649867687 >> 172.21.15.115:0/2649867687 conn(0x56103b034ac0 msgr2=0x56103b038db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 1 -- 172.21.15.115:0/2649867687 shutdown_connections 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 1 -- 172.21.15.115:0/2649867687 wait complete. 2024-05-12T10:50:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86ef803000 20 client.4710 trim_cache size 0 max 16384 2024-05-12T10:50:35.263 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:50:35.263 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "afd333ea-2e10-495a-8d22-6858d0930293", 2024-05-12T10:50:35.263 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2024-05-12T10:50:35.263 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 4321, 2024-05-12T10:50:35.263 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2024-05-12T10:50:35.263 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2024-05-12T10:50:35.263 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2024-05-12T10:50:35.263 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 39.644837541000001, 2024-05-12T10:50:35.263 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 14, 2024-05-12T10:50:35.263 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 26, 2024-05-12T10:50:35.264 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 26, 2024-05-12T10:50:35.264 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 45.700396335999997 2024-05-12T10:50:35.264 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:50:35.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 -- 172.21.15.115:0/2015654738 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f86c406f400 msgr2=0x7f86c40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f86c406f400 0x7f86c40718c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009a00 tx=0x7f86d80039a0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 -- 172.21.15.115:0/2015654738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86e40cf7c0 msgr2=0x7f86e41e20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86e40cf7c0 0x7f86e41e20e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f86d000d830 tx=0x7f86d000dcf0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 -- 172.21.15.115:0/2015654738 shutdown_connections 2024-05-12T10:50:35.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f86c406f400 0x7f86c40718c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86e40cfba0 0x7f86e40b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86e40cf7c0 0x7f86e41e20e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 --2- 172.21.15.115:0/2015654738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86e40717d0 0x7f86e41f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 -- 172.21.15.115:0/2015654738 >> 172.21.15.115:0/2015654738 conn(0x7f86e4076830 msgr2=0x7f86e41575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 -- 172.21.15.115:0/2015654738 shutdown_connections 2024-05-12T10:50:35.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.256+0000 7f86eae00640 1 -- 172.21.15.115:0/2015654738 wait complete. 2024-05-12T10:50:35.272 INFO:teuthology.run_tasks:Running task sequential... 2024-05-12T10:50:35.282 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-12T10:50:35.282 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-12T10:50:35.282 INFO:teuthology.task.print:Enabling mgr modules 2024-05-12T10:50:35.283 INFO:teuthology.run_tasks:Running task kclient... 2024-05-12T10:50:35.298 INFO:tasks.kclient:Mounting kernel clients... 2024-05-12T10:50:35.298 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-12T10:50:35.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:35.299 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-05-12T10:50:35.308 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-12T10:50:35.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:35.309 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-12T10:50:35.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:35.372 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2024-05-12T10:50:35.518 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-12T10:50:35.518 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-12T10:50:35.518 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-12T10:50:35.518 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-12T10:50:35.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.660+0000 7f8cb7400640 1 Processor -- start 2024-05-12T10:50:35.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.660+0000 7f8cb7400640 1 -- start start 2024-05-12T10:50:35.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.664+0000 7f8cb7400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8cb00c7e20 0x7f8cb00c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.664+0000 7f8cb7400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb00c9400 con 0x7f8cb00c7680 2024-05-12T10:50:35.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.664+0000 7f8cb7400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb00c8440 con 0x7f8cb0153940 2024-05-12T10:50:35.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.664+0000 7f8cb7400640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb00c8200 con 0x7f8cb00c7e20 2024-05-12T10:50:35.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.664+0000 7f8ca7e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8cb00c7680 0x7f8cb00cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50678/0 (socket says 172.21.15.115:50678) 2024-05-12T10:50:35.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.664+0000 7f8ca7e00640 1 -- 172.21.15.115:0/859790498 learned_addr learned my addr 172.21.15.115:0/859790498 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:35.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.664+0000 7f8cb5400640 1 --2- 172.21.15.115:0/859790498 >> v2:172.21.15.115:3300/0 conn(0x7f8cb00c7e20 0x7f8cb00c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.664+0000 7f8cafe00640 1 -- 172.21.15.115:0/859790498 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1504282293 0 0) 0x7f8c98001120 con 0x7f8cb00c7680 2024-05-12T10:50:35.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.664+0000 7f8cb5400640 1 -- 172.21.15.115:0/859790498 >> v1:172.21.15.134:6789/0 conn(0x7f8cb0153940 legacy=0x7f8cb015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.664+0000 7f8cb5400640 1 -- 172.21.15.115:0/859790498 >> v1:172.21.15.115:6789/0 conn(0x7f8cb00c7680 legacy=0x7f8cb00cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.664+0000 7f8cb5400640 1 -- 172.21.15.115:0/859790498 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb00c49c0 con 0x7f8cb00c7e20 2024-05-12T10:50:35.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb5400640 1 --2- 172.21.15.115:0/859790498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb00c7e20 0x7f8cb00c5cd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009d90 tx=0x7f8ca801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36fc255eec3a8a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cafe00640 1 -- 172.21.15.115:0/859790498 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80b4070 con 0x7f8cb00c7e20 2024-05-12T10:50:35.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cafe00640 1 -- 172.21.15.115:0/859790498 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca80af600 con 0x7f8cb00c7e20 2024-05-12T10:50:35.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cafe00640 1 -- 172.21.15.115:0/859790498 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80af9d0 con 0x7f8cb00c7e20 2024-05-12T10:50:35.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 -- 172.21.15.115:0/859790498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb00c7e20 msgr2=0x7f8cb00c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 --2- 172.21.15.115:0/859790498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb00c7e20 0x7f8cb00c5cd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009d90 tx=0x7f8ca801f150 comp rx=0 tx=0).stop 2024-05-12T10:50:35.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 -- 172.21.15.115:0/859790498 shutdown_connections 2024-05-12T10:50:35.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 --2- 172.21.15.115:0/859790498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb00c7e20 0x7f8cb00c5cd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 -- 172.21.15.115:0/859790498 >> 172.21.15.115:0/859790498 conn(0x7f8cb00681c0 msgr2=0x7f8cb00685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 -- 172.21.15.115:0/859790498 shutdown_connections 2024-05-12T10:50:35.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 -- 172.21.15.115:0/859790498 wait complete. 2024-05-12T10:50:35.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 Processor -- start 2024-05-12T10:50:35.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 -- start start 2024-05-12T10:50:35.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb00c7680 0x7f8cb01f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cb00c7e20 0x7f8cb01e6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cb0153940 0x7f8cb0072b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb00c4f00 con 0x7f8cb00c7680 2024-05-12T10:50:35.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb00c4c60 con 0x7f8cb00c7e20 2024-05-12T10:50:35.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb7400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb0159cb0 con 0x7f8cb0153940 2024-05-12T10:50:35.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb4a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb00c7680 0x7f8cb01f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb4a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb00c7680 0x7f8cb01f21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60908/0 (socket says 172.21.15.115:60908) 2024-05-12T10:50:35.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb4a00640 1 -- 172.21.15.115:0/2525633586 learned_addr learned my addr 172.21.15.115:0/2525633586 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:35.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8ca7e00640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cb00c7e20 0x7f8cb01e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.668+0000 7f8cb5400640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cb0153940 0x7f8cb0072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cb4a00640 1 -- 172.21.15.115:0/2525633586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cb0153940 msgr2=0x7f8cb0072b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cb4a00640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cb0153940 0x7f8cb0072b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cb4a00640 1 -- 172.21.15.115:0/2525633586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cb00c7e20 msgr2=0x7f8cb01e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cb4a00640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cb00c7e20 0x7f8cb01e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cb4a00640 1 -- 172.21.15.115:0/2525633586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb01f4d80 con 0x7f8cb00c7680 2024-05-12T10:50:35.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cb4a00640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb00c7680 0x7f8cb01f21f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000c450 tx=0x7f8ca000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cad600640 1 -- 172.21.15.115:0/2525633586 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00052d0 con 0x7f8cb00c7680 2024-05-12T10:50:35.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cad600640 1 -- 172.21.15.115:0/2525633586 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca0005470 con 0x7f8cb00c7680 2024-05-12T10:50:35.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cb7400640 1 -- 172.21.15.115:0/2525633586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb01f5020 con 0x7f8cb00c7680 2024-05-12T10:50:35.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cad600640 1 -- 172.21.15.115:0/2525633586 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0012850 con 0x7f8cb00c7680 2024-05-12T10:50:35.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cb7400640 1 -- 172.21.15.115:0/2525633586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb01f55e0 con 0x7f8cb00c7680 2024-05-12T10:50:35.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cb7400640 1 -- 172.21.15.115:0/2525633586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb0069730 con 0x7f8cb00c7680 2024-05-12T10:50:35.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cad600640 1 -- 172.21.15.115:0/2525633586 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8ca00129f0 con 0x7f8cb00c7680 2024-05-12T10:50:35.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cad600640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8c8c06f430 0x7f8c8c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:35.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.672+0000 7f8cad600640 1 -- 172.21.15.115:0/2525633586 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8ca008f140 con 0x7f8cb00c7680 2024-05-12T10:50:35.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.676+0000 7f8ca7e00640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8c8c06f430 0x7f8c8c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:35.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.676+0000 7f8ca7e00640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8c8c06f430 0x7f8c8c0718f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c98007d80 tx=0x7f8c98007d10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:35.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.680+0000 7f8cad600640 1 -- 172.21.15.115:0/2525633586 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8ca005b600 con 0x7f8cb00c7680 2024-05-12T10:50:35.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.888+0000 7f8cb7400640 1 -- 172.21.15.115:0/2525633586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8cb00ca8c0 con 0x7f8cb00c7680 2024-05-12T10:50:35.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cad600640 1 -- 172.21.15.115:0/2525633586 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+88 (secure 0 0 0) 0x7f8ca005f900 con 0x7f8cb00c7680 2024-05-12T10:50:35.888 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-12T10:50:35.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 -- 172.21.15.115:0/2525633586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8c8c06f430 msgr2=0x7f8c8c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8c8c06f430 0x7f8c8c0718f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c98007d80 tx=0x7f8c98007d10 comp rx=0 tx=0).stop 2024-05-12T10:50:35.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 -- 172.21.15.115:0/2525633586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb00c7680 msgr2=0x7f8cb01f21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:35.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb00c7680 0x7f8cb01f21f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000c450 tx=0x7f8ca000c910 comp rx=0 tx=0).stop 2024-05-12T10:50:35.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 -- 172.21.15.115:0/2525633586 shutdown_connections 2024-05-12T10:50:35.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8c8c06f430 0x7f8c8c0718f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cb0153940 0x7f8cb0072b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cb00c7e20 0x7f8cb01e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 --2- 172.21.15.115:0/2525633586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb00c7680 0x7f8cb01f21f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:35.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 -- 172.21.15.115:0/2525633586 >> 172.21.15.115:0/2525633586 conn(0x7f8cb00681c0 msgr2=0x7f8cb01e2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:35.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 -- 172.21.15.115:0/2525633586 shutdown_connections 2024-05-12T10:50:35.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:35.892+0000 7f8cb7400640 1 -- 172.21.15.115:0/2525633586 wait complete. 2024-05-12T10:50:35.910 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-12T10:50:35.910 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-12T10:50:35.910 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2024-05-12T10:50:35.910 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-12T10:50:35.910 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-12T10:50:35.910 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-12T10:50:35.910 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-12T10:50:35.910 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-12T10:50:35.910 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-12T10:50:35.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:35.910 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2024-05-12T10:50:35.919 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-12T10:50:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-12T10:50:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2024-05-12T10:50:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-05-12T10:50:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2024-05-12T10:50:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-05-12T10:50:35.919 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42415sec preferred_lft 42415sec 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-12T10:50:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 02:42:36:49:fd:5a brd ff:ff:ff:ff:ff:ff 2024-05-12T10:50:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-12T10:50:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-05-12T10:50:35.921 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-12T10:50:35.922 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T10:50:35.922 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-05-12T10:50:35.922 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add name ceph-brx type bridge 2024-05-12T10:50:35.922 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr flush dev ceph-brx 2024-05-12T10:50:35.922 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set ceph-brx up 2024-05-12T10:50:35.922 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-12T10:50:35.922 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-05-12T10:50:36.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T10:50:36.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:36.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:36.080 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-12T10:50:36.098 INFO:teuthology.orchestra.run.smithi115.stdout:1 2024-05-12T10:50:36.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:36.101 DEBUG:teuthology.orchestra.run.smithi115:> route 2024-05-12T10:50:36.159 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2024-05-12T10:50:36.159 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-12T10:50:36.159 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-12T10:50:36.159 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-12T10:50:36.159 INFO:teuthology.orchestra.run.smithi115.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-12T10:50:36.159 INFO:teuthology.orchestra.run.smithi115.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-12T10:50:36.159 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-12T10:50:36.159 INFO:teuthology.orchestra.run.smithi115.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-12T10:50:36.159 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-12T10:50:36.159 INFO:teuthology.orchestra.run.smithi115.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-12T10:50:36.160 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-12T10:50:36.160 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T10:50:36.160 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-05-12T10:50:36.160 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-12T10:50:36.160 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-12T10:50:36.160 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-12T10:50:36.160 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-05-12T10:50:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T10:50:36.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:36.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:36.297 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-05-12T10:50:36.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:36.306 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2024-05-12T10:50:36.355 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T10:50:36.355 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-05-12T10:50:36.355 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T10:50:36.355 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-12T10:50:36.355 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-05-12T10:50:36.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T10:50:36.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:36.481 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-12T10:50:36.482 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T10:50:36.482 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-05-12T10:50:36.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-12T10:50:36.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-12T10:50:36.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-12T10:50:36.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-12T10:50:36.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-12T10:50:36.482 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-05-12T10:50:36.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T10:50:36.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:36.620 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T10:50:36.620 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-05-12T10:50:36.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2024-05-12T10:50:36.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.0 master ceph-brx 2024-05-12T10:50:36.620 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-05-12T10:50:36.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T10:50:36.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:36.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-12T10:50:36.704 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-12T10:50:36.713 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-12T10:50:36.713 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-12T10:50:36.713 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-12T10:50:36.763 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-12T10:50:36.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:36.763 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-12T10:50:36.856 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-12T10:50:36.857 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-12T10:50:36.857 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-05-12T10:50:37.470 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-12T10:50:37.470 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-12T10:50:37.470 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-05-12T10:50:37.470 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.115:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-05-12T10:50:37.471 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-12T10:50:37.484 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-12T10:50:37.484 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-12T10:50:37.484 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-05-12T10:50:37.484 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.115:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-05-12T10:50:37.484 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-12T10:50:37.484 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.115:6789,172.21.15.134:6789,172.21.15.134:6790" 2024-05-12T10:50:37.484 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.115:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2024-05-12T10:50:37.484 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=afd333ea-2e10-495a-8d22-6858d0930293" will pass to kernel 2024-05-12T10:50:37.488 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-12T10:50:37.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:50:37.488 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-12T10:50:37.508 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-12T10:50:37.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-12T10:50:37.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:37.613 INFO:teuthology.orchestra.run.smithi115.stdout:client4722 2024-05-12T10:50:37.614 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:50:37.614 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-12T10:50:37.622 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-12T10:50:37.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-12T10:50:37.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:37.718 INFO:teuthology.orchestra.run.smithi115.stdout:client4722 2024-05-12T10:50:37.718 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-12T10:50:37.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-12T10:50:37.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:37.775 INFO:teuthology.orchestra.run.smithi115.stdout:client4722 2024-05-12T10:50:37.775 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/afd333ea-2e10-495a-8d22-6858d0930293.client4722/status') 2024-05-12T10:50:37.822 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T10:50:37.836 INFO:teuthology.orchestra.run.smithi115.stdout:instance: client.4722 (3)192.168.0.1:0/4265415451 2024-05-12T10:50:37.836 INFO:teuthology.orchestra.run.smithi115.stdout:blocklisted: false 2024-05-12T10:50:37.836 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records in 2024-05-12T10:50:37.836 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records out 2024-05-12T10:50:37.836 INFO:teuthology.orchestra.run.smithi115.stderr:69 bytes copied, 6.7509e-05 s, 1.0 MB/s 2024-05-12T10:50:37.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T10:50:37.845 INFO:teuthology.run_tasks:Running task quiescer... 2024-05-12T10:50:37.858 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-12T10:50:37.858 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:50:37.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:37.996+0000 7ff8d4200640 1 Processor -- start 2024-05-12T10:50:37.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:37.996+0000 7ff8d4200640 1 -- start start 2024-05-12T10:50:37.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d4200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8cc153940 0x7ff8cc0c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d4200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff8cc0c5cd0 0x7ff8cc0cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d4200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8cc0c9400 con 0x7ff8cc0c7680 2024-05-12T10:50:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d4200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff8cc0c6140 con 0x7ff8cc0c5cd0 2024-05-12T10:50:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d4200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc0c8440 con 0x7ff8cc153940 2024-05-12T10:50:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d0e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff8cc0c7680 0x7ff8cc15a1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50688/0 (socket says 172.21.15.115:50688) 2024-05-12T10:50:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d0e00640 1 -- 172.21.15.115:0/3933543155 learned_addr learned my addr 172.21.15.115:0/3933543155 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d2200640 1 --2- 172.21.15.115:0/3933543155 >> v2:172.21.15.134:3300/0 conn(0x7ff8cc0c5cd0 0x7ff8cc0cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d1800640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8cc153940 0x7ff8cc0c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720554193 0 0) 0x7ff8b8001120 con 0x7ff8cc0c7680 2024-05-12T10:50:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8b4003530 con 0x7ff8cc0c7680 2024-05-12T10:50:37.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 15741358 0 0) 0x7ff8b4003530 con 0x7ff8cc0c7680 2024-05-12T10:50:37.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8cc153940 msgr2=0x7ff8cc0c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:37.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8cc153940 0x7ff8cc0c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:37.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 >> v2:172.21.15.134:3300/0 conn(0x7ff8cc0c5cd0 msgr2=0x7ff8cc0cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 --2- 172.21.15.115:0/3933543155 >> v2:172.21.15.134:3300/0 conn(0x7ff8cc0c5cd0 0x7ff8cc0cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc0c49c0 con 0x7ff8cc0c7680 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7ff8b80018d0 con 0x7ff8cc0c7680 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 >> v1:172.21.15.115:6789/0 conn(0x7ff8cc0c7680 legacy=0x7ff8cc15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8cc153940 0x7ff8b4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b4004000 0x7ff8b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b4004d50 0x7ff8b40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0c6140 con 0x7ff8b4004000 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0c8440 con 0x7ff8b4004d50 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b400bae0 con 0x7ff8cc153940 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d0e00640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b4004000 0x7ff8b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d1800640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8cc153940 0x7ff8b4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d2200640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b4004d50 0x7ff8b40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d0e00640 1 -- 172.21.15.115:0/3933543155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8cc153940 msgr2=0x7ff8b4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d0e00640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8cc153940 0x7ff8b4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d0e00640 1 -- 172.21.15.115:0/3933543155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b4004d50 msgr2=0x7ff8b40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d0e00640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b4004d50 0x7ff8b40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.000+0000 7ff8d0e00640 1 -- 172.21.15.115:0/3933543155 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b4003530 con 0x7ff8b4004000 2024-05-12T10:50:38.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.004+0000 7ff8d0e00640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b4004000 0x7ff8b4004810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c4c0 tx=0x7ff8b801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e4ba40556e984b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:38.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.004+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b800c0e0 con 0x7ff8b4004000 2024-05-12T10:50:38.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.004+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b80a9070 con 0x7ff8b4004000 2024-05-12T10:50:38.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.004+0000 7ff8cbe00640 1 -- 172.21.15.115:0/3933543155 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80a5e20 con 0x7ff8b4004000 2024-05-12T10:50:38.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.004+0000 7ff8d4200640 1 -- 172.21.15.115:0/3933543155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b4004000 msgr2=0x7ff8b4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.004+0000 7ff8d4200640 1 --2- 172.21.15.115:0/3933543155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b4004000 0x7ff8b4004810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c4c0 tx=0x7ff8b801cc20 comp rx=0 tx=0).stop 2024-05-12T10:50:38.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.004+0000 7ff8d2200640 1 -- 172.21.15.115:0/3933543155 reap_dead start 2024-05-12T10:50:38.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.004+0000 7ff8d4200640 1 -- 172.21.15.115:0/3933543155 shutdown_connections 2024-05-12T10:50:38.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.004+0000 7ff8d4200640 1 -- 172.21.15.115:0/3933543155 >> 172.21.15.115:0/3933543155 conn(0x7ff8cc0681c0 msgr2=0x7ff8cc0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:38.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.004+0000 7ff8d4200640 1 -- 172.21.15.115:0/3933543155 shutdown_connections 2024-05-12T10:50:38.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.004+0000 7ff8d4200640 1 -- 172.21.15.115:0/3933543155 wait complete. 2024-05-12T10:50:38.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d4200640 1 Processor -- start 2024-05-12T10:50:38.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d4200640 1 -- start start 2024-05-12T10:50:38.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d4200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b4004000 0x7ff8cc14a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d4200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8cc0ccc80 0x7ff8cc14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d4200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8cc148ca0 0x7ff8cc149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d4200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0c4f00 con 0x7ff8cc0ccc80 2024-05-12T10:50:38.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d4200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0c4c60 con 0x7ff8cc148ca0 2024-05-12T10:50:38.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d4200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc159cb0 con 0x7ff8b4004000 2024-05-12T10:50:38.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d0e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8cc0ccc80 0x7ff8cc14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d0e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8cc0ccc80 0x7ff8cc14af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60918/0 (socket says 172.21.15.115:60918) 2024-05-12T10:50:38.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d0e00640 1 -- 172.21.15.115:0/3629642468 learned_addr learned my addr 172.21.15.115:0/3629642468 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:38.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d2200640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8cc148ca0 0x7ff8cc149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d1800640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b4004000 0x7ff8cc14a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d0e00640 1 -- 172.21.15.115:0/3629642468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b4004000 msgr2=0x7ff8cc14a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d0e00640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b4004000 0x7ff8cc14a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d0e00640 1 -- 172.21.15.115:0/3629642468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8cc148ca0 msgr2=0x7ff8cc149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d0e00640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8cc148ca0 0x7ff8cc149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d0e00640 1 -- 172.21.15.115:0/3629642468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc149660 con 0x7ff8cc0ccc80 2024-05-12T10:50:38.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d0e00640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8cc0ccc80 0x7ff8cc14af10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c4c0 tx=0x7ff8b4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:38.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8c9600640 1 -- 172.21.15.115:0/3629642468 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80a5bd0 con 0x7ff8cc0ccc80 2024-05-12T10:50:38.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8c9600640 1 -- 172.21.15.115:0/3629642468 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b80a5d70 con 0x7ff8cc0ccc80 2024-05-12T10:50:38.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d4200640 1 -- 172.21.15.115:0/3629642468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc0cc530 con 0x7ff8cc0ccc80 2024-05-12T10:50:38.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8c9600640 1 -- 172.21.15.115:0/3629642468 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8004a30 con 0x7ff8cc0ccc80 2024-05-12T10:50:38.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d4200640 1 -- 172.21.15.115:0/3629642468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc149ef0 con 0x7ff8cc0ccc80 2024-05-12T10:50:38.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.008+0000 7ff8d4200640 1 -- 172.21.15.115:0/3629642468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8cc069730 con 0x7ff8cc0ccc80 2024-05-12T10:50:38.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.012+0000 7ff8c9600640 1 -- 172.21.15.115:0/3629642468 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff8b8004bd0 con 0x7ff8cc0ccc80 2024-05-12T10:50:38.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.012+0000 7ff8c9600640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8ac06f400 0x7ff8ac0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.012+0000 7ff8c9600640 1 -- 172.21.15.115:0/3629642468 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff8b8129230 con 0x7ff8cc0ccc80 2024-05-12T10:50:38.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.012+0000 7ff8d1800640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8ac06f400 0x7ff8ac0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.012+0000 7ff8d1800640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8ac06f400 0x7ff8ac0718c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009b00 tx=0x7ff8c0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:38.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.016+0000 7ff8c9600640 1 -- 172.21.15.115:0/3629642468 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff8cc149660 con 0x7ff8cc0ccc80 2024-05-12T10:50:38.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.168+0000 7ff8d4200640 1 -- 172.21.15.115:0/3629642468 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8cc0ccab0 con 0x7ff8ac06f400 2024-05-12T10:50:38.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.180+0000 7ff8c9600640 1 -- 172.21.15.115:0/3629642468 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332698 (secure 0 0 0) 0x7ff8cc0ccab0 con 0x7ff8ac06f400 2024-05-12T10:50:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:38.182 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:50:38.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 -- 172.21.15.115:0/3629642468 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8ac06f400 msgr2=0x7ff8ac0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8ac06f400 0x7ff8ac0718c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009b00 tx=0x7ff8c0009190 comp rx=0 tx=0).stop 2024-05-12T10:50:38.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 -- 172.21.15.115:0/3629642468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8cc0ccc80 msgr2=0x7ff8cc14af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8cc0ccc80 0x7ff8cc14af10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c4c0 tx=0x7ff8b4005840 comp rx=0 tx=0).stop 2024-05-12T10:50:38.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 -- 172.21.15.115:0/3629642468 shutdown_connections 2024-05-12T10:50:38.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8ac06f400 0x7ff8ac0718c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8cc148ca0 0x7ff8cc149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8cc0ccc80 0x7ff8cc14af10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 --2- 172.21.15.115:0/3629642468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b4004000 0x7ff8cc14a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 -- 172.21.15.115:0/3629642468 >> 172.21.15.115:0/3629642468 conn(0x7ff8cc0681c0 msgr2=0x7ff8cc0685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:38.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 -- 172.21.15.115:0/3629642468 shutdown_connections 2024-05-12T10:50:38.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.184+0000 7ff8d4200640 1 -- 172.21.15.115:0/3629642468 wait complete. 2024-05-12T10:50:38.200 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-05-12T10:50:37.762344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":228,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219592,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755128,"statfs":{"total":773094113280,"available":772869251072,"internally_reserved":0,"allocated":3547136,"data_stored":2081208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002022"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.793391+0000","last_change":"2024-05-12T10:49:54.640093+0000","last_active":"2024-05-12T10:50:29.793391+0000","last_peered":"2024-05-12T10:50:29.793391+0000","last_clean":"2024-05-12T10:50:29.793391+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:50:29.793391+0000","last_undegraded":"2024-05-12T10:50:29.793391+0000","last_fullsized":"2024-05-12T10:50:29.793391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:07:41.639104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653116+0000","last_change":"2024-05-12T10:49:55.635928+0000","last_active":"2024-05-12T10:50:01.653116+0000","last_peered":"2024-05-12T10:50:01.653116+0000","last_clean":"2024-05-12T10:50:01.653116+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:50:01.653116+0000","last_undegraded":"2024-05-12T10:50:01.653116+0000","last_fullsized":"2024-05-12T10:50:01.653116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:41:30.909036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652376+0000","last_change":"2024-05-12T10:50:00.396417+0000","last_active":"2024-05-12T10:50:01.652376+0000","last_peered":"2024-05-12T10:50:01.652376+0000","last_clean":"2024-05-12T10:50:01.652376+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:50:01.652376+0000","last_undegraded":"2024-05-12T10:50:01.652376+0000","last_fullsized":"2024-05-12T10:50:01.652376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:27.287617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653361+0000","last_change":"2024-05-12T10:49:54.619268+0000","last_active":"2024-05-12T10:50:01.653361+0000","last_peered":"2024-05-12T10:50:01.653361+0000","last_clean":"2024-05-12T10:50:01.653361+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:50:01.653361+0000","last_undegraded":"2024-05-12T10:50:01.653361+0000","last_fullsized":"2024-05-12T10:50:01.653361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:50:34.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837930+0000","last_change":"2024-05-12T10:49:55.624986+0000","last_active":"2024-05-12T10:50:02.837930+0000","last_peered":"2024-05-12T10:50:02.837930+0000","last_clean":"2024-05-12T10:50:02.837930+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:50:02.837930+0000","last_undegraded":"2024-05-12T10:50:02.837930+0000","last_fullsized":"2024-05-12T10:50:02.837930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:03:47.220979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657155+0000","last_change":"2024-05-12T10:49:59.676139+0000","last_active":"2024-05-12T10:50:01.657155+0000","last_peered":"2024-05-12T10:50:01.657155+0000","last_clean":"2024-05-12T10:50:01.657155+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:50:01.657155+0000","last_undegraded":"2024-05-12T10:50:01.657155+0000","last_fullsized":"2024-05-12T10:50:01.657155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:24:15.396258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788919+0000","last_change":"2024-05-12T10:49:54.645331+0000","last_active":"2024-05-12T10:50:29.788919+0000","last_peered":"2024-05-12T10:50:29.788919+0000","last_clean":"2024-05-12T10:50:29.788919+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:50:29.788919+0000","last_undegraded":"2024-05-12T10:50:29.788919+0000","last_fullsized":"2024-05-12T10:50:29.788919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:38:29.023589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658144+0000","last_change":"2024-05-12T10:49:55.642386+0000","last_active":"2024-05-12T10:50:01.658144+0000","last_peered":"2024-05-12T10:50:01.658144+0000","last_clean":"2024-05-12T10:50:01.658144+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:50:01.658144+0000","last_undegraded":"2024-05-12T10:50:01.658144+0000","last_fullsized":"2024-05-12T10:50:01.658144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:54:40.153070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657964+0000","last_change":"2024-05-12T10:49:59.679887+0000","last_active":"2024-05-12T10:50:01.657964+0000","last_peered":"2024-05-12T10:50:01.657964+0000","last_clean":"2024-05-12T10:50:01.657964+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:50:01.657964+0000","last_undegraded":"2024-05-12T10:50:01.657964+0000","last_fullsized":"2024-05-12T10:50:01.657964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:25:43.004918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919021+0000","last_change":"2024-05-12T10:49:54.659229+0000","last_active":"2024-05-12T10:50:02.919021+0000","last_peered":"2024-05-12T10:50:02.919021+0000","last_clean":"2024-05-12T10:50:02.919021+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:50:02.919021+0000","last_undegraded":"2024-05-12T10:50:02.919021+0000","last_fullsized":"2024-05-12T10:50:02.919021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:54:54.658165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660005+0000","last_change":"2024-05-12T10:49:55.642157+0000","last_active":"2024-05-12T10:50:01.660005+0000","last_peered":"2024-05-12T10:50:01.660005+0000","last_clean":"2024-05-12T10:50:01.660005+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:50:01.660005+0000","last_undegraded":"2024-05-12T10:50:01.660005+0000","last_fullsized":"2024-05-12T10:50:01.660005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:16.232731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658776+0000","last_change":"2024-05-12T10:49:59.663411+0000","last_active":"2024-05-12T10:50:01.658776+0000","last_peered":"2024-05-12T10:50:01.658776+0000","last_clean":"2024-05-12T10:50:01.658776+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:50:01.658776+0000","last_undegraded":"2024-05-12T10:50:01.658776+0000","last_fullsized":"2024-05-12T10:50:01.658776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:59.136704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075711+0000","last_change":"2024-05-12T10:49:55.646019+0000","last_active":"2024-05-12T10:50:02.075711+0000","last_peered":"2024-05-12T10:50:02.075711+0000","last_clean":"2024-05-12T10:50:02.075711+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:50:02.075711+0000","last_undegraded":"2024-05-12T10:50:02.075711+0000","last_fullsized":"2024-05-12T10:50:02.075711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:07.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.753731+0000","last_change":"2024-05-12T10:49:54.642039+0000","last_active":"2024-05-12T10:50:23.753731+0000","last_peered":"2024-05-12T10:50:23.753731+0000","last_clean":"2024-05-12T10:50:23.753731+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:50:23.753731+0000","last_undegraded":"2024-05-12T10:50:23.753731+0000","last_fullsized":"2024-05-12T10:50:23.753731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:01.155569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660588+0000","last_change":"2024-05-12T10:49:59.660274+0000","last_active":"2024-05-12T10:50:01.660588+0000","last_peered":"2024-05-12T10:50:01.660588+0000","last_clean":"2024-05-12T10:50:01.660588+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:50:01.660588+0000","last_undegraded":"2024-05-12T10:50:01.660588+0000","last_fullsized":"2024-05-12T10:50:01.660588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:55:12.579645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652722+0000","last_change":"2024-05-12T10:49:55.618128+0000","last_active":"2024-05-12T10:50:01.652722+0000","last_peered":"2024-05-12T10:50:01.652722+0000","last_clean":"2024-05-12T10:50:01.652722+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:50:01.652722+0000","last_undegraded":"2024-05-12T10:50:01.652722+0000","last_fullsized":"2024-05-12T10:50:01.652722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:45.205117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915890+0000","last_change":"2024-05-12T10:49:54.619967+0000","last_active":"2024-05-12T10:50:02.915890+0000","last_peered":"2024-05-12T10:50:02.915890+0000","last_clean":"2024-05-12T10:50:02.915890+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:50:02.915890+0000","last_undegraded":"2024-05-12T10:50:02.915890+0000","last_fullsized":"2024-05-12T10:50:02.915890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:37:10.799631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659650+0000","last_change":"2024-05-12T10:49:59.681931+0000","last_active":"2024-05-12T10:50:01.659650+0000","last_peered":"2024-05-12T10:50:01.659650+0000","last_clean":"2024-05-12T10:50:01.659650+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:50:01.659650+0000","last_undegraded":"2024-05-12T10:50:01.659650+0000","last_fullsized":"2024-05-12T10:50:01.659650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:45:01.542628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652721+0000","last_change":"2024-05-12T10:49:55.615095+0000","last_active":"2024-05-12T10:50:01.652721+0000","last_peered":"2024-05-12T10:50:01.652721+0000","last_clean":"2024-05-12T10:50:01.652721+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:50:01.652721+0000","last_undegraded":"2024-05-12T10:50:01.652721+0000","last_fullsized":"2024-05-12T10:50:01.652721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:51:19.659941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.756016+0000","last_change":"2024-05-12T10:49:54.639976+0000","last_active":"2024-05-12T10:50:23.756016+0000","last_peered":"2024-05-12T10:50:23.756016+0000","last_clean":"2024-05-12T10:50:23.756016+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:50:23.756016+0000","last_undegraded":"2024-05-12T10:50:23.756016+0000","last_fullsized":"2024-05-12T10:50:23.756016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:28:37.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916755+0000","last_change":"2024-05-12T10:50:00.390786+0000","last_active":"2024-05-12T10:50:02.916755+0000","last_peered":"2024-05-12T10:50:02.916755+0000","last_clean":"2024-05-12T10:50:02.916755+0000","last_became_active":"2024-05-12T10:50:00.390378+0000","last_became_peered":"2024-05-12T10:50:00.390378+0000","last_unstale":"2024-05-12T10:50:02.916755+0000","last_undegraded":"2024-05-12T10:50:02.916755+0000","last_fullsized":"2024-05-12T10:50:02.916755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:27:57.945259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658891+0000","last_change":"2024-05-12T10:49:55.622729+0000","last_active":"2024-05-12T10:50:01.658891+0000","last_peered":"2024-05-12T10:50:01.658891+0000","last_clean":"2024-05-12T10:50:01.658891+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:50:01.658891+0000","last_undegraded":"2024-05-12T10:50:01.658891+0000","last_fullsized":"2024-05-12T10:50:01.658891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:08:29.460684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.758471+0000","last_change":"2024-05-12T10:49:54.639564+0000","last_active":"2024-05-12T10:50:23.758471+0000","last_peered":"2024-05-12T10:50:23.758471+0000","last_clean":"2024-05-12T10:50:23.758471+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:50:23.758471+0000","last_undegraded":"2024-05-12T10:50:23.758471+0000","last_fullsized":"2024-05-12T10:50:23.758471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:54:48.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.661417+0000","last_change":"2024-05-12T10:49:59.676220+0000","last_active":"2024-05-12T10:50:01.661417+0000","last_peered":"2024-05-12T10:50:01.661417+0000","last_clean":"2024-05-12T10:50:01.661417+0000","last_became_active":"2024-05-12T10:49:59.674835+0000","last_became_peered":"2024-05-12T10:49:59.674835+0000","last_unstale":"2024-05-12T10:50:01.661417+0000","last_undegraded":"2024-05-12T10:50:01.661417+0000","last_fullsized":"2024-05-12T10:50:01.661417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:55:03.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838015+0000","last_change":"2024-05-12T10:49:55.612744+0000","last_active":"2024-05-12T10:50:02.838015+0000","last_peered":"2024-05-12T10:50:02.838015+0000","last_clean":"2024-05-12T10:50:02.838015+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:50:02.838015+0000","last_undegraded":"2024-05-12T10:50:02.838015+0000","last_fullsized":"2024-05-12T10:50:02.838015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:05:06.274277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.758768+0000","last_change":"2024-05-12T10:49:54.643375+0000","last_active":"2024-05-12T10:50:23.758768+0000","last_peered":"2024-05-12T10:50:23.758768+0000","last_clean":"2024-05-12T10:50:23.758768+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:50:23.758768+0000","last_undegraded":"2024-05-12T10:50:23.758768+0000","last_fullsized":"2024-05-12T10:50:23.758768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:56:43.086871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658181+0000","last_change":"2024-05-12T10:50:00.393325+0000","last_active":"2024-05-12T10:50:01.658181+0000","last_peered":"2024-05-12T10:50:01.658181+0000","last_clean":"2024-05-12T10:50:01.658181+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:50:01.658181+0000","last_undegraded":"2024-05-12T10:50:01.658181+0000","last_fullsized":"2024-05-12T10:50:01.658181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:55.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653561+0000","last_change":"2024-05-12T10:49:55.629693+0000","last_active":"2024-05-12T10:50:01.653561+0000","last_peered":"2024-05-12T10:50:01.653561+0000","last_clean":"2024-05-12T10:50:01.653561+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:50:01.653561+0000","last_undegraded":"2024-05-12T10:50:01.653561+0000","last_fullsized":"2024-05-12T10:50:01.653561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:04:13.325079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.790340+0000","last_change":"2024-05-12T10:49:54.629227+0000","last_active":"2024-05-12T10:50:29.790340+0000","last_peered":"2024-05-12T10:50:29.790340+0000","last_clean":"2024-05-12T10:50:29.790340+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:50:29.790340+0000","last_undegraded":"2024-05-12T10:50:29.790340+0000","last_fullsized":"2024-05-12T10:50:29.790340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:03.097527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652367+0000","last_change":"2024-05-12T10:50:00.396371+0000","last_active":"2024-05-12T10:50:01.652367+0000","last_peered":"2024-05-12T10:50:01.652367+0000","last_clean":"2024-05-12T10:50:01.652367+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:50:01.652367+0000","last_undegraded":"2024-05-12T10:50:01.652367+0000","last_fullsized":"2024-05-12T10:50:01.652367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:41:09.157859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916505+0000","last_change":"2024-05-12T10:49:55.612069+0000","last_active":"2024-05-12T10:50:02.916505+0000","last_peered":"2024-05-12T10:50:02.916505+0000","last_clean":"2024-05-12T10:50:02.916505+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:50:02.916505+0000","last_undegraded":"2024-05-12T10:50:02.916505+0000","last_fullsized":"2024-05-12T10:50:02.916505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:38.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921127+0000","last_change":"2024-05-12T10:49:54.639928+0000","last_active":"2024-05-12T10:50:02.921127+0000","last_peered":"2024-05-12T10:50:02.921127+0000","last_clean":"2024-05-12T10:50:02.921127+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:50:02.921127+0000","last_undegraded":"2024-05-12T10:50:02.921127+0000","last_fullsized":"2024-05-12T10:50:02.921127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:59.215089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837562+0000","last_change":"2024-05-12T10:50:00.383605+0000","last_active":"2024-05-12T10:50:02.837562+0000","last_peered":"2024-05-12T10:50:02.837562+0000","last_clean":"2024-05-12T10:50:02.837562+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:50:02.837562+0000","last_undegraded":"2024-05-12T10:50:02.837562+0000","last_fullsized":"2024-05-12T10:50:02.837562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:28.619988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660251+0000","last_change":"2024-05-12T10:49:55.621201+0000","last_active":"2024-05-12T10:50:01.660251+0000","last_peered":"2024-05-12T10:50:01.660251+0000","last_clean":"2024-05-12T10:50:01.660251+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:50:01.660251+0000","last_undegraded":"2024-05-12T10:50:01.660251+0000","last_fullsized":"2024-05-12T10:50:01.660251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:19:39.117790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916601+0000","last_change":"2024-05-12T10:49:54.620329+0000","last_active":"2024-05-12T10:50:02.916601+0000","last_peered":"2024-05-12T10:50:02.916601+0000","last_clean":"2024-05-12T10:50:02.916601+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:50:02.916601+0000","last_undegraded":"2024-05-12T10:50:02.916601+0000","last_fullsized":"2024-05-12T10:50:02.916601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:21:10.386830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916162+0000","last_change":"2024-05-12T10:49:59.655432+0000","last_active":"2024-05-12T10:50:02.916162+0000","last_peered":"2024-05-12T10:50:02.916162+0000","last_clean":"2024-05-12T10:50:02.916162+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:50:02.916162+0000","last_undegraded":"2024-05-12T10:50:02.916162+0000","last_fullsized":"2024-05-12T10:50:02.916162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:27:34.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658413+0000","last_change":"2024-05-12T10:49:55.628221+0000","last_active":"2024-05-12T10:50:01.658413+0000","last_peered":"2024-05-12T10:50:01.658413+0000","last_clean":"2024-05-12T10:50:01.658413+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:50:01.658413+0000","last_undegraded":"2024-05-12T10:50:01.658413+0000","last_fullsized":"2024-05-12T10:50:01.658413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:54.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659956+0000","last_change":"2024-05-12T10:49:54.652499+0000","last_active":"2024-05-12T10:50:01.659956+0000","last_peered":"2024-05-12T10:50:01.659956+0000","last_clean":"2024-05-12T10:50:01.659956+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:50:01.659956+0000","last_undegraded":"2024-05-12T10:50:01.659956+0000","last_fullsized":"2024-05-12T10:50:01.659956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:14:35.180779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916502+0000","last_change":"2024-05-12T10:49:59.676676+0000","last_active":"2024-05-12T10:50:02.916502+0000","last_peered":"2024-05-12T10:50:02.916502+0000","last_clean":"2024-05-12T10:50:02.916502+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:50:02.916502+0000","last_undegraded":"2024-05-12T10:50:02.916502+0000","last_fullsized":"2024-05-12T10:50:02.916502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:03:13.485130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916164+0000","last_change":"2024-05-12T10:49:55.610830+0000","last_active":"2024-05-12T10:50:02.916164+0000","last_peered":"2024-05-12T10:50:02.916164+0000","last_clean":"2024-05-12T10:50:02.916164+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:50:02.916164+0000","last_undegraded":"2024-05-12T10:50:02.916164+0000","last_fullsized":"2024-05-12T10:50:02.916164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:15.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.791800+0000","last_change":"2024-05-12T10:49:54.609239+0000","last_active":"2024-05-12T10:50:29.791800+0000","last_peered":"2024-05-12T10:50:29.791800+0000","last_clean":"2024-05-12T10:50:29.791800+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:50:29.791800+0000","last_undegraded":"2024-05-12T10:50:29.791800+0000","last_fullsized":"2024-05-12T10:50:29.791800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:12:54.169428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916817+0000","last_change":"2024-05-12T10:49:59.656739+0000","last_active":"2024-05-12T10:50:02.916817+0000","last_peered":"2024-05-12T10:50:02.916817+0000","last_clean":"2024-05-12T10:50:02.916817+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:50:02.916817+0000","last_undegraded":"2024-05-12T10:50:02.916817+0000","last_fullsized":"2024-05-12T10:50:02.916817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:05.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837232+0000","last_change":"2024-05-12T10:49:55.626312+0000","last_active":"2024-05-12T10:50:02.837232+0000","last_peered":"2024-05-12T10:50:02.837232+0000","last_clean":"2024-05-12T10:50:02.837232+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:50:02.837232+0000","last_undegraded":"2024-05-12T10:50:02.837232+0000","last_fullsized":"2024-05-12T10:50:02.837232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:36.639971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.791973+0000","last_change":"2024-05-12T10:49:54.640819+0000","last_active":"2024-05-12T10:50:29.791973+0000","last_peered":"2024-05-12T10:50:29.791973+0000","last_clean":"2024-05-12T10:50:29.791973+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:50:29.791973+0000","last_undegraded":"2024-05-12T10:50:29.791973+0000","last_fullsized":"2024-05-12T10:50:29.791973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:01.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837983+0000","last_change":"2024-05-12T10:50:00.384347+0000","last_active":"2024-05-12T10:50:02.837983+0000","last_peered":"2024-05-12T10:50:02.837983+0000","last_clean":"2024-05-12T10:50:02.837983+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:50:02.837983+0000","last_undegraded":"2024-05-12T10:50:02.837983+0000","last_fullsized":"2024-05-12T10:50:02.837983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:30.794704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652533+0000","last_change":"2024-05-12T10:49:55.627340+0000","last_active":"2024-05-12T10:50:01.652533+0000","last_peered":"2024-05-12T10:50:01.652533+0000","last_clean":"2024-05-12T10:50:01.652533+0000","last_became_active":"2024-05-12T10:49:55.627065+0000","last_became_peered":"2024-05-12T10:49:55.627065+0000","last_unstale":"2024-05-12T10:50:01.652533+0000","last_undegraded":"2024-05-12T10:50:01.652533+0000","last_fullsized":"2024-05-12T10:50:01.652533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:57:50.849518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.756339+0000","last_change":"2024-05-12T10:49:54.648333+0000","last_active":"2024-05-12T10:50:23.756339+0000","last_peered":"2024-05-12T10:50:23.756339+0000","last_clean":"2024-05-12T10:50:23.756339+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:50:23.756339+0000","last_undegraded":"2024-05-12T10:50:23.756339+0000","last_fullsized":"2024-05-12T10:50:23.756339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:29.355444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920043+0000","last_change":"2024-05-12T10:49:45.547469+0000","last_active":"2024-05-12T10:50:02.920043+0000","last_peered":"2024-05-12T10:50:02.920043+0000","last_clean":"2024-05-12T10:50:02.920043+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:50:02.920043+0000","last_undegraded":"2024-05-12T10:50:02.920043+0000","last_fullsized":"2024-05-12T10:50:02.920043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_clean_scrub_stamp":"2024-05-12T10:49:43.953472+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:44:15.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076721+0000","last_change":"2024-05-12T10:50:00.399288+0000","last_active":"2024-05-12T10:50:02.076721+0000","last_peered":"2024-05-12T10:50:02.076721+0000","last_clean":"2024-05-12T10:50:02.076721+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:50:02.076721+0000","last_undegraded":"2024-05-12T10:50:02.076721+0000","last_fullsized":"2024-05-12T10:50:02.076721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:26.959086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920561+0000","last_change":"2024-05-12T10:49:55.639605+0000","last_active":"2024-05-12T10:50:02.920561+0000","last_peered":"2024-05-12T10:50:02.920561+0000","last_clean":"2024-05-12T10:50:02.920561+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:50:02.920561+0000","last_undegraded":"2024-05-12T10:50:02.920561+0000","last_fullsized":"2024-05-12T10:50:02.920561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:46:26.585195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788076+0000","last_change":"2024-05-12T10:49:54.654999+0000","last_active":"2024-05-12T10:50:29.788076+0000","last_peered":"2024-05-12T10:50:29.788076+0000","last_clean":"2024-05-12T10:50:29.788076+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:50:29.788076+0000","last_undegraded":"2024-05-12T10:50:29.788076+0000","last_fullsized":"2024-05-12T10:50:29.788076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:00:20.115739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076118+0000","last_change":"2024-05-12T10:50:00.393017+0000","last_active":"2024-05-12T10:50:02.076118+0000","last_peered":"2024-05-12T10:50:02.076118+0000","last_clean":"2024-05-12T10:50:02.076118+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:50:02.076118+0000","last_undegraded":"2024-05-12T10:50:02.076118+0000","last_fullsized":"2024-05-12T10:50:02.076118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:01:02.394572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658363+0000","last_change":"2024-05-12T10:49:55.623665+0000","last_active":"2024-05-12T10:50:01.658363+0000","last_peered":"2024-05-12T10:50:01.658363+0000","last_clean":"2024-05-12T10:50:01.658363+0000","last_became_active":"2024-05-12T10:49:55.623403+0000","last_became_peered":"2024-05-12T10:49:55.623403+0000","last_unstale":"2024-05-12T10:50:01.658363+0000","last_undegraded":"2024-05-12T10:50:01.658363+0000","last_fullsized":"2024-05-12T10:50:01.658363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:18:25.399664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915873+0000","last_change":"2024-05-12T10:49:54.628492+0000","last_active":"2024-05-12T10:50:02.915873+0000","last_peered":"2024-05-12T10:50:02.915873+0000","last_clean":"2024-05-12T10:50:02.915873+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:50:02.915873+0000","last_undegraded":"2024-05-12T10:50:02.915873+0000","last_fullsized":"2024-05-12T10:50:02.915873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:35:38.949401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837763+0000","last_change":"2024-05-12T10:49:59.657783+0000","last_active":"2024-05-12T10:50:02.837763+0000","last_peered":"2024-05-12T10:50:02.837763+0000","last_clean":"2024-05-12T10:50:02.837763+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:50:02.837763+0000","last_undegraded":"2024-05-12T10:50:02.837763+0000","last_fullsized":"2024-05-12T10:50:02.837763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:51:21.103458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921189+0000","last_change":"2024-05-12T10:49:55.646246+0000","last_active":"2024-05-12T10:50:02.921189+0000","last_peered":"2024-05-12T10:50:02.921189+0000","last_clean":"2024-05-12T10:50:02.921189+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:50:02.921189+0000","last_undegraded":"2024-05-12T10:50:02.921189+0000","last_fullsized":"2024-05-12T10:50:02.921189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:32.142128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102403+0000","last_change":"2024-05-12T10:49:54.610076+0000","last_active":"2024-05-12T10:50:02.102403+0000","last_peered":"2024-05-12T10:50:02.102403+0000","last_clean":"2024-05-12T10:50:02.102403+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:50:02.102403+0000","last_undegraded":"2024-05-12T10:50:02.102403+0000","last_fullsized":"2024-05-12T10:50:02.102403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:12:04.400894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657078+0000","last_change":"2024-05-12T10:50:00.386172+0000","last_active":"2024-05-12T10:50:01.657078+0000","last_peered":"2024-05-12T10:50:01.657078+0000","last_clean":"2024-05-12T10:50:01.657078+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:50:01.657078+0000","last_undegraded":"2024-05-12T10:50:01.657078+0000","last_fullsized":"2024-05-12T10:50:01.657078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:06:17.550197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920926+0000","last_change":"2024-05-12T10:49:55.646249+0000","last_active":"2024-05-12T10:50:02.920926+0000","last_peered":"2024-05-12T10:50:02.920926+0000","last_clean":"2024-05-12T10:50:02.920926+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:50:02.920926+0000","last_undegraded":"2024-05-12T10:50:02.920926+0000","last_fullsized":"2024-05-12T10:50:02.920926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:15.036675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660898+0000","last_change":"2024-05-12T10:49:54.621293+0000","last_active":"2024-05-12T10:50:01.660898+0000","last_peered":"2024-05-12T10:50:01.660898+0000","last_clean":"2024-05-12T10:50:01.660898+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:50:01.660898+0000","last_undegraded":"2024-05-12T10:50:01.660898+0000","last_fullsized":"2024-05-12T10:50:01.660898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:45:33.341215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657581+0000","last_change":"2024-05-12T10:49:59.673656+0000","last_active":"2024-05-12T10:50:01.657581+0000","last_peered":"2024-05-12T10:50:01.657581+0000","last_clean":"2024-05-12T10:50:01.657581+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:50:01.657581+0000","last_undegraded":"2024-05-12T10:50:01.657581+0000","last_fullsized":"2024-05-12T10:50:01.657581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:38.364434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919917+0000","last_change":"2024-05-12T10:49:55.646526+0000","last_active":"2024-05-12T10:50:02.919917+0000","last_peered":"2024-05-12T10:50:02.919917+0000","last_clean":"2024-05-12T10:50:02.919917+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:50:02.919917+0000","last_undegraded":"2024-05-12T10:50:02.919917+0000","last_fullsized":"2024-05-12T10:50:02.919917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:56:52.102442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.793829+0000","last_change":"2024-05-12T10:49:54.617906+0000","last_active":"2024-05-12T10:50:29.793829+0000","last_peered":"2024-05-12T10:50:29.793829+0000","last_clean":"2024-05-12T10:50:29.793829+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:50:29.793829+0000","last_undegraded":"2024-05-12T10:50:29.793829+0000","last_fullsized":"2024-05-12T10:50:29.793829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:26:35.150963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837853+0000","last_change":"2024-05-12T10:49:59.671791+0000","last_active":"2024-05-12T10:50:02.837853+0000","last_peered":"2024-05-12T10:50:02.837853+0000","last_clean":"2024-05-12T10:50:02.837853+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:50:02.837853+0000","last_undegraded":"2024-05-12T10:50:02.837853+0000","last_fullsized":"2024-05-12T10:50:02.837853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:27.425708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076017+0000","last_change":"2024-05-12T10:49:55.637810+0000","last_active":"2024-05-12T10:50:02.076017+0000","last_peered":"2024-05-12T10:50:02.076017+0000","last_clean":"2024-05-12T10:50:02.076017+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:50:02.076017+0000","last_undegraded":"2024-05-12T10:50:02.076017+0000","last_fullsized":"2024-05-12T10:50:02.076017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:52.001497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.791060+0000","last_change":"2024-05-12T10:49:54.637728+0000","last_active":"2024-05-12T10:50:29.791060+0000","last_peered":"2024-05-12T10:50:29.791060+0000","last_clean":"2024-05-12T10:50:29.791060+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:50:29.791060+0000","last_undegraded":"2024-05-12T10:50:29.791060+0000","last_fullsized":"2024-05-12T10:50:29.791060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:39.996419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653563+0000","last_change":"2024-05-12T10:50:00.383444+0000","last_active":"2024-05-12T10:50:01.653563+0000","last_peered":"2024-05-12T10:50:01.653563+0000","last_clean":"2024-05-12T10:50:01.653563+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:50:01.653563+0000","last_undegraded":"2024-05-12T10:50:01.653563+0000","last_fullsized":"2024-05-12T10:50:01.653563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:55:04.226848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920128+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:50:02.920128+0000","last_peered":"2024-05-12T10:50:02.920128+0000","last_clean":"2024-05-12T10:50:02.920128+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:50:02.920128+0000","last_undegraded":"2024-05-12T10:50:02.920128+0000","last_fullsized":"2024-05-12T10:50:02.920128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:15:58.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.752272+0000","last_change":"2024-05-12T10:49:54.656814+0000","last_active":"2024-05-12T10:50:23.752272+0000","last_peered":"2024-05-12T10:50:23.752272+0000","last_clean":"2024-05-12T10:50:23.752272+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:50:23.752272+0000","last_undegraded":"2024-05-12T10:50:23.752272+0000","last_fullsized":"2024-05-12T10:50:23.752272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:26.660043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653232+0000","last_change":"2024-05-12T10:50:00.390308+0000","last_active":"2024-05-12T10:50:01.653232+0000","last_peered":"2024-05-12T10:50:01.653232+0000","last_clean":"2024-05-12T10:50:01.653232+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:50:01.653232+0000","last_undegraded":"2024-05-12T10:50:01.653232+0000","last_fullsized":"2024-05-12T10:50:01.653232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:43.650956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837442+0000","last_change":"2024-05-12T10:49:55.628907+0000","last_active":"2024-05-12T10:50:02.837442+0000","last_peered":"2024-05-12T10:50:02.837442+0000","last_clean":"2024-05-12T10:50:02.837442+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:50:02.837442+0000","last_undegraded":"2024-05-12T10:50:02.837442+0000","last_fullsized":"2024-05-12T10:50:02.837442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:13:50.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788848+0000","last_change":"2024-05-12T10:49:54.626002+0000","last_active":"2024-05-12T10:50:29.788848+0000","last_peered":"2024-05-12T10:50:29.788848+0000","last_clean":"2024-05-12T10:50:29.788848+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:50:29.788848+0000","last_undegraded":"2024-05-12T10:50:29.788848+0000","last_fullsized":"2024-05-12T10:50:29.788848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:19:19.976387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659867+0000","last_change":"2024-05-12T10:50:00.387192+0000","last_active":"2024-05-12T10:50:01.659867+0000","last_peered":"2024-05-12T10:50:01.659867+0000","last_clean":"2024-05-12T10:50:01.659867+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:50:01.659867+0000","last_undegraded":"2024-05-12T10:50:01.659867+0000","last_fullsized":"2024-05-12T10:50:01.659867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:15:23.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920487+0000","last_change":"2024-05-12T10:49:55.634551+0000","last_active":"2024-05-12T10:50:02.920487+0000","last_peered":"2024-05-12T10:50:02.920487+0000","last_clean":"2024-05-12T10:50:02.920487+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:50:02.920487+0000","last_undegraded":"2024-05-12T10:50:02.920487+0000","last_fullsized":"2024-05-12T10:50:02.920487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:10:52.477145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.761011+0000","last_change":"2024-05-12T10:49:54.634748+0000","last_active":"2024-05-12T10:50:23.761011+0000","last_peered":"2024-05-12T10:50:23.761011+0000","last_clean":"2024-05-12T10:50:23.761011+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:50:23.761011+0000","last_undegraded":"2024-05-12T10:50:23.761011+0000","last_fullsized":"2024-05-12T10:50:23.761011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:39:16.646133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916160+0000","last_change":"2024-05-12T10:49:59.671405+0000","last_active":"2024-05-12T10:50:02.916160+0000","last_peered":"2024-05-12T10:50:02.916160+0000","last_clean":"2024-05-12T10:50:02.916160+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:50:02.916160+0000","last_undegraded":"2024-05-12T10:50:02.916160+0000","last_fullsized":"2024-05-12T10:50:02.916160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:06:34.170753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659820+0000","last_change":"2024-05-12T10:49:55.634686+0000","last_active":"2024-05-12T10:50:01.659820+0000","last_peered":"2024-05-12T10:50:01.659820+0000","last_clean":"2024-05-12T10:50:01.659820+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:50:01.659820+0000","last_undegraded":"2024-05-12T10:50:01.659820+0000","last_fullsized":"2024-05-12T10:50:01.659820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:25:04.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915954+0000","last_change":"2024-05-12T10:49:54.656012+0000","last_active":"2024-05-12T10:50:02.915954+0000","last_peered":"2024-05-12T10:50:02.915954+0000","last_clean":"2024-05-12T10:50:02.915954+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:50:02.915954+0000","last_undegraded":"2024-05-12T10:50:02.915954+0000","last_fullsized":"2024-05-12T10:50:02.915954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:29.253250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658272+0000","last_change":"2024-05-12T10:49:59.672820+0000","last_active":"2024-05-12T10:50:01.658272+0000","last_peered":"2024-05-12T10:50:01.658272+0000","last_clean":"2024-05-12T10:50:01.658272+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:50:01.658272+0000","last_undegraded":"2024-05-12T10:50:01.658272+0000","last_fullsized":"2024-05-12T10:50:01.658272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:49:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838093+0000","last_change":"2024-05-12T10:49:55.620541+0000","last_active":"2024-05-12T10:50:02.838093+0000","last_peered":"2024-05-12T10:50:02.838093+0000","last_clean":"2024-05-12T10:50:02.838093+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:50:02.838093+0000","last_undegraded":"2024-05-12T10:50:02.838093+0000","last_fullsized":"2024-05-12T10:50:02.838093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:11.742829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.756880+0000","last_change":"2024-05-12T10:49:54.651289+0000","last_active":"2024-05-12T10:50:23.756880+0000","last_peered":"2024-05-12T10:50:23.756880+0000","last_clean":"2024-05-12T10:50:23.756880+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:50:23.756880+0000","last_undegraded":"2024-05-12T10:50:23.756880+0000","last_fullsized":"2024-05-12T10:50:23.756880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:33:24.087763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652523+0000","last_change":"2024-05-12T10:49:59.670973+0000","last_active":"2024-05-12T10:50:01.652523+0000","last_peered":"2024-05-12T10:50:01.652523+0000","last_clean":"2024-05-12T10:50:01.652523+0000","last_became_active":"2024-05-12T10:49:59.670656+0000","last_became_peered":"2024-05-12T10:49:59.670656+0000","last_unstale":"2024-05-12T10:50:01.652523+0000","last_undegraded":"2024-05-12T10:50:01.652523+0000","last_fullsized":"2024-05-12T10:50:01.652523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:16:58.665403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659979+0000","last_change":"2024-05-12T10:49:55.626645+0000","last_active":"2024-05-12T10:50:01.659979+0000","last_peered":"2024-05-12T10:50:01.659979+0000","last_clean":"2024-05-12T10:50:01.659979+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:50:01.659979+0000","last_undegraded":"2024-05-12T10:50:01.659979+0000","last_fullsized":"2024-05-12T10:50:01.659979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:41.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.761019+0000","last_change":"2024-05-12T10:49:54.654822+0000","last_active":"2024-05-12T10:50:23.761019+0000","last_peered":"2024-05-12T10:50:23.761019+0000","last_clean":"2024-05-12T10:50:23.761019+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:50:23.761019+0000","last_undegraded":"2024-05-12T10:50:23.761019+0000","last_fullsized":"2024-05-12T10:50:23.761019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:52:07.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652430+0000","last_change":"2024-05-12T10:50:00.396453+0000","last_active":"2024-05-12T10:50:01.652430+0000","last_peered":"2024-05-12T10:50:01.652430+0000","last_clean":"2024-05-12T10:50:01.652430+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:50:01.652430+0000","last_undegraded":"2024-05-12T10:50:01.652430+0000","last_fullsized":"2024-05-12T10:50:01.652430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:40.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837810+0000","last_change":"2024-05-12T10:50:00.390477+0000","last_active":"2024-05-12T10:50:02.837810+0000","last_peered":"2024-05-12T10:50:02.837810+0000","last_clean":"2024-05-12T10:50:02.837810+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:50:02.837810+0000","last_undegraded":"2024-05-12T10:50:02.837810+0000","last_fullsized":"2024-05-12T10:50:02.837810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:20:19.551216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916112+0000","last_change":"2024-05-12T10:49:55.619984+0000","last_active":"2024-05-12T10:50:02.916112+0000","last_peered":"2024-05-12T10:50:02.916112+0000","last_clean":"2024-05-12T10:50:02.916112+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:50:02.916112+0000","last_undegraded":"2024-05-12T10:50:02.916112+0000","last_fullsized":"2024-05-12T10:50:02.916112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:21:34.136203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658089+0000","last_change":"2024-05-12T10:49:54.656580+0000","last_active":"2024-05-12T10:50:01.658089+0000","last_peered":"2024-05-12T10:50:01.658089+0000","last_clean":"2024-05-12T10:50:01.658089+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:50:01.658089+0000","last_undegraded":"2024-05-12T10:50:01.658089+0000","last_fullsized":"2024-05-12T10:50:01.658089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:43:32.603999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076883+0000","last_change":"2024-05-12T10:49:59.681648+0000","last_active":"2024-05-12T10:50:02.076883+0000","last_peered":"2024-05-12T10:50:02.076883+0000","last_clean":"2024-05-12T10:50:02.076883+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:50:02.076883+0000","last_undegraded":"2024-05-12T10:50:02.076883+0000","last_fullsized":"2024-05-12T10:50:02.076883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:54.912836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652618+0000","last_change":"2024-05-12T10:49:55.617393+0000","last_active":"2024-05-12T10:50:01.652618+0000","last_peered":"2024-05-12T10:50:01.652618+0000","last_clean":"2024-05-12T10:50:01.652618+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:50:01.652618+0000","last_undegraded":"2024-05-12T10:50:01.652618+0000","last_fullsized":"2024-05-12T10:50:01.652618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:51.584695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788252+0000","last_change":"2024-05-12T10:49:54.637393+0000","last_active":"2024-05-12T10:50:29.788252+0000","last_peered":"2024-05-12T10:50:29.788252+0000","last_clean":"2024-05-12T10:50:29.788252+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:50:29.788252+0000","last_undegraded":"2024-05-12T10:50:29.788252+0000","last_fullsized":"2024-05-12T10:50:29.788252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:44:00.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788812+0000","last_change":"2024-05-12T10:49:54.636945+0000","last_active":"2024-05-12T10:50:29.788812+0000","last_peered":"2024-05-12T10:50:29.788812+0000","last_clean":"2024-05-12T10:50:29.788812+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:50:29.788812+0000","last_undegraded":"2024-05-12T10:50:29.788812+0000","last_fullsized":"2024-05-12T10:50:29.788812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:34:25.927458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837878+0000","last_change":"2024-05-12T10:49:55.627105+0000","last_active":"2024-05-12T10:50:02.837878+0000","last_peered":"2024-05-12T10:50:02.837878+0000","last_clean":"2024-05-12T10:50:02.837878+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:50:02.837878+0000","last_undegraded":"2024-05-12T10:50:02.837878+0000","last_fullsized":"2024-05-12T10:50:02.837878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:00:09.334541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102212+0000","last_change":"2024-05-12T10:49:59.659142+0000","last_active":"2024-05-12T10:50:02.102212+0000","last_peered":"2024-05-12T10:50:02.102212+0000","last_clean":"2024-05-12T10:50:02.102212+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:50:02.102212+0000","last_undegraded":"2024-05-12T10:50:02.102212+0000","last_fullsized":"2024-05-12T10:50:02.102212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:40.443593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.755012+0000","last_change":"2024-05-12T10:49:54.632224+0000","last_active":"2024-05-12T10:50:23.755012+0000","last_peered":"2024-05-12T10:50:23.755012+0000","last_clean":"2024-05-12T10:50:23.755012+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:50:23.755012+0000","last_undegraded":"2024-05-12T10:50:23.755012+0000","last_fullsized":"2024-05-12T10:50:23.755012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:27:39.637678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659206+0000","last_change":"2024-05-12T10:49:55.633243+0000","last_active":"2024-05-12T10:50:01.659206+0000","last_peered":"2024-05-12T10:50:01.659206+0000","last_clean":"2024-05-12T10:50:01.659206+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:50:01.659206+0000","last_undegraded":"2024-05-12T10:50:01.659206+0000","last_fullsized":"2024-05-12T10:50:01.659206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:14.239020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652874+0000","last_change":"2024-05-12T10:49:59.655807+0000","last_active":"2024-05-12T10:50:01.652874+0000","last_peered":"2024-05-12T10:50:01.652874+0000","last_clean":"2024-05-12T10:50:01.652874+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:50:01.652874+0000","last_undegraded":"2024-05-12T10:50:01.652874+0000","last_fullsized":"2024-05-12T10:50:01.652874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:12.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075680+0000","last_change":"2024-05-12T10:49:55.637106+0000","last_active":"2024-05-12T10:50:02.075680+0000","last_peered":"2024-05-12T10:50:02.075680+0000","last_clean":"2024-05-12T10:50:02.075680+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:50:02.075680+0000","last_undegraded":"2024-05-12T10:50:02.075680+0000","last_fullsized":"2024-05-12T10:50:02.075680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:22:07.477677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101967+0000","last_change":"2024-05-12T10:49:55.618952+0000","last_active":"2024-05-12T10:50:02.101967+0000","last_peered":"2024-05-12T10:50:02.101967+0000","last_clean":"2024-05-12T10:50:02.101967+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:50:02.101967+0000","last_undegraded":"2024-05-12T10:50:02.101967+0000","last_fullsized":"2024-05-12T10:50:02.101967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:38:10.693066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659549+0000","last_change":"2024-05-12T10:49:55.623916+0000","last_active":"2024-05-12T10:50:01.659549+0000","last_peered":"2024-05-12T10:50:01.659549+0000","last_clean":"2024-05-12T10:50:01.659549+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:50:01.659549+0000","last_undegraded":"2024-05-12T10:50:01.659549+0000","last_fullsized":"2024-05-12T10:50:01.659549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:06:14.434631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837761+0000","last_change":"2024-05-12T10:49:55.620278+0000","last_active":"2024-05-12T10:50:02.837761+0000","last_peered":"2024-05-12T10:50:02.837761+0000","last_clean":"2024-05-12T10:50:02.837761+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:50:02.837761+0000","last_undegraded":"2024-05-12T10:50:02.837761+0000","last_fullsized":"2024-05-12T10:50:02.837761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:59.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653439+0000","last_change":"2024-05-12T10:49:55.626216+0000","last_active":"2024-05-12T10:50:01.653439+0000","last_peered":"2024-05-12T10:50:01.653439+0000","last_clean":"2024-05-12T10:50:01.653439+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:50:01.653439+0000","last_undegraded":"2024-05-12T10:50:01.653439+0000","last_fullsized":"2024-05-12T10:50:01.653439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:52:14.438331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916463+0000","last_change":"2024-05-12T10:49:55.622085+0000","last_active":"2024-05-12T10:50:02.916463+0000","last_peered":"2024-05-12T10:50:02.916463+0000","last_clean":"2024-05-12T10:50:02.916463+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:50:02.916463+0000","last_undegraded":"2024-05-12T10:50:02.916463+0000","last_fullsized":"2024-05-12T10:50:02.916463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:41:42.558506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076984+0000","last_change":"2024-05-12T10:49:55.635592+0000","last_active":"2024-05-12T10:50:02.076984+0000","last_peered":"2024-05-12T10:50:02.076984+0000","last_clean":"2024-05-12T10:50:02.076984+0000","last_became_active":"2024-05-12T10:49:55.635298+0000","last_became_peered":"2024-05-12T10:49:55.635298+0000","last_unstale":"2024-05-12T10:50:02.076984+0000","last_undegraded":"2024-05-12T10:50:02.076984+0000","last_fullsized":"2024-05-12T10:50:02.076984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:43:14.781372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653476+0000","last_change":"2024-05-12T10:49:55.626353+0000","last_active":"2024-05-12T10:50:01.653476+0000","last_peered":"2024-05-12T10:50:01.653476+0000","last_clean":"2024-05-12T10:50:01.653476+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:50:01.653476+0000","last_undegraded":"2024-05-12T10:50:01.653476+0000","last_fullsized":"2024-05-12T10:50:01.653476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:58.905284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657725+0000","last_change":"2024-05-12T10:49:55.621110+0000","last_active":"2024-05-12T10:50:01.657725+0000","last_peered":"2024-05-12T10:50:01.657725+0000","last_clean":"2024-05-12T10:50:01.657725+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:50:01.657725+0000","last_undegraded":"2024-05-12T10:50:01.657725+0000","last_fullsized":"2024-05-12T10:50:01.657725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:12:36.369923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652483+0000","last_change":"2024-05-12T10:49:55.626913+0000","last_active":"2024-05-12T10:50:01.652483+0000","last_peered":"2024-05-12T10:50:01.652483+0000","last_clean":"2024-05-12T10:50:01.652483+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:50:01.652483+0000","last_undegraded":"2024-05-12T10:50:01.652483+0000","last_fullsized":"2024-05-12T10:50:01.652483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:27:08.492294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659499+0000","last_change":"2024-05-12T10:49:55.629992+0000","last_active":"2024-05-12T10:50:01.659499+0000","last_peered":"2024-05-12T10:50:01.659499+0000","last_clean":"2024-05-12T10:50:01.659499+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:50:01.659499+0000","last_undegraded":"2024-05-12T10:50:01.659499+0000","last_fullsized":"2024-05-12T10:50:01.659499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:31.454363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837524+0000","last_change":"2024-05-12T10:49:55.620821+0000","last_active":"2024-05-12T10:50:02.837524+0000","last_peered":"2024-05-12T10:50:02.837524+0000","last_clean":"2024-05-12T10:50:02.837524+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:50:02.837524+0000","last_undegraded":"2024-05-12T10:50:02.837524+0000","last_fullsized":"2024-05-12T10:50:02.837524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:53.597215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076297+0000","last_change":"2024-05-12T10:49:55.646368+0000","last_active":"2024-05-12T10:50:02.076297+0000","last_peered":"2024-05-12T10:50:02.076297+0000","last_clean":"2024-05-12T10:50:02.076297+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:50:02.076297+0000","last_undegraded":"2024-05-12T10:50:02.076297+0000","last_fullsized":"2024-05-12T10:50:02.076297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:21:04.313921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920866+0000","last_change":"2024-05-12T10:49:55.633122+0000","last_active":"2024-05-12T10:50:02.920866+0000","last_peered":"2024-05-12T10:50:02.920866+0000","last_clean":"2024-05-12T10:50:02.920866+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:50:02.920866+0000","last_undegraded":"2024-05-12T10:50:02.920866+0000","last_fullsized":"2024-05-12T10:50:02.920866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:25:19.563648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102362+0000","last_change":"2024-05-12T10:49:55.635394+0000","last_active":"2024-05-12T10:50:02.102362+0000","last_peered":"2024-05-12T10:50:02.102362+0000","last_clean":"2024-05-12T10:50:02.102362+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:50:02.102362+0000","last_undegraded":"2024-05-12T10:50:02.102362+0000","last_fullsized":"2024-05-12T10:50:02.102362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:41:58.478292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660761+0000","last_change":"2024-05-12T10:49:55.626485+0000","last_active":"2024-05-12T10:50:01.660761+0000","last_peered":"2024-05-12T10:50:01.660761+0000","last_clean":"2024-05-12T10:50:01.660761+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:50:01.660761+0000","last_undegraded":"2024-05-12T10:50:01.660761+0000","last_fullsized":"2024-05-12T10:50:01.660761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:17.942339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657391+0000","last_change":"2024-05-12T10:49:55.618820+0000","last_active":"2024-05-12T10:50:01.657391+0000","last_peered":"2024-05-12T10:50:01.657391+0000","last_clean":"2024-05-12T10:50:01.657391+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:50:01.657391+0000","last_undegraded":"2024-05-12T10:50:01.657391+0000","last_fullsized":"2024-05-12T10:50:01.657391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:23:00.474438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916163+0000","last_change":"2024-05-12T10:49:55.626429+0000","last_active":"2024-05-12T10:50:02.916163+0000","last_peered":"2024-05-12T10:50:02.916163+0000","last_clean":"2024-05-12T10:50:02.916163+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:50:02.916163+0000","last_undegraded":"2024-05-12T10:50:02.916163+0000","last_fullsized":"2024-05-12T10:50:02.916163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:40:02.709729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837421+0000","last_change":"2024-05-12T10:49:55.612139+0000","last_active":"2024-05-12T10:50:02.837421+0000","last_peered":"2024-05-12T10:50:02.837421+0000","last_clean":"2024-05-12T10:50:02.837421+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:50:02.837421+0000","last_undegraded":"2024-05-12T10:50:02.837421+0000","last_fullsized":"2024-05-12T10:50:02.837421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:57:34.138392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652690+0000","last_change":"2024-05-12T10:49:55.631137+0000","last_active":"2024-05-12T10:50:01.652690+0000","last_peered":"2024-05-12T10:50:01.652690+0000","last_clean":"2024-05-12T10:50:01.652690+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:50:01.652690+0000","last_undegraded":"2024-05-12T10:50:01.652690+0000","last_fullsized":"2024-05-12T10:50:01.652690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:04.390314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659797+0000","last_change":"2024-05-12T10:49:55.643416+0000","last_active":"2024-05-12T10:50:01.659797+0000","last_peered":"2024-05-12T10:50:01.659797+0000","last_clean":"2024-05-12T10:50:01.659797+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:50:01.659797+0000","last_undegraded":"2024-05-12T10:50:01.659797+0000","last_fullsized":"2024-05-12T10:50:01.659797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:58.632966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076802+0000","last_change":"2024-05-12T10:49:55.635847+0000","last_active":"2024-05-12T10:50:02.076802+0000","last_peered":"2024-05-12T10:50:02.076802+0000","last_clean":"2024-05-12T10:50:02.076802+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:50:02.076802+0000","last_undegraded":"2024-05-12T10:50:02.076802+0000","last_fullsized":"2024-05-12T10:50:02.076802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:57:51.222099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076561+0000","last_change":"2024-05-12T10:49:55.641921+0000","last_active":"2024-05-12T10:50:02.076561+0000","last_peered":"2024-05-12T10:50:02.076561+0000","last_clean":"2024-05-12T10:50:02.076561+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:50:02.076561+0000","last_undegraded":"2024-05-12T10:50:02.076561+0000","last_fullsized":"2024-05-12T10:50:02.076561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:44:57.787358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921179+0000","last_change":"2024-05-12T10:49:55.635853+0000","last_active":"2024-05-12T10:50:02.921179+0000","last_peered":"2024-05-12T10:50:02.921179+0000","last_clean":"2024-05-12T10:50:02.921179+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:50:02.921179+0000","last_undegraded":"2024-05-12T10:50:02.921179+0000","last_fullsized":"2024-05-12T10:50:02.921179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:04:39.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652297+0000","last_change":"2024-05-12T10:49:55.620107+0000","last_active":"2024-05-12T10:50:01.652297+0000","last_peered":"2024-05-12T10:50:01.652297+0000","last_clean":"2024-05-12T10:50:01.652297+0000","last_became_active":"2024-05-12T10:49:55.619802+0000","last_became_peered":"2024-05-12T10:49:55.619802+0000","last_unstale":"2024-05-12T10:50:01.652297+0000","last_undegraded":"2024-05-12T10:50:01.652297+0000","last_fullsized":"2024-05-12T10:50:01.652297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:52:39.033778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920076+0000","last_change":"2024-05-12T10:49:55.629001+0000","last_active":"2024-05-12T10:50:02.920076+0000","last_peered":"2024-05-12T10:50:02.920076+0000","last_clean":"2024-05-12T10:50:02.920076+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:50:02.920076+0000","last_undegraded":"2024-05-12T10:50:02.920076+0000","last_fullsized":"2024-05-12T10:50:02.920076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:42:39.042271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659136+0000","last_change":"2024-05-12T10:49:55.625540+0000","last_active":"2024-05-12T10:50:01.659136+0000","last_peered":"2024-05-12T10:50:01.659136+0000","last_clean":"2024-05-12T10:50:01.659136+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:50:01.659136+0000","last_undegraded":"2024-05-12T10:50:01.659136+0000","last_fullsized":"2024-05-12T10:50:01.659136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:35.621918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919665+0000","last_change":"2024-05-12T10:49:55.633576+0000","last_active":"2024-05-12T10:50:02.919665+0000","last_peered":"2024-05-12T10:50:02.919665+0000","last_clean":"2024-05-12T10:50:02.919665+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:50:02.919665+0000","last_undegraded":"2024-05-12T10:50:02.919665+0000","last_fullsized":"2024-05-12T10:50:02.919665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:06:16.255147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657885+0000","last_change":"2024-05-12T10:49:55.624205+0000","last_active":"2024-05-12T10:50:01.657885+0000","last_peered":"2024-05-12T10:50:01.657885+0000","last_clean":"2024-05-12T10:50:01.657885+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:50:01.657885+0000","last_undegraded":"2024-05-12T10:50:01.657885+0000","last_fullsized":"2024-05-12T10:50:01.657885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:21.895269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837757+0000","last_change":"2024-05-12T10:49:55.610461+0000","last_active":"2024-05-12T10:50:02.837757+0000","last_peered":"2024-05-12T10:50:02.837757+0000","last_clean":"2024-05-12T10:50:02.837757+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:50:02.837757+0000","last_undegraded":"2024-05-12T10:50:02.837757+0000","last_fullsized":"2024-05-12T10:50:02.837757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:44.511895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916628+0000","last_change":"2024-05-12T10:49:55.608434+0000","last_active":"2024-05-12T10:50:02.916628+0000","last_peered":"2024-05-12T10:50:02.916628+0000","last_clean":"2024-05-12T10:50:02.916628+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:50:02.916628+0000","last_undegraded":"2024-05-12T10:50:02.916628+0000","last_fullsized":"2024-05-12T10:50:02.916628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:17.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920943+0000","last_change":"2024-05-12T10:49:55.639296+0000","last_active":"2024-05-12T10:50:02.920943+0000","last_peered":"2024-05-12T10:50:02.920943+0000","last_clean":"2024-05-12T10:50:02.920943+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:50:02.920943+0000","last_undegraded":"2024-05-12T10:50:02.920943+0000","last_fullsized":"2024-05-12T10:50:02.920943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:47:15.862328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":888832,"data_stored":702380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":112074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":111410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":115250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":111514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":111640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":701724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:50:38.205 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:50:38.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.380+0000 7f7e7aa00640 1 Processor -- start 2024-05-12T10:50:38.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.380+0000 7f7e7aa00640 1 -- start start 2024-05-12T10:50:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e7aa00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74155d90 0x7f7e74068250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e7aa00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e740cb5e0 con 0x7f7e74156170 2024-05-12T10:50:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e7aa00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e741600e0 con 0x7f7e740c9450 2024-05-12T10:50:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e7aa00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7e740cc4b0 con 0x7f7e74155d90 2024-05-12T10:50:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e6b400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7e74156170 0x7f7e740c8d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50692/0 (socket says 172.21.15.115:50692) 2024-05-12T10:50:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e6b400640 1 -- 172.21.15.115:0/1190018282 learned_addr learned my addr 172.21.15.115:0/1190018282 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:38.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73e00640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74155d90 0x7f7e74068250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275492570 0 0) 0x7f7e740cb5e0 con 0x7f7e74156170 2024-05-12T10:50:38.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e58003530 con 0x7f7e74156170 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 637941257 0 0) 0x7f7e58003530 con 0x7f7e74156170 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74155d90 msgr2=0x7f7e74068250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74155d90 0x7f7e74068250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 >> v1:172.21.15.134:6789/0 conn(0x7f7e740c9450 legacy=0x7f7e7415f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e740cc700 con 0x7f7e74156170 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f7e5c001700 con 0x7f7e74156170 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 >> v1:172.21.15.115:6789/0 conn(0x7f7e74156170 legacy=0x7f7e740c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e580039f0 0x7f7e58003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58004810 0x7f7e58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74155d90 0x7f7e580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7e740cc4b0 con 0x7f7e58004810 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5800ba80 con 0x7f7e580039f0 2024-05-12T10:50:38.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5800bc80 con 0x7f7e74155d90 2024-05-12T10:50:38.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e6b400640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58004810 0x7f7e58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73e00640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e580039f0 0x7f7e58003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e78a00640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74155d90 0x7f7e580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e6b400640 1 -- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74155d90 msgr2=0x7f7e580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:38.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e6b400640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74155d90 0x7f7e580051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e6b400640 1 -- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e580039f0 msgr2=0x7f7e58003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:38.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e6b400640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e580039f0 0x7f7e58003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e6b400640 1 -- 172.21.15.115:0/1190018282 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e58003530 con 0x7f7e58004810 2024-05-12T10:50:38.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.384+0000 7f7e73e00640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e580039f0 0x7f7e58003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e6b400640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58004810 0x7f7e58004c90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00c210 tx=0x7f7e5c01f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05cbf0670924d79 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c007d20 con 0x7f7e58004810 2024-05-12T10:50:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5c005ae0 con 0x7f7e58004810 2024-05-12T10:50:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e73400640 1 -- 172.21.15.115:0/1190018282 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c007070 con 0x7f7e58004810 2024-05-12T10:50:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1190018282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58004810 msgr2=0x7f7e58004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e7aa00640 1 --2- 172.21.15.115:0/1190018282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58004810 0x7f7e58004c90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00c210 tx=0x7f7e5c01f310 comp rx=0 tx=0).stop 2024-05-12T10:50:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e78a00640 1 -- 172.21.15.115:0/1190018282 reap_dead start 2024-05-12T10:50:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1190018282 shutdown_connections 2024-05-12T10:50:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1190018282 >> 172.21.15.115:0/1190018282 conn(0x7f7e740ca7a0 msgr2=0x7f7e740cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1190018282 shutdown_connections 2024-05-12T10:50:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1190018282 wait complete. 2024-05-12T10:50:38.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e7aa00640 1 Processor -- start 2024-05-12T10:50:38.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.388+0000 7f7e7aa00640 1 -- start start 2024-05-12T10:50:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e7aa00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e58004810 0x7f7e7414ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e7aa00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74146340 0x7f7e741481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e7aa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e741469f0 0x7f7e74148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e7aa00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74068250 con 0x7f7e741469f0 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e7aa00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7e740c8820 con 0x7f7e58004810 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e7aa00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7e740683d0 con 0x7f7e74146340 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e78a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e741469f0 0x7f7e74148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e78a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e741469f0 0x7f7e74148710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60932/0 (socket says 172.21.15.115:60932) 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e78a00640 1 -- 172.21.15.115:0/1739709586 learned_addr learned my addr 172.21.15.115:0/1739709586 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e73e00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e58004810 0x7f7e7414ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e6b400640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74146340 0x7f7e741481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e78a00640 1 -- 172.21.15.115:0/1739709586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74146340 msgr2=0x7f7e741481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e78a00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74146340 0x7f7e741481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e78a00640 1 -- 172.21.15.115:0/1739709586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e58004810 msgr2=0x7f7e7414ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e78a00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e58004810 0x7f7e7414ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e78a00640 1 -- 172.21.15.115:0/1739709586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e740c4390 con 0x7f7e741469f0 2024-05-12T10:50:38.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e78a00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e741469f0 0x7f7e74148710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e740c98b0 tx=0x7f7e6c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:38.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e70c00640 1 -- 172.21.15.115:0/1739709586 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c006b60 con 0x7f7e741469f0 2024-05-12T10:50:38.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e70c00640 1 -- 172.21.15.115:0/1739709586 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6c006d20 con 0x7f7e741469f0 2024-05-12T10:50:38.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e70c00640 1 -- 172.21.15.115:0/1739709586 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c003980 con 0x7f7e741469f0 2024-05-12T10:50:38.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1739709586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e741f1680 con 0x7f7e741469f0 2024-05-12T10:50:38.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1739709586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e741f1c00 con 0x7f7e741469f0 2024-05-12T10:50:38.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.392+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1739709586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e74069730 con 0x7f7e741469f0 2024-05-12T10:50:38.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.396+0000 7f7e70c00640 1 -- 172.21.15.115:0/1739709586 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7e6c01a030 con 0x7f7e741469f0 2024-05-12T10:50:38.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.396+0000 7f7e70c00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7e5006f430 0x7f7e500718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.396+0000 7f7e70c00640 1 -- 172.21.15.115:0/1739709586 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f7e6c08ed30 con 0x7f7e741469f0 2024-05-12T10:50:38.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.396+0000 7f7e73e00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7e5006f430 0x7f7e500718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.396+0000 7f7e73e00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7e5006f430 0x7f7e500718f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009ab0 tx=0x7f7e64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:38.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.400+0000 7f7e70c00640 1 -- 172.21.15.115:0/1739709586 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7e6c021020 con 0x7f7e741469f0 2024-05-12T10:50:38.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.552+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1739709586 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e7406f970 con 0x7f7e5006f430 2024-05-12T10:50:38.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.560+0000 7f7e70c00640 1 -- 172.21.15.115:0/1739709586 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332698 (secure 0 0 0) 0x7f7e7406f970 con 0x7f7e5006f430 2024-05-12T10:50:38.561 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:38.563 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:50:38.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1739709586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7e5006f430 msgr2=0x7f7e500718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7e5006f430 0x7f7e500718f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009ab0 tx=0x7f7e64008040 comp rx=0 tx=0).stop 2024-05-12T10:50:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1739709586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e741469f0 msgr2=0x7f7e74148710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e741469f0 0x7f7e74148710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e740c98b0 tx=0x7f7e6c00eb90 comp rx=0 tx=0).stop 2024-05-12T10:50:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1739709586 shutdown_connections 2024-05-12T10:50:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f7e5006f430 0x7f7e500718f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e741469f0 0x7f7e74148710 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7e74146340 0x7f7e741481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 --2- 172.21.15.115:0/1739709586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e58004810 0x7f7e7414ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1739709586 >> 172.21.15.115:0/1739709586 conn(0x7f7e740ca7a0 msgr2=0x7f7e740c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1739709586 shutdown_connections 2024-05-12T10:50:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.564+0000 7f7e7aa00640 1 -- 172.21.15.115:0/1739709586 wait complete. 2024-05-12T10:50:38.581 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-05-12T10:50:37.762344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":228,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219592,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755128,"statfs":{"total":773094113280,"available":772869251072,"internally_reserved":0,"allocated":3547136,"data_stored":2081208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002022"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.793391+0000","last_change":"2024-05-12T10:49:54.640093+0000","last_active":"2024-05-12T10:50:29.793391+0000","last_peered":"2024-05-12T10:50:29.793391+0000","last_clean":"2024-05-12T10:50:29.793391+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:50:29.793391+0000","last_undegraded":"2024-05-12T10:50:29.793391+0000","last_fullsized":"2024-05-12T10:50:29.793391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:07:41.639104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653116+0000","last_change":"2024-05-12T10:49:55.635928+0000","last_active":"2024-05-12T10:50:01.653116+0000","last_peered":"2024-05-12T10:50:01.653116+0000","last_clean":"2024-05-12T10:50:01.653116+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:50:01.653116+0000","last_undegraded":"2024-05-12T10:50:01.653116+0000","last_fullsized":"2024-05-12T10:50:01.653116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:41:30.909036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652376+0000","last_change":"2024-05-12T10:50:00.396417+0000","last_active":"2024-05-12T10:50:01.652376+0000","last_peered":"2024-05-12T10:50:01.652376+0000","last_clean":"2024-05-12T10:50:01.652376+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:50:01.652376+0000","last_undegraded":"2024-05-12T10:50:01.652376+0000","last_fullsized":"2024-05-12T10:50:01.652376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:27.287617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653361+0000","last_change":"2024-05-12T10:49:54.619268+0000","last_active":"2024-05-12T10:50:01.653361+0000","last_peered":"2024-05-12T10:50:01.653361+0000","last_clean":"2024-05-12T10:50:01.653361+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:50:01.653361+0000","last_undegraded":"2024-05-12T10:50:01.653361+0000","last_fullsized":"2024-05-12T10:50:01.653361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:50:34.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837930+0000","last_change":"2024-05-12T10:49:55.624986+0000","last_active":"2024-05-12T10:50:02.837930+0000","last_peered":"2024-05-12T10:50:02.837930+0000","last_clean":"2024-05-12T10:50:02.837930+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:50:02.837930+0000","last_undegraded":"2024-05-12T10:50:02.837930+0000","last_fullsized":"2024-05-12T10:50:02.837930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:03:47.220979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657155+0000","last_change":"2024-05-12T10:49:59.676139+0000","last_active":"2024-05-12T10:50:01.657155+0000","last_peered":"2024-05-12T10:50:01.657155+0000","last_clean":"2024-05-12T10:50:01.657155+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:50:01.657155+0000","last_undegraded":"2024-05-12T10:50:01.657155+0000","last_fullsized":"2024-05-12T10:50:01.657155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:24:15.396258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788919+0000","last_change":"2024-05-12T10:49:54.645331+0000","last_active":"2024-05-12T10:50:29.788919+0000","last_peered":"2024-05-12T10:50:29.788919+0000","last_clean":"2024-05-12T10:50:29.788919+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:50:29.788919+0000","last_undegraded":"2024-05-12T10:50:29.788919+0000","last_fullsized":"2024-05-12T10:50:29.788919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:38:29.023589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658144+0000","last_change":"2024-05-12T10:49:55.642386+0000","last_active":"2024-05-12T10:50:01.658144+0000","last_peered":"2024-05-12T10:50:01.658144+0000","last_clean":"2024-05-12T10:50:01.658144+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:50:01.658144+0000","last_undegraded":"2024-05-12T10:50:01.658144+0000","last_fullsized":"2024-05-12T10:50:01.658144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:54:40.153070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657964+0000","last_change":"2024-05-12T10:49:59.679887+0000","last_active":"2024-05-12T10:50:01.657964+0000","last_peered":"2024-05-12T10:50:01.657964+0000","last_clean":"2024-05-12T10:50:01.657964+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:50:01.657964+0000","last_undegraded":"2024-05-12T10:50:01.657964+0000","last_fullsized":"2024-05-12T10:50:01.657964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:25:43.004918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919021+0000","last_change":"2024-05-12T10:49:54.659229+0000","last_active":"2024-05-12T10:50:02.919021+0000","last_peered":"2024-05-12T10:50:02.919021+0000","last_clean":"2024-05-12T10:50:02.919021+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:50:02.919021+0000","last_undegraded":"2024-05-12T10:50:02.919021+0000","last_fullsized":"2024-05-12T10:50:02.919021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:54:54.658165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660005+0000","last_change":"2024-05-12T10:49:55.642157+0000","last_active":"2024-05-12T10:50:01.660005+0000","last_peered":"2024-05-12T10:50:01.660005+0000","last_clean":"2024-05-12T10:50:01.660005+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:50:01.660005+0000","last_undegraded":"2024-05-12T10:50:01.660005+0000","last_fullsized":"2024-05-12T10:50:01.660005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:16.232731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658776+0000","last_change":"2024-05-12T10:49:59.663411+0000","last_active":"2024-05-12T10:50:01.658776+0000","last_peered":"2024-05-12T10:50:01.658776+0000","last_clean":"2024-05-12T10:50:01.658776+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:50:01.658776+0000","last_undegraded":"2024-05-12T10:50:01.658776+0000","last_fullsized":"2024-05-12T10:50:01.658776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:59.136704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075711+0000","last_change":"2024-05-12T10:49:55.646019+0000","last_active":"2024-05-12T10:50:02.075711+0000","last_peered":"2024-05-12T10:50:02.075711+0000","last_clean":"2024-05-12T10:50:02.075711+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:50:02.075711+0000","last_undegraded":"2024-05-12T10:50:02.075711+0000","last_fullsized":"2024-05-12T10:50:02.075711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:07.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.753731+0000","last_change":"2024-05-12T10:49:54.642039+0000","last_active":"2024-05-12T10:50:23.753731+0000","last_peered":"2024-05-12T10:50:23.753731+0000","last_clean":"2024-05-12T10:50:23.753731+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:50:23.753731+0000","last_undegraded":"2024-05-12T10:50:23.753731+0000","last_fullsized":"2024-05-12T10:50:23.753731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:01.155569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660588+0000","last_change":"2024-05-12T10:49:59.660274+0000","last_active":"2024-05-12T10:50:01.660588+0000","last_peered":"2024-05-12T10:50:01.660588+0000","last_clean":"2024-05-12T10:50:01.660588+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:50:01.660588+0000","last_undegraded":"2024-05-12T10:50:01.660588+0000","last_fullsized":"2024-05-12T10:50:01.660588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:55:12.579645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652722+0000","last_change":"2024-05-12T10:49:55.618128+0000","last_active":"2024-05-12T10:50:01.652722+0000","last_peered":"2024-05-12T10:50:01.652722+0000","last_clean":"2024-05-12T10:50:01.652722+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:50:01.652722+0000","last_undegraded":"2024-05-12T10:50:01.652722+0000","last_fullsized":"2024-05-12T10:50:01.652722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:45.205117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915890+0000","last_change":"2024-05-12T10:49:54.619967+0000","last_active":"2024-05-12T10:50:02.915890+0000","last_peered":"2024-05-12T10:50:02.915890+0000","last_clean":"2024-05-12T10:50:02.915890+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:50:02.915890+0000","last_undegraded":"2024-05-12T10:50:02.915890+0000","last_fullsized":"2024-05-12T10:50:02.915890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:37:10.799631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659650+0000","last_change":"2024-05-12T10:49:59.681931+0000","last_active":"2024-05-12T10:50:01.659650+0000","last_peered":"2024-05-12T10:50:01.659650+0000","last_clean":"2024-05-12T10:50:01.659650+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:50:01.659650+0000","last_undegraded":"2024-05-12T10:50:01.659650+0000","last_fullsized":"2024-05-12T10:50:01.659650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:45:01.542628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652721+0000","last_change":"2024-05-12T10:49:55.615095+0000","last_active":"2024-05-12T10:50:01.652721+0000","last_peered":"2024-05-12T10:50:01.652721+0000","last_clean":"2024-05-12T10:50:01.652721+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:50:01.652721+0000","last_undegraded":"2024-05-12T10:50:01.652721+0000","last_fullsized":"2024-05-12T10:50:01.652721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:51:19.659941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.756016+0000","last_change":"2024-05-12T10:49:54.639976+0000","last_active":"2024-05-12T10:50:23.756016+0000","last_peered":"2024-05-12T10:50:23.756016+0000","last_clean":"2024-05-12T10:50:23.756016+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:50:23.756016+0000","last_undegraded":"2024-05-12T10:50:23.756016+0000","last_fullsized":"2024-05-12T10:50:23.756016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:28:37.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916755+0000","last_change":"2024-05-12T10:50:00.390786+0000","last_active":"2024-05-12T10:50:02.916755+0000","last_peered":"2024-05-12T10:50:02.916755+0000","last_clean":"2024-05-12T10:50:02.916755+0000","last_became_active":"2024-05-12T10:50:00.390378+0000","last_became_peered":"2024-05-12T10:50:00.390378+0000","last_unstale":"2024-05-12T10:50:02.916755+0000","last_undegraded":"2024-05-12T10:50:02.916755+0000","last_fullsized":"2024-05-12T10:50:02.916755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:27:57.945259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658891+0000","last_change":"2024-05-12T10:49:55.622729+0000","last_active":"2024-05-12T10:50:01.658891+0000","last_peered":"2024-05-12T10:50:01.658891+0000","last_clean":"2024-05-12T10:50:01.658891+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:50:01.658891+0000","last_undegraded":"2024-05-12T10:50:01.658891+0000","last_fullsized":"2024-05-12T10:50:01.658891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:08:29.460684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.758471+0000","last_change":"2024-05-12T10:49:54.639564+0000","last_active":"2024-05-12T10:50:23.758471+0000","last_peered":"2024-05-12T10:50:23.758471+0000","last_clean":"2024-05-12T10:50:23.758471+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:50:23.758471+0000","last_undegraded":"2024-05-12T10:50:23.758471+0000","last_fullsized":"2024-05-12T10:50:23.758471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:54:48.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.661417+0000","last_change":"2024-05-12T10:49:59.676220+0000","last_active":"2024-05-12T10:50:01.661417+0000","last_peered":"2024-05-12T10:50:01.661417+0000","last_clean":"2024-05-12T10:50:01.661417+0000","last_became_active":"2024-05-12T10:49:59.674835+0000","last_became_peered":"2024-05-12T10:49:59.674835+0000","last_unstale":"2024-05-12T10:50:01.661417+0000","last_undegraded":"2024-05-12T10:50:01.661417+0000","last_fullsized":"2024-05-12T10:50:01.661417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:55:03.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838015+0000","last_change":"2024-05-12T10:49:55.612744+0000","last_active":"2024-05-12T10:50:02.838015+0000","last_peered":"2024-05-12T10:50:02.838015+0000","last_clean":"2024-05-12T10:50:02.838015+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:50:02.838015+0000","last_undegraded":"2024-05-12T10:50:02.838015+0000","last_fullsized":"2024-05-12T10:50:02.838015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:05:06.274277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.758768+0000","last_change":"2024-05-12T10:49:54.643375+0000","last_active":"2024-05-12T10:50:23.758768+0000","last_peered":"2024-05-12T10:50:23.758768+0000","last_clean":"2024-05-12T10:50:23.758768+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:50:23.758768+0000","last_undegraded":"2024-05-12T10:50:23.758768+0000","last_fullsized":"2024-05-12T10:50:23.758768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:56:43.086871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658181+0000","last_change":"2024-05-12T10:50:00.393325+0000","last_active":"2024-05-12T10:50:01.658181+0000","last_peered":"2024-05-12T10:50:01.658181+0000","last_clean":"2024-05-12T10:50:01.658181+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:50:01.658181+0000","last_undegraded":"2024-05-12T10:50:01.658181+0000","last_fullsized":"2024-05-12T10:50:01.658181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:55.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653561+0000","last_change":"2024-05-12T10:49:55.629693+0000","last_active":"2024-05-12T10:50:01.653561+0000","last_peered":"2024-05-12T10:50:01.653561+0000","last_clean":"2024-05-12T10:50:01.653561+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:50:01.653561+0000","last_undegraded":"2024-05-12T10:50:01.653561+0000","last_fullsized":"2024-05-12T10:50:01.653561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:04:13.325079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.790340+0000","last_change":"2024-05-12T10:49:54.629227+0000","last_active":"2024-05-12T10:50:29.790340+0000","last_peered":"2024-05-12T10:50:29.790340+0000","last_clean":"2024-05-12T10:50:29.790340+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:50:29.790340+0000","last_undegraded":"2024-05-12T10:50:29.790340+0000","last_fullsized":"2024-05-12T10:50:29.790340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:03.097527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652367+0000","last_change":"2024-05-12T10:50:00.396371+0000","last_active":"2024-05-12T10:50:01.652367+0000","last_peered":"2024-05-12T10:50:01.652367+0000","last_clean":"2024-05-12T10:50:01.652367+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:50:01.652367+0000","last_undegraded":"2024-05-12T10:50:01.652367+0000","last_fullsized":"2024-05-12T10:50:01.652367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:41:09.157859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916505+0000","last_change":"2024-05-12T10:49:55.612069+0000","last_active":"2024-05-12T10:50:02.916505+0000","last_peered":"2024-05-12T10:50:02.916505+0000","last_clean":"2024-05-12T10:50:02.916505+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:50:02.916505+0000","last_undegraded":"2024-05-12T10:50:02.916505+0000","last_fullsized":"2024-05-12T10:50:02.916505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:38.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921127+0000","last_change":"2024-05-12T10:49:54.639928+0000","last_active":"2024-05-12T10:50:02.921127+0000","last_peered":"2024-05-12T10:50:02.921127+0000","last_clean":"2024-05-12T10:50:02.921127+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:50:02.921127+0000","last_undegraded":"2024-05-12T10:50:02.921127+0000","last_fullsized":"2024-05-12T10:50:02.921127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:59.215089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837562+0000","last_change":"2024-05-12T10:50:00.383605+0000","last_active":"2024-05-12T10:50:02.837562+0000","last_peered":"2024-05-12T10:50:02.837562+0000","last_clean":"2024-05-12T10:50:02.837562+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:50:02.837562+0000","last_undegraded":"2024-05-12T10:50:02.837562+0000","last_fullsized":"2024-05-12T10:50:02.837562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:28.619988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660251+0000","last_change":"2024-05-12T10:49:55.621201+0000","last_active":"2024-05-12T10:50:01.660251+0000","last_peered":"2024-05-12T10:50:01.660251+0000","last_clean":"2024-05-12T10:50:01.660251+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:50:01.660251+0000","last_undegraded":"2024-05-12T10:50:01.660251+0000","last_fullsized":"2024-05-12T10:50:01.660251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:19:39.117790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916601+0000","last_change":"2024-05-12T10:49:54.620329+0000","last_active":"2024-05-12T10:50:02.916601+0000","last_peered":"2024-05-12T10:50:02.916601+0000","last_clean":"2024-05-12T10:50:02.916601+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:50:02.916601+0000","last_undegraded":"2024-05-12T10:50:02.916601+0000","last_fullsized":"2024-05-12T10:50:02.916601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:21:10.386830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916162+0000","last_change":"2024-05-12T10:49:59.655432+0000","last_active":"2024-05-12T10:50:02.916162+0000","last_peered":"2024-05-12T10:50:02.916162+0000","last_clean":"2024-05-12T10:50:02.916162+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:50:02.916162+0000","last_undegraded":"2024-05-12T10:50:02.916162+0000","last_fullsized":"2024-05-12T10:50:02.916162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:27:34.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658413+0000","last_change":"2024-05-12T10:49:55.628221+0000","last_active":"2024-05-12T10:50:01.658413+0000","last_peered":"2024-05-12T10:50:01.658413+0000","last_clean":"2024-05-12T10:50:01.658413+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:50:01.658413+0000","last_undegraded":"2024-05-12T10:50:01.658413+0000","last_fullsized":"2024-05-12T10:50:01.658413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:54.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659956+0000","last_change":"2024-05-12T10:49:54.652499+0000","last_active":"2024-05-12T10:50:01.659956+0000","last_peered":"2024-05-12T10:50:01.659956+0000","last_clean":"2024-05-12T10:50:01.659956+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:50:01.659956+0000","last_undegraded":"2024-05-12T10:50:01.659956+0000","last_fullsized":"2024-05-12T10:50:01.659956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:14:35.180779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916502+0000","last_change":"2024-05-12T10:49:59.676676+0000","last_active":"2024-05-12T10:50:02.916502+0000","last_peered":"2024-05-12T10:50:02.916502+0000","last_clean":"2024-05-12T10:50:02.916502+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:50:02.916502+0000","last_undegraded":"2024-05-12T10:50:02.916502+0000","last_fullsized":"2024-05-12T10:50:02.916502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:03:13.485130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916164+0000","last_change":"2024-05-12T10:49:55.610830+0000","last_active":"2024-05-12T10:50:02.916164+0000","last_peered":"2024-05-12T10:50:02.916164+0000","last_clean":"2024-05-12T10:50:02.916164+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:50:02.916164+0000","last_undegraded":"2024-05-12T10:50:02.916164+0000","last_fullsized":"2024-05-12T10:50:02.916164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:15.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.791800+0000","last_change":"2024-05-12T10:49:54.609239+0000","last_active":"2024-05-12T10:50:29.791800+0000","last_peered":"2024-05-12T10:50:29.791800+0000","last_clean":"2024-05-12T10:50:29.791800+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:50:29.791800+0000","last_undegraded":"2024-05-12T10:50:29.791800+0000","last_fullsized":"2024-05-12T10:50:29.791800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:12:54.169428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916817+0000","last_change":"2024-05-12T10:49:59.656739+0000","last_active":"2024-05-12T10:50:02.916817+0000","last_peered":"2024-05-12T10:50:02.916817+0000","last_clean":"2024-05-12T10:50:02.916817+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:50:02.916817+0000","last_undegraded":"2024-05-12T10:50:02.916817+0000","last_fullsized":"2024-05-12T10:50:02.916817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:05.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837232+0000","last_change":"2024-05-12T10:49:55.626312+0000","last_active":"2024-05-12T10:50:02.837232+0000","last_peered":"2024-05-12T10:50:02.837232+0000","last_clean":"2024-05-12T10:50:02.837232+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:50:02.837232+0000","last_undegraded":"2024-05-12T10:50:02.837232+0000","last_fullsized":"2024-05-12T10:50:02.837232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:36.639971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.791973+0000","last_change":"2024-05-12T10:49:54.640819+0000","last_active":"2024-05-12T10:50:29.791973+0000","last_peered":"2024-05-12T10:50:29.791973+0000","last_clean":"2024-05-12T10:50:29.791973+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:50:29.791973+0000","last_undegraded":"2024-05-12T10:50:29.791973+0000","last_fullsized":"2024-05-12T10:50:29.791973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:01.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837983+0000","last_change":"2024-05-12T10:50:00.384347+0000","last_active":"2024-05-12T10:50:02.837983+0000","last_peered":"2024-05-12T10:50:02.837983+0000","last_clean":"2024-05-12T10:50:02.837983+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:50:02.837983+0000","last_undegraded":"2024-05-12T10:50:02.837983+0000","last_fullsized":"2024-05-12T10:50:02.837983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:30.794704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652533+0000","last_change":"2024-05-12T10:49:55.627340+0000","last_active":"2024-05-12T10:50:01.652533+0000","last_peered":"2024-05-12T10:50:01.652533+0000","last_clean":"2024-05-12T10:50:01.652533+0000","last_became_active":"2024-05-12T10:49:55.627065+0000","last_became_peered":"2024-05-12T10:49:55.627065+0000","last_unstale":"2024-05-12T10:50:01.652533+0000","last_undegraded":"2024-05-12T10:50:01.652533+0000","last_fullsized":"2024-05-12T10:50:01.652533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:57:50.849518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.756339+0000","last_change":"2024-05-12T10:49:54.648333+0000","last_active":"2024-05-12T10:50:23.756339+0000","last_peered":"2024-05-12T10:50:23.756339+0000","last_clean":"2024-05-12T10:50:23.756339+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:50:23.756339+0000","last_undegraded":"2024-05-12T10:50:23.756339+0000","last_fullsized":"2024-05-12T10:50:23.756339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:29.355444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920043+0000","last_change":"2024-05-12T10:49:45.547469+0000","last_active":"2024-05-12T10:50:02.920043+0000","last_peered":"2024-05-12T10:50:02.920043+0000","last_clean":"2024-05-12T10:50:02.920043+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:50:02.920043+0000","last_undegraded":"2024-05-12T10:50:02.920043+0000","last_fullsized":"2024-05-12T10:50:02.920043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_clean_scrub_stamp":"2024-05-12T10:49:43.953472+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:44:15.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076721+0000","last_change":"2024-05-12T10:50:00.399288+0000","last_active":"2024-05-12T10:50:02.076721+0000","last_peered":"2024-05-12T10:50:02.076721+0000","last_clean":"2024-05-12T10:50:02.076721+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:50:02.076721+0000","last_undegraded":"2024-05-12T10:50:02.076721+0000","last_fullsized":"2024-05-12T10:50:02.076721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:26.959086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920561+0000","last_change":"2024-05-12T10:49:55.639605+0000","last_active":"2024-05-12T10:50:02.920561+0000","last_peered":"2024-05-12T10:50:02.920561+0000","last_clean":"2024-05-12T10:50:02.920561+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:50:02.920561+0000","last_undegraded":"2024-05-12T10:50:02.920561+0000","last_fullsized":"2024-05-12T10:50:02.920561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:46:26.585195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788076+0000","last_change":"2024-05-12T10:49:54.654999+0000","last_active":"2024-05-12T10:50:29.788076+0000","last_peered":"2024-05-12T10:50:29.788076+0000","last_clean":"2024-05-12T10:50:29.788076+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:50:29.788076+0000","last_undegraded":"2024-05-12T10:50:29.788076+0000","last_fullsized":"2024-05-12T10:50:29.788076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:00:20.115739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076118+0000","last_change":"2024-05-12T10:50:00.393017+0000","last_active":"2024-05-12T10:50:02.076118+0000","last_peered":"2024-05-12T10:50:02.076118+0000","last_clean":"2024-05-12T10:50:02.076118+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:50:02.076118+0000","last_undegraded":"2024-05-12T10:50:02.076118+0000","last_fullsized":"2024-05-12T10:50:02.076118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:01:02.394572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658363+0000","last_change":"2024-05-12T10:49:55.623665+0000","last_active":"2024-05-12T10:50:01.658363+0000","last_peered":"2024-05-12T10:50:01.658363+0000","last_clean":"2024-05-12T10:50:01.658363+0000","last_became_active":"2024-05-12T10:49:55.623403+0000","last_became_peered":"2024-05-12T10:49:55.623403+0000","last_unstale":"2024-05-12T10:50:01.658363+0000","last_undegraded":"2024-05-12T10:50:01.658363+0000","last_fullsized":"2024-05-12T10:50:01.658363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:18:25.399664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915873+0000","last_change":"2024-05-12T10:49:54.628492+0000","last_active":"2024-05-12T10:50:02.915873+0000","last_peered":"2024-05-12T10:50:02.915873+0000","last_clean":"2024-05-12T10:50:02.915873+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:50:02.915873+0000","last_undegraded":"2024-05-12T10:50:02.915873+0000","last_fullsized":"2024-05-12T10:50:02.915873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:35:38.949401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837763+0000","last_change":"2024-05-12T10:49:59.657783+0000","last_active":"2024-05-12T10:50:02.837763+0000","last_peered":"2024-05-12T10:50:02.837763+0000","last_clean":"2024-05-12T10:50:02.837763+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:50:02.837763+0000","last_undegraded":"2024-05-12T10:50:02.837763+0000","last_fullsized":"2024-05-12T10:50:02.837763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:51:21.103458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921189+0000","last_change":"2024-05-12T10:49:55.646246+0000","last_active":"2024-05-12T10:50:02.921189+0000","last_peered":"2024-05-12T10:50:02.921189+0000","last_clean":"2024-05-12T10:50:02.921189+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:50:02.921189+0000","last_undegraded":"2024-05-12T10:50:02.921189+0000","last_fullsized":"2024-05-12T10:50:02.921189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:32.142128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102403+0000","last_change":"2024-05-12T10:49:54.610076+0000","last_active":"2024-05-12T10:50:02.102403+0000","last_peered":"2024-05-12T10:50:02.102403+0000","last_clean":"2024-05-12T10:50:02.102403+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:50:02.102403+0000","last_undegraded":"2024-05-12T10:50:02.102403+0000","last_fullsized":"2024-05-12T10:50:02.102403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:12:04.400894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657078+0000","last_change":"2024-05-12T10:50:00.386172+0000","last_active":"2024-05-12T10:50:01.657078+0000","last_peered":"2024-05-12T10:50:01.657078+0000","last_clean":"2024-05-12T10:50:01.657078+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:50:01.657078+0000","last_undegraded":"2024-05-12T10:50:01.657078+0000","last_fullsized":"2024-05-12T10:50:01.657078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:06:17.550197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920926+0000","last_change":"2024-05-12T10:49:55.646249+0000","last_active":"2024-05-12T10:50:02.920926+0000","last_peered":"2024-05-12T10:50:02.920926+0000","last_clean":"2024-05-12T10:50:02.920926+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:50:02.920926+0000","last_undegraded":"2024-05-12T10:50:02.920926+0000","last_fullsized":"2024-05-12T10:50:02.920926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:15.036675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660898+0000","last_change":"2024-05-12T10:49:54.621293+0000","last_active":"2024-05-12T10:50:01.660898+0000","last_peered":"2024-05-12T10:50:01.660898+0000","last_clean":"2024-05-12T10:50:01.660898+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:50:01.660898+0000","last_undegraded":"2024-05-12T10:50:01.660898+0000","last_fullsized":"2024-05-12T10:50:01.660898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:45:33.341215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657581+0000","last_change":"2024-05-12T10:49:59.673656+0000","last_active":"2024-05-12T10:50:01.657581+0000","last_peered":"2024-05-12T10:50:01.657581+0000","last_clean":"2024-05-12T10:50:01.657581+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:50:01.657581+0000","last_undegraded":"2024-05-12T10:50:01.657581+0000","last_fullsized":"2024-05-12T10:50:01.657581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:38.364434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919917+0000","last_change":"2024-05-12T10:49:55.646526+0000","last_active":"2024-05-12T10:50:02.919917+0000","last_peered":"2024-05-12T10:50:02.919917+0000","last_clean":"2024-05-12T10:50:02.919917+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:50:02.919917+0000","last_undegraded":"2024-05-12T10:50:02.919917+0000","last_fullsized":"2024-05-12T10:50:02.919917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:56:52.102442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.793829+0000","last_change":"2024-05-12T10:49:54.617906+0000","last_active":"2024-05-12T10:50:29.793829+0000","last_peered":"2024-05-12T10:50:29.793829+0000","last_clean":"2024-05-12T10:50:29.793829+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:50:29.793829+0000","last_undegraded":"2024-05-12T10:50:29.793829+0000","last_fullsized":"2024-05-12T10:50:29.793829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:26:35.150963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837853+0000","last_change":"2024-05-12T10:49:59.671791+0000","last_active":"2024-05-12T10:50:02.837853+0000","last_peered":"2024-05-12T10:50:02.837853+0000","last_clean":"2024-05-12T10:50:02.837853+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:50:02.837853+0000","last_undegraded":"2024-05-12T10:50:02.837853+0000","last_fullsized":"2024-05-12T10:50:02.837853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:27.425708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076017+0000","last_change":"2024-05-12T10:49:55.637810+0000","last_active":"2024-05-12T10:50:02.076017+0000","last_peered":"2024-05-12T10:50:02.076017+0000","last_clean":"2024-05-12T10:50:02.076017+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:50:02.076017+0000","last_undegraded":"2024-05-12T10:50:02.076017+0000","last_fullsized":"2024-05-12T10:50:02.076017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:52.001497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.791060+0000","last_change":"2024-05-12T10:49:54.637728+0000","last_active":"2024-05-12T10:50:29.791060+0000","last_peered":"2024-05-12T10:50:29.791060+0000","last_clean":"2024-05-12T10:50:29.791060+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:50:29.791060+0000","last_undegraded":"2024-05-12T10:50:29.791060+0000","last_fullsized":"2024-05-12T10:50:29.791060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:39.996419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653563+0000","last_change":"2024-05-12T10:50:00.383444+0000","last_active":"2024-05-12T10:50:01.653563+0000","last_peered":"2024-05-12T10:50:01.653563+0000","last_clean":"2024-05-12T10:50:01.653563+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:50:01.653563+0000","last_undegraded":"2024-05-12T10:50:01.653563+0000","last_fullsized":"2024-05-12T10:50:01.653563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:55:04.226848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920128+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:50:02.920128+0000","last_peered":"2024-05-12T10:50:02.920128+0000","last_clean":"2024-05-12T10:50:02.920128+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:50:02.920128+0000","last_undegraded":"2024-05-12T10:50:02.920128+0000","last_fullsized":"2024-05-12T10:50:02.920128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:15:58.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.752272+0000","last_change":"2024-05-12T10:49:54.656814+0000","last_active":"2024-05-12T10:50:23.752272+0000","last_peered":"2024-05-12T10:50:23.752272+0000","last_clean":"2024-05-12T10:50:23.752272+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:50:23.752272+0000","last_undegraded":"2024-05-12T10:50:23.752272+0000","last_fullsized":"2024-05-12T10:50:23.752272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:26.660043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653232+0000","last_change":"2024-05-12T10:50:00.390308+0000","last_active":"2024-05-12T10:50:01.653232+0000","last_peered":"2024-05-12T10:50:01.653232+0000","last_clean":"2024-05-12T10:50:01.653232+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:50:01.653232+0000","last_undegraded":"2024-05-12T10:50:01.653232+0000","last_fullsized":"2024-05-12T10:50:01.653232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:43.650956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837442+0000","last_change":"2024-05-12T10:49:55.628907+0000","last_active":"2024-05-12T10:50:02.837442+0000","last_peered":"2024-05-12T10:50:02.837442+0000","last_clean":"2024-05-12T10:50:02.837442+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:50:02.837442+0000","last_undegraded":"2024-05-12T10:50:02.837442+0000","last_fullsized":"2024-05-12T10:50:02.837442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:13:50.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788848+0000","last_change":"2024-05-12T10:49:54.626002+0000","last_active":"2024-05-12T10:50:29.788848+0000","last_peered":"2024-05-12T10:50:29.788848+0000","last_clean":"2024-05-12T10:50:29.788848+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:50:29.788848+0000","last_undegraded":"2024-05-12T10:50:29.788848+0000","last_fullsized":"2024-05-12T10:50:29.788848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:19:19.976387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659867+0000","last_change":"2024-05-12T10:50:00.387192+0000","last_active":"2024-05-12T10:50:01.659867+0000","last_peered":"2024-05-12T10:50:01.659867+0000","last_clean":"2024-05-12T10:50:01.659867+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:50:01.659867+0000","last_undegraded":"2024-05-12T10:50:01.659867+0000","last_fullsized":"2024-05-12T10:50:01.659867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:15:23.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920487+0000","last_change":"2024-05-12T10:49:55.634551+0000","last_active":"2024-05-12T10:50:02.920487+0000","last_peered":"2024-05-12T10:50:02.920487+0000","last_clean":"2024-05-12T10:50:02.920487+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:50:02.920487+0000","last_undegraded":"2024-05-12T10:50:02.920487+0000","last_fullsized":"2024-05-12T10:50:02.920487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:10:52.477145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.761011+0000","last_change":"2024-05-12T10:49:54.634748+0000","last_active":"2024-05-12T10:50:23.761011+0000","last_peered":"2024-05-12T10:50:23.761011+0000","last_clean":"2024-05-12T10:50:23.761011+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:50:23.761011+0000","last_undegraded":"2024-05-12T10:50:23.761011+0000","last_fullsized":"2024-05-12T10:50:23.761011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:39:16.646133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916160+0000","last_change":"2024-05-12T10:49:59.671405+0000","last_active":"2024-05-12T10:50:02.916160+0000","last_peered":"2024-05-12T10:50:02.916160+0000","last_clean":"2024-05-12T10:50:02.916160+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:50:02.916160+0000","last_undegraded":"2024-05-12T10:50:02.916160+0000","last_fullsized":"2024-05-12T10:50:02.916160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:06:34.170753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659820+0000","last_change":"2024-05-12T10:49:55.634686+0000","last_active":"2024-05-12T10:50:01.659820+0000","last_peered":"2024-05-12T10:50:01.659820+0000","last_clean":"2024-05-12T10:50:01.659820+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:50:01.659820+0000","last_undegraded":"2024-05-12T10:50:01.659820+0000","last_fullsized":"2024-05-12T10:50:01.659820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:25:04.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915954+0000","last_change":"2024-05-12T10:49:54.656012+0000","last_active":"2024-05-12T10:50:02.915954+0000","last_peered":"2024-05-12T10:50:02.915954+0000","last_clean":"2024-05-12T10:50:02.915954+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:50:02.915954+0000","last_undegraded":"2024-05-12T10:50:02.915954+0000","last_fullsized":"2024-05-12T10:50:02.915954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:29.253250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658272+0000","last_change":"2024-05-12T10:49:59.672820+0000","last_active":"2024-05-12T10:50:01.658272+0000","last_peered":"2024-05-12T10:50:01.658272+0000","last_clean":"2024-05-12T10:50:01.658272+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:50:01.658272+0000","last_undegraded":"2024-05-12T10:50:01.658272+0000","last_fullsized":"2024-05-12T10:50:01.658272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:49:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838093+0000","last_change":"2024-05-12T10:49:55.620541+0000","last_active":"2024-05-12T10:50:02.838093+0000","last_peered":"2024-05-12T10:50:02.838093+0000","last_clean":"2024-05-12T10:50:02.838093+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:50:02.838093+0000","last_undegraded":"2024-05-12T10:50:02.838093+0000","last_fullsized":"2024-05-12T10:50:02.838093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:11.742829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.756880+0000","last_change":"2024-05-12T10:49:54.651289+0000","last_active":"2024-05-12T10:50:23.756880+0000","last_peered":"2024-05-12T10:50:23.756880+0000","last_clean":"2024-05-12T10:50:23.756880+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:50:23.756880+0000","last_undegraded":"2024-05-12T10:50:23.756880+0000","last_fullsized":"2024-05-12T10:50:23.756880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:33:24.087763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652523+0000","last_change":"2024-05-12T10:49:59.670973+0000","last_active":"2024-05-12T10:50:01.652523+0000","last_peered":"2024-05-12T10:50:01.652523+0000","last_clean":"2024-05-12T10:50:01.652523+0000","last_became_active":"2024-05-12T10:49:59.670656+0000","last_became_peered":"2024-05-12T10:49:59.670656+0000","last_unstale":"2024-05-12T10:50:01.652523+0000","last_undegraded":"2024-05-12T10:50:01.652523+0000","last_fullsized":"2024-05-12T10:50:01.652523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:16:58.665403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659979+0000","last_change":"2024-05-12T10:49:55.626645+0000","last_active":"2024-05-12T10:50:01.659979+0000","last_peered":"2024-05-12T10:50:01.659979+0000","last_clean":"2024-05-12T10:50:01.659979+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:50:01.659979+0000","last_undegraded":"2024-05-12T10:50:01.659979+0000","last_fullsized":"2024-05-12T10:50:01.659979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:41.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.761019+0000","last_change":"2024-05-12T10:49:54.654822+0000","last_active":"2024-05-12T10:50:23.761019+0000","last_peered":"2024-05-12T10:50:23.761019+0000","last_clean":"2024-05-12T10:50:23.761019+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:50:23.761019+0000","last_undegraded":"2024-05-12T10:50:23.761019+0000","last_fullsized":"2024-05-12T10:50:23.761019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:52:07.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652430+0000","last_change":"2024-05-12T10:50:00.396453+0000","last_active":"2024-05-12T10:50:01.652430+0000","last_peered":"2024-05-12T10:50:01.652430+0000","last_clean":"2024-05-12T10:50:01.652430+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:50:01.652430+0000","last_undegraded":"2024-05-12T10:50:01.652430+0000","last_fullsized":"2024-05-12T10:50:01.652430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:40.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837810+0000","last_change":"2024-05-12T10:50:00.390477+0000","last_active":"2024-05-12T10:50:02.837810+0000","last_peered":"2024-05-12T10:50:02.837810+0000","last_clean":"2024-05-12T10:50:02.837810+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:50:02.837810+0000","last_undegraded":"2024-05-12T10:50:02.837810+0000","last_fullsized":"2024-05-12T10:50:02.837810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:20:19.551216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916112+0000","last_change":"2024-05-12T10:49:55.619984+0000","last_active":"2024-05-12T10:50:02.916112+0000","last_peered":"2024-05-12T10:50:02.916112+0000","last_clean":"2024-05-12T10:50:02.916112+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:50:02.916112+0000","last_undegraded":"2024-05-12T10:50:02.916112+0000","last_fullsized":"2024-05-12T10:50:02.916112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:21:34.136203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658089+0000","last_change":"2024-05-12T10:49:54.656580+0000","last_active":"2024-05-12T10:50:01.658089+0000","last_peered":"2024-05-12T10:50:01.658089+0000","last_clean":"2024-05-12T10:50:01.658089+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:50:01.658089+0000","last_undegraded":"2024-05-12T10:50:01.658089+0000","last_fullsized":"2024-05-12T10:50:01.658089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:43:32.603999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076883+0000","last_change":"2024-05-12T10:49:59.681648+0000","last_active":"2024-05-12T10:50:02.076883+0000","last_peered":"2024-05-12T10:50:02.076883+0000","last_clean":"2024-05-12T10:50:02.076883+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:50:02.076883+0000","last_undegraded":"2024-05-12T10:50:02.076883+0000","last_fullsized":"2024-05-12T10:50:02.076883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:54.912836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652618+0000","last_change":"2024-05-12T10:49:55.617393+0000","last_active":"2024-05-12T10:50:01.652618+0000","last_peered":"2024-05-12T10:50:01.652618+0000","last_clean":"2024-05-12T10:50:01.652618+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:50:01.652618+0000","last_undegraded":"2024-05-12T10:50:01.652618+0000","last_fullsized":"2024-05-12T10:50:01.652618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:51.584695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788252+0000","last_change":"2024-05-12T10:49:54.637393+0000","last_active":"2024-05-12T10:50:29.788252+0000","last_peered":"2024-05-12T10:50:29.788252+0000","last_clean":"2024-05-12T10:50:29.788252+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:50:29.788252+0000","last_undegraded":"2024-05-12T10:50:29.788252+0000","last_fullsized":"2024-05-12T10:50:29.788252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:44:00.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788812+0000","last_change":"2024-05-12T10:49:54.636945+0000","last_active":"2024-05-12T10:50:29.788812+0000","last_peered":"2024-05-12T10:50:29.788812+0000","last_clean":"2024-05-12T10:50:29.788812+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:50:29.788812+0000","last_undegraded":"2024-05-12T10:50:29.788812+0000","last_fullsized":"2024-05-12T10:50:29.788812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:34:25.927458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837878+0000","last_change":"2024-05-12T10:49:55.627105+0000","last_active":"2024-05-12T10:50:02.837878+0000","last_peered":"2024-05-12T10:50:02.837878+0000","last_clean":"2024-05-12T10:50:02.837878+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:50:02.837878+0000","last_undegraded":"2024-05-12T10:50:02.837878+0000","last_fullsized":"2024-05-12T10:50:02.837878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:00:09.334541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102212+0000","last_change":"2024-05-12T10:49:59.659142+0000","last_active":"2024-05-12T10:50:02.102212+0000","last_peered":"2024-05-12T10:50:02.102212+0000","last_clean":"2024-05-12T10:50:02.102212+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:50:02.102212+0000","last_undegraded":"2024-05-12T10:50:02.102212+0000","last_fullsized":"2024-05-12T10:50:02.102212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:40.443593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.755012+0000","last_change":"2024-05-12T10:49:54.632224+0000","last_active":"2024-05-12T10:50:23.755012+0000","last_peered":"2024-05-12T10:50:23.755012+0000","last_clean":"2024-05-12T10:50:23.755012+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:50:23.755012+0000","last_undegraded":"2024-05-12T10:50:23.755012+0000","last_fullsized":"2024-05-12T10:50:23.755012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:27:39.637678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659206+0000","last_change":"2024-05-12T10:49:55.633243+0000","last_active":"2024-05-12T10:50:01.659206+0000","last_peered":"2024-05-12T10:50:01.659206+0000","last_clean":"2024-05-12T10:50:01.659206+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:50:01.659206+0000","last_undegraded":"2024-05-12T10:50:01.659206+0000","last_fullsized":"2024-05-12T10:50:01.659206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:14.239020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652874+0000","last_change":"2024-05-12T10:49:59.655807+0000","last_active":"2024-05-12T10:50:01.652874+0000","last_peered":"2024-05-12T10:50:01.652874+0000","last_clean":"2024-05-12T10:50:01.652874+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:50:01.652874+0000","last_undegraded":"2024-05-12T10:50:01.652874+0000","last_fullsized":"2024-05-12T10:50:01.652874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:12.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075680+0000","last_change":"2024-05-12T10:49:55.637106+0000","last_active":"2024-05-12T10:50:02.075680+0000","last_peered":"2024-05-12T10:50:02.075680+0000","last_clean":"2024-05-12T10:50:02.075680+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:50:02.075680+0000","last_undegraded":"2024-05-12T10:50:02.075680+0000","last_fullsized":"2024-05-12T10:50:02.075680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:22:07.477677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101967+0000","last_change":"2024-05-12T10:49:55.618952+0000","last_active":"2024-05-12T10:50:02.101967+0000","last_peered":"2024-05-12T10:50:02.101967+0000","last_clean":"2024-05-12T10:50:02.101967+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:50:02.101967+0000","last_undegraded":"2024-05-12T10:50:02.101967+0000","last_fullsized":"2024-05-12T10:50:02.101967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:38:10.693066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659549+0000","last_change":"2024-05-12T10:49:55.623916+0000","last_active":"2024-05-12T10:50:01.659549+0000","last_peered":"2024-05-12T10:50:01.659549+0000","last_clean":"2024-05-12T10:50:01.659549+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:50:01.659549+0000","last_undegraded":"2024-05-12T10:50:01.659549+0000","last_fullsized":"2024-05-12T10:50:01.659549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:06:14.434631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837761+0000","last_change":"2024-05-12T10:49:55.620278+0000","last_active":"2024-05-12T10:50:02.837761+0000","last_peered":"2024-05-12T10:50:02.837761+0000","last_clean":"2024-05-12T10:50:02.837761+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:50:02.837761+0000","last_undegraded":"2024-05-12T10:50:02.837761+0000","last_fullsized":"2024-05-12T10:50:02.837761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:59.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653439+0000","last_change":"2024-05-12T10:49:55.626216+0000","last_active":"2024-05-12T10:50:01.653439+0000","last_peered":"2024-05-12T10:50:01.653439+0000","last_clean":"2024-05-12T10:50:01.653439+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:50:01.653439+0000","last_undegraded":"2024-05-12T10:50:01.653439+0000","last_fullsized":"2024-05-12T10:50:01.653439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:52:14.438331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916463+0000","last_change":"2024-05-12T10:49:55.622085+0000","last_active":"2024-05-12T10:50:02.916463+0000","last_peered":"2024-05-12T10:50:02.916463+0000","last_clean":"2024-05-12T10:50:02.916463+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:50:02.916463+0000","last_undegraded":"2024-05-12T10:50:02.916463+0000","last_fullsized":"2024-05-12T10:50:02.916463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:41:42.558506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076984+0000","last_change":"2024-05-12T10:49:55.635592+0000","last_active":"2024-05-12T10:50:02.076984+0000","last_peered":"2024-05-12T10:50:02.076984+0000","last_clean":"2024-05-12T10:50:02.076984+0000","last_became_active":"2024-05-12T10:49:55.635298+0000","last_became_peered":"2024-05-12T10:49:55.635298+0000","last_unstale":"2024-05-12T10:50:02.076984+0000","last_undegraded":"2024-05-12T10:50:02.076984+0000","last_fullsized":"2024-05-12T10:50:02.076984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:43:14.781372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653476+0000","last_change":"2024-05-12T10:49:55.626353+0000","last_active":"2024-05-12T10:50:01.653476+0000","last_peered":"2024-05-12T10:50:01.653476+0000","last_clean":"2024-05-12T10:50:01.653476+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:50:01.653476+0000","last_undegraded":"2024-05-12T10:50:01.653476+0000","last_fullsized":"2024-05-12T10:50:01.653476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:58.905284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657725+0000","last_change":"2024-05-12T10:49:55.621110+0000","last_active":"2024-05-12T10:50:01.657725+0000","last_peered":"2024-05-12T10:50:01.657725+0000","last_clean":"2024-05-12T10:50:01.657725+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:50:01.657725+0000","last_undegraded":"2024-05-12T10:50:01.657725+0000","last_fullsized":"2024-05-12T10:50:01.657725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:12:36.369923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652483+0000","last_change":"2024-05-12T10:49:55.626913+0000","last_active":"2024-05-12T10:50:01.652483+0000","last_peered":"2024-05-12T10:50:01.652483+0000","last_clean":"2024-05-12T10:50:01.652483+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:50:01.652483+0000","last_undegraded":"2024-05-12T10:50:01.652483+0000","last_fullsized":"2024-05-12T10:50:01.652483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:27:08.492294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659499+0000","last_change":"2024-05-12T10:49:55.629992+0000","last_active":"2024-05-12T10:50:01.659499+0000","last_peered":"2024-05-12T10:50:01.659499+0000","last_clean":"2024-05-12T10:50:01.659499+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:50:01.659499+0000","last_undegraded":"2024-05-12T10:50:01.659499+0000","last_fullsized":"2024-05-12T10:50:01.659499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:31.454363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837524+0000","last_change":"2024-05-12T10:49:55.620821+0000","last_active":"2024-05-12T10:50:02.837524+0000","last_peered":"2024-05-12T10:50:02.837524+0000","last_clean":"2024-05-12T10:50:02.837524+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:50:02.837524+0000","last_undegraded":"2024-05-12T10:50:02.837524+0000","last_fullsized":"2024-05-12T10:50:02.837524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:53.597215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076297+0000","last_change":"2024-05-12T10:49:55.646368+0000","last_active":"2024-05-12T10:50:02.076297+0000","last_peered":"2024-05-12T10:50:02.076297+0000","last_clean":"2024-05-12T10:50:02.076297+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:50:02.076297+0000","last_undegraded":"2024-05-12T10:50:02.076297+0000","last_fullsized":"2024-05-12T10:50:02.076297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:21:04.313921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920866+0000","last_change":"2024-05-12T10:49:55.633122+0000","last_active":"2024-05-12T10:50:02.920866+0000","last_peered":"2024-05-12T10:50:02.920866+0000","last_clean":"2024-05-12T10:50:02.920866+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:50:02.920866+0000","last_undegraded":"2024-05-12T10:50:02.920866+0000","last_fullsized":"2024-05-12T10:50:02.920866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:25:19.563648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102362+0000","last_change":"2024-05-12T10:49:55.635394+0000","last_active":"2024-05-12T10:50:02.102362+0000","last_peered":"2024-05-12T10:50:02.102362+0000","last_clean":"2024-05-12T10:50:02.102362+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:50:02.102362+0000","last_undegraded":"2024-05-12T10:50:02.102362+0000","last_fullsized":"2024-05-12T10:50:02.102362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:41:58.478292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660761+0000","last_change":"2024-05-12T10:49:55.626485+0000","last_active":"2024-05-12T10:50:01.660761+0000","last_peered":"2024-05-12T10:50:01.660761+0000","last_clean":"2024-05-12T10:50:01.660761+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:50:01.660761+0000","last_undegraded":"2024-05-12T10:50:01.660761+0000","last_fullsized":"2024-05-12T10:50:01.660761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:17.942339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657391+0000","last_change":"2024-05-12T10:49:55.618820+0000","last_active":"2024-05-12T10:50:01.657391+0000","last_peered":"2024-05-12T10:50:01.657391+0000","last_clean":"2024-05-12T10:50:01.657391+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:50:01.657391+0000","last_undegraded":"2024-05-12T10:50:01.657391+0000","last_fullsized":"2024-05-12T10:50:01.657391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:23:00.474438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916163+0000","last_change":"2024-05-12T10:49:55.626429+0000","last_active":"2024-05-12T10:50:02.916163+0000","last_peered":"2024-05-12T10:50:02.916163+0000","last_clean":"2024-05-12T10:50:02.916163+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:50:02.916163+0000","last_undegraded":"2024-05-12T10:50:02.916163+0000","last_fullsized":"2024-05-12T10:50:02.916163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:40:02.709729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837421+0000","last_change":"2024-05-12T10:49:55.612139+0000","last_active":"2024-05-12T10:50:02.837421+0000","last_peered":"2024-05-12T10:50:02.837421+0000","last_clean":"2024-05-12T10:50:02.837421+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:50:02.837421+0000","last_undegraded":"2024-05-12T10:50:02.837421+0000","last_fullsized":"2024-05-12T10:50:02.837421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:57:34.138392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652690+0000","last_change":"2024-05-12T10:49:55.631137+0000","last_active":"2024-05-12T10:50:01.652690+0000","last_peered":"2024-05-12T10:50:01.652690+0000","last_clean":"2024-05-12T10:50:01.652690+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:50:01.652690+0000","last_undegraded":"2024-05-12T10:50:01.652690+0000","last_fullsized":"2024-05-12T10:50:01.652690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:04.390314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659797+0000","last_change":"2024-05-12T10:49:55.643416+0000","last_active":"2024-05-12T10:50:01.659797+0000","last_peered":"2024-05-12T10:50:01.659797+0000","last_clean":"2024-05-12T10:50:01.659797+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:50:01.659797+0000","last_undegraded":"2024-05-12T10:50:01.659797+0000","last_fullsized":"2024-05-12T10:50:01.659797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:58.632966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076802+0000","last_change":"2024-05-12T10:49:55.635847+0000","last_active":"2024-05-12T10:50:02.076802+0000","last_peered":"2024-05-12T10:50:02.076802+0000","last_clean":"2024-05-12T10:50:02.076802+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:50:02.076802+0000","last_undegraded":"2024-05-12T10:50:02.076802+0000","last_fullsized":"2024-05-12T10:50:02.076802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:57:51.222099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076561+0000","last_change":"2024-05-12T10:49:55.641921+0000","last_active":"2024-05-12T10:50:02.076561+0000","last_peered":"2024-05-12T10:50:02.076561+0000","last_clean":"2024-05-12T10:50:02.076561+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:50:02.076561+0000","last_undegraded":"2024-05-12T10:50:02.076561+0000","last_fullsized":"2024-05-12T10:50:02.076561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:44:57.787358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921179+0000","last_change":"2024-05-12T10:49:55.635853+0000","last_active":"2024-05-12T10:50:02.921179+0000","last_peered":"2024-05-12T10:50:02.921179+0000","last_clean":"2024-05-12T10:50:02.921179+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:50:02.921179+0000","last_undegraded":"2024-05-12T10:50:02.921179+0000","last_fullsized":"2024-05-12T10:50:02.921179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:04:39.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652297+0000","last_change":"2024-05-12T10:49:55.620107+0000","last_active":"2024-05-12T10:50:01.652297+0000","last_peered":"2024-05-12T10:50:01.652297+0000","last_clean":"2024-05-12T10:50:01.652297+0000","last_became_active":"2024-05-12T10:49:55.619802+0000","last_became_peered":"2024-05-12T10:49:55.619802+0000","last_unstale":"2024-05-12T10:50:01.652297+0000","last_undegraded":"2024-05-12T10:50:01.652297+0000","last_fullsized":"2024-05-12T10:50:01.652297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:52:39.033778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920076+0000","last_change":"2024-05-12T10:49:55.629001+0000","last_active":"2024-05-12T10:50:02.920076+0000","last_peered":"2024-05-12T10:50:02.920076+0000","last_clean":"2024-05-12T10:50:02.920076+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:50:02.920076+0000","last_undegraded":"2024-05-12T10:50:02.920076+0000","last_fullsized":"2024-05-12T10:50:02.920076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:42:39.042271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659136+0000","last_change":"2024-05-12T10:49:55.625540+0000","last_active":"2024-05-12T10:50:01.659136+0000","last_peered":"2024-05-12T10:50:01.659136+0000","last_clean":"2024-05-12T10:50:01.659136+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:50:01.659136+0000","last_undegraded":"2024-05-12T10:50:01.659136+0000","last_fullsized":"2024-05-12T10:50:01.659136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:35.621918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919665+0000","last_change":"2024-05-12T10:49:55.633576+0000","last_active":"2024-05-12T10:50:02.919665+0000","last_peered":"2024-05-12T10:50:02.919665+0000","last_clean":"2024-05-12T10:50:02.919665+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:50:02.919665+0000","last_undegraded":"2024-05-12T10:50:02.919665+0000","last_fullsized":"2024-05-12T10:50:02.919665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:06:16.255147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657885+0000","last_change":"2024-05-12T10:49:55.624205+0000","last_active":"2024-05-12T10:50:01.657885+0000","last_peered":"2024-05-12T10:50:01.657885+0000","last_clean":"2024-05-12T10:50:01.657885+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:50:01.657885+0000","last_undegraded":"2024-05-12T10:50:01.657885+0000","last_fullsized":"2024-05-12T10:50:01.657885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:21.895269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837757+0000","last_change":"2024-05-12T10:49:55.610461+0000","last_active":"2024-05-12T10:50:02.837757+0000","last_peered":"2024-05-12T10:50:02.837757+0000","last_clean":"2024-05-12T10:50:02.837757+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:50:02.837757+0000","last_undegraded":"2024-05-12T10:50:02.837757+0000","last_fullsized":"2024-05-12T10:50:02.837757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:44.511895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916628+0000","last_change":"2024-05-12T10:49:55.608434+0000","last_active":"2024-05-12T10:50:02.916628+0000","last_peered":"2024-05-12T10:50:02.916628+0000","last_clean":"2024-05-12T10:50:02.916628+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:50:02.916628+0000","last_undegraded":"2024-05-12T10:50:02.916628+0000","last_fullsized":"2024-05-12T10:50:02.916628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:17.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920943+0000","last_change":"2024-05-12T10:49:55.639296+0000","last_active":"2024-05-12T10:50:02.920943+0000","last_peered":"2024-05-12T10:50:02.920943+0000","last_clean":"2024-05-12T10:50:02.920943+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:50:02.920943+0000","last_undegraded":"2024-05-12T10:50:02.920943+0000","last_fullsized":"2024-05-12T10:50:02.920943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:47:15.862328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":888832,"data_stored":702380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":112074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":111410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":115250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":111514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":111640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":701724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:50:38.587 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-12T10:50:38.587 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:50:38.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.764+0000 7f9739a00640 1 Processor -- start 2024-05-12T10:50:38.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.764+0000 7f9739a00640 1 -- start start 2024-05-12T10:50:38.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.764+0000 7f9739a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97340cb7d0 0x7f973415f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.764+0000 7f9739a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9734071140 0x7f973415fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.764+0000 7f9739a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f973415bfe0 con 0x7f9734155c00 2024-05-12T10:50:38.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.764+0000 7f9739a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f973415cb60 con 0x7f9734071140 2024-05-12T10:50:38.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.764+0000 7f9739a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f973415f350 con 0x7f97340cb7d0 2024-05-12T10:50:38.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.764+0000 7f9732a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9734155c00 0x7f9734073e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50700/0 (socket says 172.21.15.115:50700) 2024-05-12T10:50:38.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.764+0000 7f9732a00640 1 -- 172.21.15.115:0/3955574120 learned_addr learned my addr 172.21.15.115:0/3955574120 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:38.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.764+0000 7f9733400640 1 --2- 172.21.15.115:0/3955574120 >> v2:172.21.15.115:3300/0 conn(0x7f9734071140 0x7f973415fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.768+0000 7f9732000640 1 --2- 172.21.15.115:0/3955574120 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97340cb7d0 0x7f973415f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.768+0000 7f9731600640 1 -- 172.21.15.115:0/3955574120 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959426094 0 0) 0x7f973415bfe0 con 0x7f9734155c00 2024-05-12T10:50:38.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.768+0000 7f9731600640 1 -- 172.21.15.115:0/3955574120 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9718003530 con 0x7f9734155c00 2024-05-12T10:50:38.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.768+0000 7f9733400640 1 -- 172.21.15.115:0/3955574120 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97340cb7d0 msgr2=0x7f973415f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:38.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.768+0000 7f9733400640 1 --2- 172.21.15.115:0/3955574120 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97340cb7d0 0x7f973415f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.768+0000 7f9733400640 1 -- 172.21.15.115:0/3955574120 >> v1:172.21.15.115:6789/0 conn(0x7f9734155c00 legacy=0x7f9734073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.768+0000 7f9733400640 1 -- 172.21.15.115:0/3955574120 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973415c2c0 con 0x7f9734071140 2024-05-12T10:50:38.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.768+0000 7f9733400640 1 --2- 172.21.15.115:0/3955574120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9734071140 0x7f973415fd20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f972c009d90 tx=0x7f972c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a1aed23d32faa9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:38.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.768+0000 7f9731600640 1 -- 172.21.15.115:0/3955574120 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0b2070 con 0x7f9734071140 2024-05-12T10:50:38.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.768+0000 7f9731600640 1 -- 172.21.15.115:0/3955574120 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f972c0a5910 con 0x7f9734071140 2024-05-12T10:50:38.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.768+0000 7f9731600640 1 -- 172.21.15.115:0/3955574120 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0a5ce0 con 0x7f9734071140 2024-05-12T10:50:38.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 -- 172.21.15.115:0/3955574120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9734071140 msgr2=0x7f973415fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 --2- 172.21.15.115:0/3955574120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9734071140 0x7f973415fd20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f972c009d90 tx=0x7f972c01c850 comp rx=0 tx=0).stop 2024-05-12T10:50:38.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 -- 172.21.15.115:0/3955574120 shutdown_connections 2024-05-12T10:50:38.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 --2- 172.21.15.115:0/3955574120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9734071140 0x7f973415fd20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 --2- 172.21.15.115:0/3955574120 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97340cb7d0 0x7f973415f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 -- 172.21.15.115:0/3955574120 >> 172.21.15.115:0/3955574120 conn(0x7f97340681c0 msgr2=0x7f97340685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:38.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 -- 172.21.15.115:0/3955574120 shutdown_connections 2024-05-12T10:50:38.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 -- 172.21.15.115:0/3955574120 wait complete. 2024-05-12T10:50:38.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 Processor -- start 2024-05-12T10:50:38.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 -- start start 2024-05-12T10:50:38.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9734071140 0x7f97341439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340cb7d0 0x7f973415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9734155c00 0x7f973415d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9734073640 con 0x7f9734071140 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f97340734c0 con 0x7f97340cb7d0 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9739a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9734074580 con 0x7f9734155c00 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9732a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9734071140 0x7f97341439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9732a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9734071140 0x7f97341439e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60948/0 (socket says 172.21.15.115:60948) 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9732a00640 1 -- 172.21.15.115:0/685583882 learned_addr learned my addr 172.21.15.115:0/685583882 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9732000640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340cb7d0 0x7f973415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9733400640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9734155c00 0x7f973415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9732a00640 1 -- 172.21.15.115:0/685583882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9734155c00 msgr2=0x7f973415d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9732a00640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9734155c00 0x7f973415d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9732a00640 1 -- 172.21.15.115:0/685583882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340cb7d0 msgr2=0x7f973415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9732a00640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340cb7d0 0x7f973415d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9732a00640 1 -- 172.21.15.115:0/685583882 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9734154580 con 0x7f9734071140 2024-05-12T10:50:38.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9733400640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9734155c00 0x7f973415d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:38.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f9732a00640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9734071140 0x7f97341439e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f972400c4d0 tx=0x7f972400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:38.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.772+0000 7f972aa00640 1 -- 172.21.15.115:0/685583882 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724017070 con 0x7f9734071140 2024-05-12T10:50:38.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.776+0000 7f972aa00640 1 -- 172.21.15.115:0/685583882 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9724005cf0 con 0x7f9734071140 2024-05-12T10:50:38.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.776+0000 7f972aa00640 1 -- 172.21.15.115:0/685583882 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724007270 con 0x7f9734071140 2024-05-12T10:50:38.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.776+0000 7f9739a00640 1 -- 172.21.15.115:0/685583882 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9734154820 con 0x7f9734071140 2024-05-12T10:50:38.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.776+0000 7f9739a00640 1 -- 172.21.15.115:0/685583882 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9734154de0 con 0x7f9734071140 2024-05-12T10:50:38.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.776+0000 7f9739a00640 1 -- 172.21.15.115:0/685583882 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9734069730 con 0x7f9734071140 2024-05-12T10:50:38.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.776+0000 7f972aa00640 1 -- 172.21.15.115:0/685583882 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f972401a070 con 0x7f9734071140 2024-05-12T10:50:38.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.776+0000 7f972aa00640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f971406f400 0x7f97140718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:38.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.776+0000 7f972aa00640 1 -- 172.21.15.115:0/685583882 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f972408ea10 con 0x7f9734071140 2024-05-12T10:50:38.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.776+0000 7f9732000640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f971406f400 0x7f97140718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:38.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.776+0000 7f9732000640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f971406f400 0x7f97140718c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9720009ac0 tx=0x7f9720009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:38.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.780+0000 7f972aa00640 1 -- 172.21.15.115:0/685583882 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f972405ae10 con 0x7f9734071140 2024-05-12T10:50:38.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.936+0000 7f9739a00640 1 -- 172.21.15.115:0/685583882 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97341599f0 con 0x7f971406f400 2024-05-12T10:50:38.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.944+0000 7f972aa00640 1 -- 172.21.15.115:0/685583882 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332698 (secure 0 0 0) 0x7f97341599f0 con 0x7f971406f400 2024-05-12T10:50:38.947 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:38.949 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.948+0000 7f9739a00640 1 -- 172.21.15.115:0/685583882 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f971406f400 msgr2=0x7f97140718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.948+0000 7f9739a00640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f971406f400 0x7f97140718c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9720009ac0 tx=0x7f9720009190 comp rx=0 tx=0).stop 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.948+0000 7f9739a00640 1 -- 172.21.15.115:0/685583882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9734071140 msgr2=0x7f97341439e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.948+0000 7f9739a00640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9734071140 0x7f97341439e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f972400c4d0 tx=0x7f972400c990 comp rx=0 tx=0).stop 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.948+0000 7f9739a00640 1 -- 172.21.15.115:0/685583882 shutdown_connections 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.948+0000 7f9739a00640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f971406f400 0x7f97140718c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.948+0000 7f9739a00640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9734155c00 0x7f973415d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.948+0000 7f9739a00640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97340cb7d0 0x7f973415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.948+0000 7f9739a00640 1 --2- 172.21.15.115:0/685583882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9734071140 0x7f97341439e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.948+0000 7f9739a00640 1 -- 172.21.15.115:0/685583882 >> 172.21.15.115:0/685583882 conn(0x7f97340681c0 msgr2=0x7f9734073e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.948+0000 7f9739a00640 1 -- 172.21.15.115:0/685583882 shutdown_connections 2024-05-12T10:50:38.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:38.952+0000 7f9739a00640 1 -- 172.21.15.115:0/685583882 wait complete. 2024-05-12T10:50:38.967 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-05-12T10:50:37.762344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":228,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219592,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755128,"statfs":{"total":773094113280,"available":772869251072,"internally_reserved":0,"allocated":3547136,"data_stored":2081208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002022"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.793391+0000","last_change":"2024-05-12T10:49:54.640093+0000","last_active":"2024-05-12T10:50:29.793391+0000","last_peered":"2024-05-12T10:50:29.793391+0000","last_clean":"2024-05-12T10:50:29.793391+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:50:29.793391+0000","last_undegraded":"2024-05-12T10:50:29.793391+0000","last_fullsized":"2024-05-12T10:50:29.793391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:07:41.639104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653116+0000","last_change":"2024-05-12T10:49:55.635928+0000","last_active":"2024-05-12T10:50:01.653116+0000","last_peered":"2024-05-12T10:50:01.653116+0000","last_clean":"2024-05-12T10:50:01.653116+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:50:01.653116+0000","last_undegraded":"2024-05-12T10:50:01.653116+0000","last_fullsized":"2024-05-12T10:50:01.653116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:41:30.909036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652376+0000","last_change":"2024-05-12T10:50:00.396417+0000","last_active":"2024-05-12T10:50:01.652376+0000","last_peered":"2024-05-12T10:50:01.652376+0000","last_clean":"2024-05-12T10:50:01.652376+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:50:01.652376+0000","last_undegraded":"2024-05-12T10:50:01.652376+0000","last_fullsized":"2024-05-12T10:50:01.652376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:27.287617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653361+0000","last_change":"2024-05-12T10:49:54.619268+0000","last_active":"2024-05-12T10:50:01.653361+0000","last_peered":"2024-05-12T10:50:01.653361+0000","last_clean":"2024-05-12T10:50:01.653361+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:50:01.653361+0000","last_undegraded":"2024-05-12T10:50:01.653361+0000","last_fullsized":"2024-05-12T10:50:01.653361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:50:34.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837930+0000","last_change":"2024-05-12T10:49:55.624986+0000","last_active":"2024-05-12T10:50:02.837930+0000","last_peered":"2024-05-12T10:50:02.837930+0000","last_clean":"2024-05-12T10:50:02.837930+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:50:02.837930+0000","last_undegraded":"2024-05-12T10:50:02.837930+0000","last_fullsized":"2024-05-12T10:50:02.837930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:03:47.220979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657155+0000","last_change":"2024-05-12T10:49:59.676139+0000","last_active":"2024-05-12T10:50:01.657155+0000","last_peered":"2024-05-12T10:50:01.657155+0000","last_clean":"2024-05-12T10:50:01.657155+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:50:01.657155+0000","last_undegraded":"2024-05-12T10:50:01.657155+0000","last_fullsized":"2024-05-12T10:50:01.657155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:24:15.396258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788919+0000","last_change":"2024-05-12T10:49:54.645331+0000","last_active":"2024-05-12T10:50:29.788919+0000","last_peered":"2024-05-12T10:50:29.788919+0000","last_clean":"2024-05-12T10:50:29.788919+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:50:29.788919+0000","last_undegraded":"2024-05-12T10:50:29.788919+0000","last_fullsized":"2024-05-12T10:50:29.788919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:38:29.023589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658144+0000","last_change":"2024-05-12T10:49:55.642386+0000","last_active":"2024-05-12T10:50:01.658144+0000","last_peered":"2024-05-12T10:50:01.658144+0000","last_clean":"2024-05-12T10:50:01.658144+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:50:01.658144+0000","last_undegraded":"2024-05-12T10:50:01.658144+0000","last_fullsized":"2024-05-12T10:50:01.658144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:54:40.153070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657964+0000","last_change":"2024-05-12T10:49:59.679887+0000","last_active":"2024-05-12T10:50:01.657964+0000","last_peered":"2024-05-12T10:50:01.657964+0000","last_clean":"2024-05-12T10:50:01.657964+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:50:01.657964+0000","last_undegraded":"2024-05-12T10:50:01.657964+0000","last_fullsized":"2024-05-12T10:50:01.657964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:25:43.004918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919021+0000","last_change":"2024-05-12T10:49:54.659229+0000","last_active":"2024-05-12T10:50:02.919021+0000","last_peered":"2024-05-12T10:50:02.919021+0000","last_clean":"2024-05-12T10:50:02.919021+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:50:02.919021+0000","last_undegraded":"2024-05-12T10:50:02.919021+0000","last_fullsized":"2024-05-12T10:50:02.919021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:54:54.658165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660005+0000","last_change":"2024-05-12T10:49:55.642157+0000","last_active":"2024-05-12T10:50:01.660005+0000","last_peered":"2024-05-12T10:50:01.660005+0000","last_clean":"2024-05-12T10:50:01.660005+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:50:01.660005+0000","last_undegraded":"2024-05-12T10:50:01.660005+0000","last_fullsized":"2024-05-12T10:50:01.660005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:16.232731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658776+0000","last_change":"2024-05-12T10:49:59.663411+0000","last_active":"2024-05-12T10:50:01.658776+0000","last_peered":"2024-05-12T10:50:01.658776+0000","last_clean":"2024-05-12T10:50:01.658776+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:50:01.658776+0000","last_undegraded":"2024-05-12T10:50:01.658776+0000","last_fullsized":"2024-05-12T10:50:01.658776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:59.136704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075711+0000","last_change":"2024-05-12T10:49:55.646019+0000","last_active":"2024-05-12T10:50:02.075711+0000","last_peered":"2024-05-12T10:50:02.075711+0000","last_clean":"2024-05-12T10:50:02.075711+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:50:02.075711+0000","last_undegraded":"2024-05-12T10:50:02.075711+0000","last_fullsized":"2024-05-12T10:50:02.075711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:07.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.753731+0000","last_change":"2024-05-12T10:49:54.642039+0000","last_active":"2024-05-12T10:50:23.753731+0000","last_peered":"2024-05-12T10:50:23.753731+0000","last_clean":"2024-05-12T10:50:23.753731+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:50:23.753731+0000","last_undegraded":"2024-05-12T10:50:23.753731+0000","last_fullsized":"2024-05-12T10:50:23.753731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:01.155569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660588+0000","last_change":"2024-05-12T10:49:59.660274+0000","last_active":"2024-05-12T10:50:01.660588+0000","last_peered":"2024-05-12T10:50:01.660588+0000","last_clean":"2024-05-12T10:50:01.660588+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:50:01.660588+0000","last_undegraded":"2024-05-12T10:50:01.660588+0000","last_fullsized":"2024-05-12T10:50:01.660588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:55:12.579645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652722+0000","last_change":"2024-05-12T10:49:55.618128+0000","last_active":"2024-05-12T10:50:01.652722+0000","last_peered":"2024-05-12T10:50:01.652722+0000","last_clean":"2024-05-12T10:50:01.652722+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:50:01.652722+0000","last_undegraded":"2024-05-12T10:50:01.652722+0000","last_fullsized":"2024-05-12T10:50:01.652722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:45.205117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915890+0000","last_change":"2024-05-12T10:49:54.619967+0000","last_active":"2024-05-12T10:50:02.915890+0000","last_peered":"2024-05-12T10:50:02.915890+0000","last_clean":"2024-05-12T10:50:02.915890+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:50:02.915890+0000","last_undegraded":"2024-05-12T10:50:02.915890+0000","last_fullsized":"2024-05-12T10:50:02.915890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:37:10.799631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659650+0000","last_change":"2024-05-12T10:49:59.681931+0000","last_active":"2024-05-12T10:50:01.659650+0000","last_peered":"2024-05-12T10:50:01.659650+0000","last_clean":"2024-05-12T10:50:01.659650+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:50:01.659650+0000","last_undegraded":"2024-05-12T10:50:01.659650+0000","last_fullsized":"2024-05-12T10:50:01.659650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:45:01.542628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652721+0000","last_change":"2024-05-12T10:49:55.615095+0000","last_active":"2024-05-12T10:50:01.652721+0000","last_peered":"2024-05-12T10:50:01.652721+0000","last_clean":"2024-05-12T10:50:01.652721+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:50:01.652721+0000","last_undegraded":"2024-05-12T10:50:01.652721+0000","last_fullsized":"2024-05-12T10:50:01.652721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:51:19.659941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.756016+0000","last_change":"2024-05-12T10:49:54.639976+0000","last_active":"2024-05-12T10:50:23.756016+0000","last_peered":"2024-05-12T10:50:23.756016+0000","last_clean":"2024-05-12T10:50:23.756016+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:50:23.756016+0000","last_undegraded":"2024-05-12T10:50:23.756016+0000","last_fullsized":"2024-05-12T10:50:23.756016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:28:37.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916755+0000","last_change":"2024-05-12T10:50:00.390786+0000","last_active":"2024-05-12T10:50:02.916755+0000","last_peered":"2024-05-12T10:50:02.916755+0000","last_clean":"2024-05-12T10:50:02.916755+0000","last_became_active":"2024-05-12T10:50:00.390378+0000","last_became_peered":"2024-05-12T10:50:00.390378+0000","last_unstale":"2024-05-12T10:50:02.916755+0000","last_undegraded":"2024-05-12T10:50:02.916755+0000","last_fullsized":"2024-05-12T10:50:02.916755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:27:57.945259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658891+0000","last_change":"2024-05-12T10:49:55.622729+0000","last_active":"2024-05-12T10:50:01.658891+0000","last_peered":"2024-05-12T10:50:01.658891+0000","last_clean":"2024-05-12T10:50:01.658891+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:50:01.658891+0000","last_undegraded":"2024-05-12T10:50:01.658891+0000","last_fullsized":"2024-05-12T10:50:01.658891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:08:29.460684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.758471+0000","last_change":"2024-05-12T10:49:54.639564+0000","last_active":"2024-05-12T10:50:23.758471+0000","last_peered":"2024-05-12T10:50:23.758471+0000","last_clean":"2024-05-12T10:50:23.758471+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:50:23.758471+0000","last_undegraded":"2024-05-12T10:50:23.758471+0000","last_fullsized":"2024-05-12T10:50:23.758471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:54:48.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.661417+0000","last_change":"2024-05-12T10:49:59.676220+0000","last_active":"2024-05-12T10:50:01.661417+0000","last_peered":"2024-05-12T10:50:01.661417+0000","last_clean":"2024-05-12T10:50:01.661417+0000","last_became_active":"2024-05-12T10:49:59.674835+0000","last_became_peered":"2024-05-12T10:49:59.674835+0000","last_unstale":"2024-05-12T10:50:01.661417+0000","last_undegraded":"2024-05-12T10:50:01.661417+0000","last_fullsized":"2024-05-12T10:50:01.661417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:55:03.456622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838015+0000","last_change":"2024-05-12T10:49:55.612744+0000","last_active":"2024-05-12T10:50:02.838015+0000","last_peered":"2024-05-12T10:50:02.838015+0000","last_clean":"2024-05-12T10:50:02.838015+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:50:02.838015+0000","last_undegraded":"2024-05-12T10:50:02.838015+0000","last_fullsized":"2024-05-12T10:50:02.838015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:05:06.274277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.758768+0000","last_change":"2024-05-12T10:49:54.643375+0000","last_active":"2024-05-12T10:50:23.758768+0000","last_peered":"2024-05-12T10:50:23.758768+0000","last_clean":"2024-05-12T10:50:23.758768+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:50:23.758768+0000","last_undegraded":"2024-05-12T10:50:23.758768+0000","last_fullsized":"2024-05-12T10:50:23.758768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:56:43.086871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658181+0000","last_change":"2024-05-12T10:50:00.393325+0000","last_active":"2024-05-12T10:50:01.658181+0000","last_peered":"2024-05-12T10:50:01.658181+0000","last_clean":"2024-05-12T10:50:01.658181+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:50:01.658181+0000","last_undegraded":"2024-05-12T10:50:01.658181+0000","last_fullsized":"2024-05-12T10:50:01.658181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:55.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653561+0000","last_change":"2024-05-12T10:49:55.629693+0000","last_active":"2024-05-12T10:50:01.653561+0000","last_peered":"2024-05-12T10:50:01.653561+0000","last_clean":"2024-05-12T10:50:01.653561+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:50:01.653561+0000","last_undegraded":"2024-05-12T10:50:01.653561+0000","last_fullsized":"2024-05-12T10:50:01.653561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:04:13.325079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.790340+0000","last_change":"2024-05-12T10:49:54.629227+0000","last_active":"2024-05-12T10:50:29.790340+0000","last_peered":"2024-05-12T10:50:29.790340+0000","last_clean":"2024-05-12T10:50:29.790340+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:50:29.790340+0000","last_undegraded":"2024-05-12T10:50:29.790340+0000","last_fullsized":"2024-05-12T10:50:29.790340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:03.097527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652367+0000","last_change":"2024-05-12T10:50:00.396371+0000","last_active":"2024-05-12T10:50:01.652367+0000","last_peered":"2024-05-12T10:50:01.652367+0000","last_clean":"2024-05-12T10:50:01.652367+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:50:01.652367+0000","last_undegraded":"2024-05-12T10:50:01.652367+0000","last_fullsized":"2024-05-12T10:50:01.652367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:41:09.157859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916505+0000","last_change":"2024-05-12T10:49:55.612069+0000","last_active":"2024-05-12T10:50:02.916505+0000","last_peered":"2024-05-12T10:50:02.916505+0000","last_clean":"2024-05-12T10:50:02.916505+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:50:02.916505+0000","last_undegraded":"2024-05-12T10:50:02.916505+0000","last_fullsized":"2024-05-12T10:50:02.916505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:38.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921127+0000","last_change":"2024-05-12T10:49:54.639928+0000","last_active":"2024-05-12T10:50:02.921127+0000","last_peered":"2024-05-12T10:50:02.921127+0000","last_clean":"2024-05-12T10:50:02.921127+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:50:02.921127+0000","last_undegraded":"2024-05-12T10:50:02.921127+0000","last_fullsized":"2024-05-12T10:50:02.921127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:59.215089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837562+0000","last_change":"2024-05-12T10:50:00.383605+0000","last_active":"2024-05-12T10:50:02.837562+0000","last_peered":"2024-05-12T10:50:02.837562+0000","last_clean":"2024-05-12T10:50:02.837562+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:50:02.837562+0000","last_undegraded":"2024-05-12T10:50:02.837562+0000","last_fullsized":"2024-05-12T10:50:02.837562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:28.619988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660251+0000","last_change":"2024-05-12T10:49:55.621201+0000","last_active":"2024-05-12T10:50:01.660251+0000","last_peered":"2024-05-12T10:50:01.660251+0000","last_clean":"2024-05-12T10:50:01.660251+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:50:01.660251+0000","last_undegraded":"2024-05-12T10:50:01.660251+0000","last_fullsized":"2024-05-12T10:50:01.660251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:19:39.117790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916601+0000","last_change":"2024-05-12T10:49:54.620329+0000","last_active":"2024-05-12T10:50:02.916601+0000","last_peered":"2024-05-12T10:50:02.916601+0000","last_clean":"2024-05-12T10:50:02.916601+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:50:02.916601+0000","last_undegraded":"2024-05-12T10:50:02.916601+0000","last_fullsized":"2024-05-12T10:50:02.916601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:21:10.386830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916162+0000","last_change":"2024-05-12T10:49:59.655432+0000","last_active":"2024-05-12T10:50:02.916162+0000","last_peered":"2024-05-12T10:50:02.916162+0000","last_clean":"2024-05-12T10:50:02.916162+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:50:02.916162+0000","last_undegraded":"2024-05-12T10:50:02.916162+0000","last_fullsized":"2024-05-12T10:50:02.916162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:27:34.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658413+0000","last_change":"2024-05-12T10:49:55.628221+0000","last_active":"2024-05-12T10:50:01.658413+0000","last_peered":"2024-05-12T10:50:01.658413+0000","last_clean":"2024-05-12T10:50:01.658413+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:50:01.658413+0000","last_undegraded":"2024-05-12T10:50:01.658413+0000","last_fullsized":"2024-05-12T10:50:01.658413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:54.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659956+0000","last_change":"2024-05-12T10:49:54.652499+0000","last_active":"2024-05-12T10:50:01.659956+0000","last_peered":"2024-05-12T10:50:01.659956+0000","last_clean":"2024-05-12T10:50:01.659956+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:50:01.659956+0000","last_undegraded":"2024-05-12T10:50:01.659956+0000","last_fullsized":"2024-05-12T10:50:01.659956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:14:35.180779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916502+0000","last_change":"2024-05-12T10:49:59.676676+0000","last_active":"2024-05-12T10:50:02.916502+0000","last_peered":"2024-05-12T10:50:02.916502+0000","last_clean":"2024-05-12T10:50:02.916502+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:50:02.916502+0000","last_undegraded":"2024-05-12T10:50:02.916502+0000","last_fullsized":"2024-05-12T10:50:02.916502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:03:13.485130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916164+0000","last_change":"2024-05-12T10:49:55.610830+0000","last_active":"2024-05-12T10:50:02.916164+0000","last_peered":"2024-05-12T10:50:02.916164+0000","last_clean":"2024-05-12T10:50:02.916164+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:50:02.916164+0000","last_undegraded":"2024-05-12T10:50:02.916164+0000","last_fullsized":"2024-05-12T10:50:02.916164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:15.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.791800+0000","last_change":"2024-05-12T10:49:54.609239+0000","last_active":"2024-05-12T10:50:29.791800+0000","last_peered":"2024-05-12T10:50:29.791800+0000","last_clean":"2024-05-12T10:50:29.791800+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:50:29.791800+0000","last_undegraded":"2024-05-12T10:50:29.791800+0000","last_fullsized":"2024-05-12T10:50:29.791800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:12:54.169428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916817+0000","last_change":"2024-05-12T10:49:59.656739+0000","last_active":"2024-05-12T10:50:02.916817+0000","last_peered":"2024-05-12T10:50:02.916817+0000","last_clean":"2024-05-12T10:50:02.916817+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:50:02.916817+0000","last_undegraded":"2024-05-12T10:50:02.916817+0000","last_fullsized":"2024-05-12T10:50:02.916817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:05.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837232+0000","last_change":"2024-05-12T10:49:55.626312+0000","last_active":"2024-05-12T10:50:02.837232+0000","last_peered":"2024-05-12T10:50:02.837232+0000","last_clean":"2024-05-12T10:50:02.837232+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:50:02.837232+0000","last_undegraded":"2024-05-12T10:50:02.837232+0000","last_fullsized":"2024-05-12T10:50:02.837232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:36.639971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.791973+0000","last_change":"2024-05-12T10:49:54.640819+0000","last_active":"2024-05-12T10:50:29.791973+0000","last_peered":"2024-05-12T10:50:29.791973+0000","last_clean":"2024-05-12T10:50:29.791973+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:50:29.791973+0000","last_undegraded":"2024-05-12T10:50:29.791973+0000","last_fullsized":"2024-05-12T10:50:29.791973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:01.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837983+0000","last_change":"2024-05-12T10:50:00.384347+0000","last_active":"2024-05-12T10:50:02.837983+0000","last_peered":"2024-05-12T10:50:02.837983+0000","last_clean":"2024-05-12T10:50:02.837983+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:50:02.837983+0000","last_undegraded":"2024-05-12T10:50:02.837983+0000","last_fullsized":"2024-05-12T10:50:02.837983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:30.794704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652533+0000","last_change":"2024-05-12T10:49:55.627340+0000","last_active":"2024-05-12T10:50:01.652533+0000","last_peered":"2024-05-12T10:50:01.652533+0000","last_clean":"2024-05-12T10:50:01.652533+0000","last_became_active":"2024-05-12T10:49:55.627065+0000","last_became_peered":"2024-05-12T10:49:55.627065+0000","last_unstale":"2024-05-12T10:50:01.652533+0000","last_undegraded":"2024-05-12T10:50:01.652533+0000","last_fullsized":"2024-05-12T10:50:01.652533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:57:50.849518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.756339+0000","last_change":"2024-05-12T10:49:54.648333+0000","last_active":"2024-05-12T10:50:23.756339+0000","last_peered":"2024-05-12T10:50:23.756339+0000","last_clean":"2024-05-12T10:50:23.756339+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:50:23.756339+0000","last_undegraded":"2024-05-12T10:50:23.756339+0000","last_fullsized":"2024-05-12T10:50:23.756339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:29.355444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920043+0000","last_change":"2024-05-12T10:49:45.547469+0000","last_active":"2024-05-12T10:50:02.920043+0000","last_peered":"2024-05-12T10:50:02.920043+0000","last_clean":"2024-05-12T10:50:02.920043+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:50:02.920043+0000","last_undegraded":"2024-05-12T10:50:02.920043+0000","last_fullsized":"2024-05-12T10:50:02.920043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_clean_scrub_stamp":"2024-05-12T10:49:43.953472+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:44:15.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076721+0000","last_change":"2024-05-12T10:50:00.399288+0000","last_active":"2024-05-12T10:50:02.076721+0000","last_peered":"2024-05-12T10:50:02.076721+0000","last_clean":"2024-05-12T10:50:02.076721+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:50:02.076721+0000","last_undegraded":"2024-05-12T10:50:02.076721+0000","last_fullsized":"2024-05-12T10:50:02.076721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:26.959086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920561+0000","last_change":"2024-05-12T10:49:55.639605+0000","last_active":"2024-05-12T10:50:02.920561+0000","last_peered":"2024-05-12T10:50:02.920561+0000","last_clean":"2024-05-12T10:50:02.920561+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:50:02.920561+0000","last_undegraded":"2024-05-12T10:50:02.920561+0000","last_fullsized":"2024-05-12T10:50:02.920561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:46:26.585195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788076+0000","last_change":"2024-05-12T10:49:54.654999+0000","last_active":"2024-05-12T10:50:29.788076+0000","last_peered":"2024-05-12T10:50:29.788076+0000","last_clean":"2024-05-12T10:50:29.788076+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:50:29.788076+0000","last_undegraded":"2024-05-12T10:50:29.788076+0000","last_fullsized":"2024-05-12T10:50:29.788076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:00:20.115739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076118+0000","last_change":"2024-05-12T10:50:00.393017+0000","last_active":"2024-05-12T10:50:02.076118+0000","last_peered":"2024-05-12T10:50:02.076118+0000","last_clean":"2024-05-12T10:50:02.076118+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:50:02.076118+0000","last_undegraded":"2024-05-12T10:50:02.076118+0000","last_fullsized":"2024-05-12T10:50:02.076118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:01:02.394572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658363+0000","last_change":"2024-05-12T10:49:55.623665+0000","last_active":"2024-05-12T10:50:01.658363+0000","last_peered":"2024-05-12T10:50:01.658363+0000","last_clean":"2024-05-12T10:50:01.658363+0000","last_became_active":"2024-05-12T10:49:55.623403+0000","last_became_peered":"2024-05-12T10:49:55.623403+0000","last_unstale":"2024-05-12T10:50:01.658363+0000","last_undegraded":"2024-05-12T10:50:01.658363+0000","last_fullsized":"2024-05-12T10:50:01.658363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:18:25.399664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915873+0000","last_change":"2024-05-12T10:49:54.628492+0000","last_active":"2024-05-12T10:50:02.915873+0000","last_peered":"2024-05-12T10:50:02.915873+0000","last_clean":"2024-05-12T10:50:02.915873+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:50:02.915873+0000","last_undegraded":"2024-05-12T10:50:02.915873+0000","last_fullsized":"2024-05-12T10:50:02.915873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:35:38.949401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837763+0000","last_change":"2024-05-12T10:49:59.657783+0000","last_active":"2024-05-12T10:50:02.837763+0000","last_peered":"2024-05-12T10:50:02.837763+0000","last_clean":"2024-05-12T10:50:02.837763+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:50:02.837763+0000","last_undegraded":"2024-05-12T10:50:02.837763+0000","last_fullsized":"2024-05-12T10:50:02.837763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:51:21.103458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921189+0000","last_change":"2024-05-12T10:49:55.646246+0000","last_active":"2024-05-12T10:50:02.921189+0000","last_peered":"2024-05-12T10:50:02.921189+0000","last_clean":"2024-05-12T10:50:02.921189+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:50:02.921189+0000","last_undegraded":"2024-05-12T10:50:02.921189+0000","last_fullsized":"2024-05-12T10:50:02.921189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:32.142128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102403+0000","last_change":"2024-05-12T10:49:54.610076+0000","last_active":"2024-05-12T10:50:02.102403+0000","last_peered":"2024-05-12T10:50:02.102403+0000","last_clean":"2024-05-12T10:50:02.102403+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:50:02.102403+0000","last_undegraded":"2024-05-12T10:50:02.102403+0000","last_fullsized":"2024-05-12T10:50:02.102403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:12:04.400894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657078+0000","last_change":"2024-05-12T10:50:00.386172+0000","last_active":"2024-05-12T10:50:01.657078+0000","last_peered":"2024-05-12T10:50:01.657078+0000","last_clean":"2024-05-12T10:50:01.657078+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:50:01.657078+0000","last_undegraded":"2024-05-12T10:50:01.657078+0000","last_fullsized":"2024-05-12T10:50:01.657078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:06:17.550197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920926+0000","last_change":"2024-05-12T10:49:55.646249+0000","last_active":"2024-05-12T10:50:02.920926+0000","last_peered":"2024-05-12T10:50:02.920926+0000","last_clean":"2024-05-12T10:50:02.920926+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:50:02.920926+0000","last_undegraded":"2024-05-12T10:50:02.920926+0000","last_fullsized":"2024-05-12T10:50:02.920926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:15.036675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660898+0000","last_change":"2024-05-12T10:49:54.621293+0000","last_active":"2024-05-12T10:50:01.660898+0000","last_peered":"2024-05-12T10:50:01.660898+0000","last_clean":"2024-05-12T10:50:01.660898+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:50:01.660898+0000","last_undegraded":"2024-05-12T10:50:01.660898+0000","last_fullsized":"2024-05-12T10:50:01.660898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:45:33.341215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657581+0000","last_change":"2024-05-12T10:49:59.673656+0000","last_active":"2024-05-12T10:50:01.657581+0000","last_peered":"2024-05-12T10:50:01.657581+0000","last_clean":"2024-05-12T10:50:01.657581+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:50:01.657581+0000","last_undegraded":"2024-05-12T10:50:01.657581+0000","last_fullsized":"2024-05-12T10:50:01.657581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:38.364434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919917+0000","last_change":"2024-05-12T10:49:55.646526+0000","last_active":"2024-05-12T10:50:02.919917+0000","last_peered":"2024-05-12T10:50:02.919917+0000","last_clean":"2024-05-12T10:50:02.919917+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:50:02.919917+0000","last_undegraded":"2024-05-12T10:50:02.919917+0000","last_fullsized":"2024-05-12T10:50:02.919917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:56:52.102442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.793829+0000","last_change":"2024-05-12T10:49:54.617906+0000","last_active":"2024-05-12T10:50:29.793829+0000","last_peered":"2024-05-12T10:50:29.793829+0000","last_clean":"2024-05-12T10:50:29.793829+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:50:29.793829+0000","last_undegraded":"2024-05-12T10:50:29.793829+0000","last_fullsized":"2024-05-12T10:50:29.793829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:26:35.150963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837853+0000","last_change":"2024-05-12T10:49:59.671791+0000","last_active":"2024-05-12T10:50:02.837853+0000","last_peered":"2024-05-12T10:50:02.837853+0000","last_clean":"2024-05-12T10:50:02.837853+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:50:02.837853+0000","last_undegraded":"2024-05-12T10:50:02.837853+0000","last_fullsized":"2024-05-12T10:50:02.837853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:27.425708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076017+0000","last_change":"2024-05-12T10:49:55.637810+0000","last_active":"2024-05-12T10:50:02.076017+0000","last_peered":"2024-05-12T10:50:02.076017+0000","last_clean":"2024-05-12T10:50:02.076017+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:50:02.076017+0000","last_undegraded":"2024-05-12T10:50:02.076017+0000","last_fullsized":"2024-05-12T10:50:02.076017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:52.001497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.791060+0000","last_change":"2024-05-12T10:49:54.637728+0000","last_active":"2024-05-12T10:50:29.791060+0000","last_peered":"2024-05-12T10:50:29.791060+0000","last_clean":"2024-05-12T10:50:29.791060+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:50:29.791060+0000","last_undegraded":"2024-05-12T10:50:29.791060+0000","last_fullsized":"2024-05-12T10:50:29.791060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:39.996419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653563+0000","last_change":"2024-05-12T10:50:00.383444+0000","last_active":"2024-05-12T10:50:01.653563+0000","last_peered":"2024-05-12T10:50:01.653563+0000","last_clean":"2024-05-12T10:50:01.653563+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:50:01.653563+0000","last_undegraded":"2024-05-12T10:50:01.653563+0000","last_fullsized":"2024-05-12T10:50:01.653563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:55:04.226848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920128+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:50:02.920128+0000","last_peered":"2024-05-12T10:50:02.920128+0000","last_clean":"2024-05-12T10:50:02.920128+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:50:02.920128+0000","last_undegraded":"2024-05-12T10:50:02.920128+0000","last_fullsized":"2024-05-12T10:50:02.920128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:15:58.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.752272+0000","last_change":"2024-05-12T10:49:54.656814+0000","last_active":"2024-05-12T10:50:23.752272+0000","last_peered":"2024-05-12T10:50:23.752272+0000","last_clean":"2024-05-12T10:50:23.752272+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:50:23.752272+0000","last_undegraded":"2024-05-12T10:50:23.752272+0000","last_fullsized":"2024-05-12T10:50:23.752272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:26.660043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653232+0000","last_change":"2024-05-12T10:50:00.390308+0000","last_active":"2024-05-12T10:50:01.653232+0000","last_peered":"2024-05-12T10:50:01.653232+0000","last_clean":"2024-05-12T10:50:01.653232+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:50:01.653232+0000","last_undegraded":"2024-05-12T10:50:01.653232+0000","last_fullsized":"2024-05-12T10:50:01.653232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:43.650956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837442+0000","last_change":"2024-05-12T10:49:55.628907+0000","last_active":"2024-05-12T10:50:02.837442+0000","last_peered":"2024-05-12T10:50:02.837442+0000","last_clean":"2024-05-12T10:50:02.837442+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:50:02.837442+0000","last_undegraded":"2024-05-12T10:50:02.837442+0000","last_fullsized":"2024-05-12T10:50:02.837442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:13:50.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788848+0000","last_change":"2024-05-12T10:49:54.626002+0000","last_active":"2024-05-12T10:50:29.788848+0000","last_peered":"2024-05-12T10:50:29.788848+0000","last_clean":"2024-05-12T10:50:29.788848+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:50:29.788848+0000","last_undegraded":"2024-05-12T10:50:29.788848+0000","last_fullsized":"2024-05-12T10:50:29.788848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:19:19.976387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659867+0000","last_change":"2024-05-12T10:50:00.387192+0000","last_active":"2024-05-12T10:50:01.659867+0000","last_peered":"2024-05-12T10:50:01.659867+0000","last_clean":"2024-05-12T10:50:01.659867+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:50:01.659867+0000","last_undegraded":"2024-05-12T10:50:01.659867+0000","last_fullsized":"2024-05-12T10:50:01.659867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:15:23.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920487+0000","last_change":"2024-05-12T10:49:55.634551+0000","last_active":"2024-05-12T10:50:02.920487+0000","last_peered":"2024-05-12T10:50:02.920487+0000","last_clean":"2024-05-12T10:50:02.920487+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:50:02.920487+0000","last_undegraded":"2024-05-12T10:50:02.920487+0000","last_fullsized":"2024-05-12T10:50:02.920487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:10:52.477145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.761011+0000","last_change":"2024-05-12T10:49:54.634748+0000","last_active":"2024-05-12T10:50:23.761011+0000","last_peered":"2024-05-12T10:50:23.761011+0000","last_clean":"2024-05-12T10:50:23.761011+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:50:23.761011+0000","last_undegraded":"2024-05-12T10:50:23.761011+0000","last_fullsized":"2024-05-12T10:50:23.761011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:39:16.646133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916160+0000","last_change":"2024-05-12T10:49:59.671405+0000","last_active":"2024-05-12T10:50:02.916160+0000","last_peered":"2024-05-12T10:50:02.916160+0000","last_clean":"2024-05-12T10:50:02.916160+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:50:02.916160+0000","last_undegraded":"2024-05-12T10:50:02.916160+0000","last_fullsized":"2024-05-12T10:50:02.916160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:06:34.170753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659820+0000","last_change":"2024-05-12T10:49:55.634686+0000","last_active":"2024-05-12T10:50:01.659820+0000","last_peered":"2024-05-12T10:50:01.659820+0000","last_clean":"2024-05-12T10:50:01.659820+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:50:01.659820+0000","last_undegraded":"2024-05-12T10:50:01.659820+0000","last_fullsized":"2024-05-12T10:50:01.659820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:25:04.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.915954+0000","last_change":"2024-05-12T10:49:54.656012+0000","last_active":"2024-05-12T10:50:02.915954+0000","last_peered":"2024-05-12T10:50:02.915954+0000","last_clean":"2024-05-12T10:50:02.915954+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:50:02.915954+0000","last_undegraded":"2024-05-12T10:50:02.915954+0000","last_fullsized":"2024-05-12T10:50:02.915954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:29.253250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658272+0000","last_change":"2024-05-12T10:49:59.672820+0000","last_active":"2024-05-12T10:50:01.658272+0000","last_peered":"2024-05-12T10:50:01.658272+0000","last_clean":"2024-05-12T10:50:01.658272+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:50:01.658272+0000","last_undegraded":"2024-05-12T10:50:01.658272+0000","last_fullsized":"2024-05-12T10:50:01.658272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:49:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.838093+0000","last_change":"2024-05-12T10:49:55.620541+0000","last_active":"2024-05-12T10:50:02.838093+0000","last_peered":"2024-05-12T10:50:02.838093+0000","last_clean":"2024-05-12T10:50:02.838093+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:50:02.838093+0000","last_undegraded":"2024-05-12T10:50:02.838093+0000","last_fullsized":"2024-05-12T10:50:02.838093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:11.742829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.756880+0000","last_change":"2024-05-12T10:49:54.651289+0000","last_active":"2024-05-12T10:50:23.756880+0000","last_peered":"2024-05-12T10:50:23.756880+0000","last_clean":"2024-05-12T10:50:23.756880+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:50:23.756880+0000","last_undegraded":"2024-05-12T10:50:23.756880+0000","last_fullsized":"2024-05-12T10:50:23.756880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:33:24.087763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652523+0000","last_change":"2024-05-12T10:49:59.670973+0000","last_active":"2024-05-12T10:50:01.652523+0000","last_peered":"2024-05-12T10:50:01.652523+0000","last_clean":"2024-05-12T10:50:01.652523+0000","last_became_active":"2024-05-12T10:49:59.670656+0000","last_became_peered":"2024-05-12T10:49:59.670656+0000","last_unstale":"2024-05-12T10:50:01.652523+0000","last_undegraded":"2024-05-12T10:50:01.652523+0000","last_fullsized":"2024-05-12T10:50:01.652523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:16:58.665403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659979+0000","last_change":"2024-05-12T10:49:55.626645+0000","last_active":"2024-05-12T10:50:01.659979+0000","last_peered":"2024-05-12T10:50:01.659979+0000","last_clean":"2024-05-12T10:50:01.659979+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:50:01.659979+0000","last_undegraded":"2024-05-12T10:50:01.659979+0000","last_fullsized":"2024-05-12T10:50:01.659979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:41.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.761019+0000","last_change":"2024-05-12T10:49:54.654822+0000","last_active":"2024-05-12T10:50:23.761019+0000","last_peered":"2024-05-12T10:50:23.761019+0000","last_clean":"2024-05-12T10:50:23.761019+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:50:23.761019+0000","last_undegraded":"2024-05-12T10:50:23.761019+0000","last_fullsized":"2024-05-12T10:50:23.761019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:52:07.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652430+0000","last_change":"2024-05-12T10:50:00.396453+0000","last_active":"2024-05-12T10:50:01.652430+0000","last_peered":"2024-05-12T10:50:01.652430+0000","last_clean":"2024-05-12T10:50:01.652430+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:50:01.652430+0000","last_undegraded":"2024-05-12T10:50:01.652430+0000","last_fullsized":"2024-05-12T10:50:01.652430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:40.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837810+0000","last_change":"2024-05-12T10:50:00.390477+0000","last_active":"2024-05-12T10:50:02.837810+0000","last_peered":"2024-05-12T10:50:02.837810+0000","last_clean":"2024-05-12T10:50:02.837810+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:50:02.837810+0000","last_undegraded":"2024-05-12T10:50:02.837810+0000","last_fullsized":"2024-05-12T10:50:02.837810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:20:19.551216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916112+0000","last_change":"2024-05-12T10:49:55.619984+0000","last_active":"2024-05-12T10:50:02.916112+0000","last_peered":"2024-05-12T10:50:02.916112+0000","last_clean":"2024-05-12T10:50:02.916112+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:50:02.916112+0000","last_undegraded":"2024-05-12T10:50:02.916112+0000","last_fullsized":"2024-05-12T10:50:02.916112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:21:34.136203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.658089+0000","last_change":"2024-05-12T10:49:54.656580+0000","last_active":"2024-05-12T10:50:01.658089+0000","last_peered":"2024-05-12T10:50:01.658089+0000","last_clean":"2024-05-12T10:50:01.658089+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:50:01.658089+0000","last_undegraded":"2024-05-12T10:50:01.658089+0000","last_fullsized":"2024-05-12T10:50:01.658089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:43:32.603999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076883+0000","last_change":"2024-05-12T10:49:59.681648+0000","last_active":"2024-05-12T10:50:02.076883+0000","last_peered":"2024-05-12T10:50:02.076883+0000","last_clean":"2024-05-12T10:50:02.076883+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:50:02.076883+0000","last_undegraded":"2024-05-12T10:50:02.076883+0000","last_fullsized":"2024-05-12T10:50:02.076883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:54.912836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652618+0000","last_change":"2024-05-12T10:49:55.617393+0000","last_active":"2024-05-12T10:50:01.652618+0000","last_peered":"2024-05-12T10:50:01.652618+0000","last_clean":"2024-05-12T10:50:01.652618+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:50:01.652618+0000","last_undegraded":"2024-05-12T10:50:01.652618+0000","last_fullsized":"2024-05-12T10:50:01.652618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:51.584695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788252+0000","last_change":"2024-05-12T10:49:54.637393+0000","last_active":"2024-05-12T10:50:29.788252+0000","last_peered":"2024-05-12T10:50:29.788252+0000","last_clean":"2024-05-12T10:50:29.788252+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:50:29.788252+0000","last_undegraded":"2024-05-12T10:50:29.788252+0000","last_fullsized":"2024-05-12T10:50:29.788252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:44:00.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:29.788812+0000","last_change":"2024-05-12T10:49:54.636945+0000","last_active":"2024-05-12T10:50:29.788812+0000","last_peered":"2024-05-12T10:50:29.788812+0000","last_clean":"2024-05-12T10:50:29.788812+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:50:29.788812+0000","last_undegraded":"2024-05-12T10:50:29.788812+0000","last_fullsized":"2024-05-12T10:50:29.788812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:34:25.927458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837878+0000","last_change":"2024-05-12T10:49:55.627105+0000","last_active":"2024-05-12T10:50:02.837878+0000","last_peered":"2024-05-12T10:50:02.837878+0000","last_clean":"2024-05-12T10:50:02.837878+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:50:02.837878+0000","last_undegraded":"2024-05-12T10:50:02.837878+0000","last_fullsized":"2024-05-12T10:50:02.837878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:00:09.334541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102212+0000","last_change":"2024-05-12T10:49:59.659142+0000","last_active":"2024-05-12T10:50:02.102212+0000","last_peered":"2024-05-12T10:50:02.102212+0000","last_clean":"2024-05-12T10:50:02.102212+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:50:02.102212+0000","last_undegraded":"2024-05-12T10:50:02.102212+0000","last_fullsized":"2024-05-12T10:50:02.102212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:40.443593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:23.755012+0000","last_change":"2024-05-12T10:49:54.632224+0000","last_active":"2024-05-12T10:50:23.755012+0000","last_peered":"2024-05-12T10:50:23.755012+0000","last_clean":"2024-05-12T10:50:23.755012+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:50:23.755012+0000","last_undegraded":"2024-05-12T10:50:23.755012+0000","last_fullsized":"2024-05-12T10:50:23.755012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:27:39.637678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659206+0000","last_change":"2024-05-12T10:49:55.633243+0000","last_active":"2024-05-12T10:50:01.659206+0000","last_peered":"2024-05-12T10:50:01.659206+0000","last_clean":"2024-05-12T10:50:01.659206+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:50:01.659206+0000","last_undegraded":"2024-05-12T10:50:01.659206+0000","last_fullsized":"2024-05-12T10:50:01.659206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:14.239020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652874+0000","last_change":"2024-05-12T10:49:59.655807+0000","last_active":"2024-05-12T10:50:01.652874+0000","last_peered":"2024-05-12T10:50:01.652874+0000","last_clean":"2024-05-12T10:50:01.652874+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:50:01.652874+0000","last_undegraded":"2024-05-12T10:50:01.652874+0000","last_fullsized":"2024-05-12T10:50:01.652874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:12.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.075680+0000","last_change":"2024-05-12T10:49:55.637106+0000","last_active":"2024-05-12T10:50:02.075680+0000","last_peered":"2024-05-12T10:50:02.075680+0000","last_clean":"2024-05-12T10:50:02.075680+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:50:02.075680+0000","last_undegraded":"2024-05-12T10:50:02.075680+0000","last_fullsized":"2024-05-12T10:50:02.075680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:22:07.477677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.101967+0000","last_change":"2024-05-12T10:49:55.618952+0000","last_active":"2024-05-12T10:50:02.101967+0000","last_peered":"2024-05-12T10:50:02.101967+0000","last_clean":"2024-05-12T10:50:02.101967+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:50:02.101967+0000","last_undegraded":"2024-05-12T10:50:02.101967+0000","last_fullsized":"2024-05-12T10:50:02.101967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:38:10.693066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659549+0000","last_change":"2024-05-12T10:49:55.623916+0000","last_active":"2024-05-12T10:50:01.659549+0000","last_peered":"2024-05-12T10:50:01.659549+0000","last_clean":"2024-05-12T10:50:01.659549+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:50:01.659549+0000","last_undegraded":"2024-05-12T10:50:01.659549+0000","last_fullsized":"2024-05-12T10:50:01.659549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:06:14.434631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837761+0000","last_change":"2024-05-12T10:49:55.620278+0000","last_active":"2024-05-12T10:50:02.837761+0000","last_peered":"2024-05-12T10:50:02.837761+0000","last_clean":"2024-05-12T10:50:02.837761+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:50:02.837761+0000","last_undegraded":"2024-05-12T10:50:02.837761+0000","last_fullsized":"2024-05-12T10:50:02.837761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:59.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653439+0000","last_change":"2024-05-12T10:49:55.626216+0000","last_active":"2024-05-12T10:50:01.653439+0000","last_peered":"2024-05-12T10:50:01.653439+0000","last_clean":"2024-05-12T10:50:01.653439+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:50:01.653439+0000","last_undegraded":"2024-05-12T10:50:01.653439+0000","last_fullsized":"2024-05-12T10:50:01.653439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:52:14.438331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916463+0000","last_change":"2024-05-12T10:49:55.622085+0000","last_active":"2024-05-12T10:50:02.916463+0000","last_peered":"2024-05-12T10:50:02.916463+0000","last_clean":"2024-05-12T10:50:02.916463+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:50:02.916463+0000","last_undegraded":"2024-05-12T10:50:02.916463+0000","last_fullsized":"2024-05-12T10:50:02.916463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:41:42.558506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076984+0000","last_change":"2024-05-12T10:49:55.635592+0000","last_active":"2024-05-12T10:50:02.076984+0000","last_peered":"2024-05-12T10:50:02.076984+0000","last_clean":"2024-05-12T10:50:02.076984+0000","last_became_active":"2024-05-12T10:49:55.635298+0000","last_became_peered":"2024-05-12T10:49:55.635298+0000","last_unstale":"2024-05-12T10:50:02.076984+0000","last_undegraded":"2024-05-12T10:50:02.076984+0000","last_fullsized":"2024-05-12T10:50:02.076984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:43:14.781372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.653476+0000","last_change":"2024-05-12T10:49:55.626353+0000","last_active":"2024-05-12T10:50:01.653476+0000","last_peered":"2024-05-12T10:50:01.653476+0000","last_clean":"2024-05-12T10:50:01.653476+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:50:01.653476+0000","last_undegraded":"2024-05-12T10:50:01.653476+0000","last_fullsized":"2024-05-12T10:50:01.653476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:58.905284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657725+0000","last_change":"2024-05-12T10:49:55.621110+0000","last_active":"2024-05-12T10:50:01.657725+0000","last_peered":"2024-05-12T10:50:01.657725+0000","last_clean":"2024-05-12T10:50:01.657725+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:50:01.657725+0000","last_undegraded":"2024-05-12T10:50:01.657725+0000","last_fullsized":"2024-05-12T10:50:01.657725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:12:36.369923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652483+0000","last_change":"2024-05-12T10:49:55.626913+0000","last_active":"2024-05-12T10:50:01.652483+0000","last_peered":"2024-05-12T10:50:01.652483+0000","last_clean":"2024-05-12T10:50:01.652483+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:50:01.652483+0000","last_undegraded":"2024-05-12T10:50:01.652483+0000","last_fullsized":"2024-05-12T10:50:01.652483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:27:08.492294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659499+0000","last_change":"2024-05-12T10:49:55.629992+0000","last_active":"2024-05-12T10:50:01.659499+0000","last_peered":"2024-05-12T10:50:01.659499+0000","last_clean":"2024-05-12T10:50:01.659499+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:50:01.659499+0000","last_undegraded":"2024-05-12T10:50:01.659499+0000","last_fullsized":"2024-05-12T10:50:01.659499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:31.454363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837524+0000","last_change":"2024-05-12T10:49:55.620821+0000","last_active":"2024-05-12T10:50:02.837524+0000","last_peered":"2024-05-12T10:50:02.837524+0000","last_clean":"2024-05-12T10:50:02.837524+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:50:02.837524+0000","last_undegraded":"2024-05-12T10:50:02.837524+0000","last_fullsized":"2024-05-12T10:50:02.837524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:53.597215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076297+0000","last_change":"2024-05-12T10:49:55.646368+0000","last_active":"2024-05-12T10:50:02.076297+0000","last_peered":"2024-05-12T10:50:02.076297+0000","last_clean":"2024-05-12T10:50:02.076297+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:50:02.076297+0000","last_undegraded":"2024-05-12T10:50:02.076297+0000","last_fullsized":"2024-05-12T10:50:02.076297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:21:04.313921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920866+0000","last_change":"2024-05-12T10:49:55.633122+0000","last_active":"2024-05-12T10:50:02.920866+0000","last_peered":"2024-05-12T10:50:02.920866+0000","last_clean":"2024-05-12T10:50:02.920866+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:50:02.920866+0000","last_undegraded":"2024-05-12T10:50:02.920866+0000","last_fullsized":"2024-05-12T10:50:02.920866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:25:19.563648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.102362+0000","last_change":"2024-05-12T10:49:55.635394+0000","last_active":"2024-05-12T10:50:02.102362+0000","last_peered":"2024-05-12T10:50:02.102362+0000","last_clean":"2024-05-12T10:50:02.102362+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:50:02.102362+0000","last_undegraded":"2024-05-12T10:50:02.102362+0000","last_fullsized":"2024-05-12T10:50:02.102362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:41:58.478292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.660761+0000","last_change":"2024-05-12T10:49:55.626485+0000","last_active":"2024-05-12T10:50:01.660761+0000","last_peered":"2024-05-12T10:50:01.660761+0000","last_clean":"2024-05-12T10:50:01.660761+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:50:01.660761+0000","last_undegraded":"2024-05-12T10:50:01.660761+0000","last_fullsized":"2024-05-12T10:50:01.660761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:17.942339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657391+0000","last_change":"2024-05-12T10:49:55.618820+0000","last_active":"2024-05-12T10:50:01.657391+0000","last_peered":"2024-05-12T10:50:01.657391+0000","last_clean":"2024-05-12T10:50:01.657391+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:50:01.657391+0000","last_undegraded":"2024-05-12T10:50:01.657391+0000","last_fullsized":"2024-05-12T10:50:01.657391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:23:00.474438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916163+0000","last_change":"2024-05-12T10:49:55.626429+0000","last_active":"2024-05-12T10:50:02.916163+0000","last_peered":"2024-05-12T10:50:02.916163+0000","last_clean":"2024-05-12T10:50:02.916163+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:50:02.916163+0000","last_undegraded":"2024-05-12T10:50:02.916163+0000","last_fullsized":"2024-05-12T10:50:02.916163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:40:02.709729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837421+0000","last_change":"2024-05-12T10:49:55.612139+0000","last_active":"2024-05-12T10:50:02.837421+0000","last_peered":"2024-05-12T10:50:02.837421+0000","last_clean":"2024-05-12T10:50:02.837421+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:50:02.837421+0000","last_undegraded":"2024-05-12T10:50:02.837421+0000","last_fullsized":"2024-05-12T10:50:02.837421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:57:34.138392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652690+0000","last_change":"2024-05-12T10:49:55.631137+0000","last_active":"2024-05-12T10:50:01.652690+0000","last_peered":"2024-05-12T10:50:01.652690+0000","last_clean":"2024-05-12T10:50:01.652690+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:50:01.652690+0000","last_undegraded":"2024-05-12T10:50:01.652690+0000","last_fullsized":"2024-05-12T10:50:01.652690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:04.390314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659797+0000","last_change":"2024-05-12T10:49:55.643416+0000","last_active":"2024-05-12T10:50:01.659797+0000","last_peered":"2024-05-12T10:50:01.659797+0000","last_clean":"2024-05-12T10:50:01.659797+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:50:01.659797+0000","last_undegraded":"2024-05-12T10:50:01.659797+0000","last_fullsized":"2024-05-12T10:50:01.659797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:58.632966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076802+0000","last_change":"2024-05-12T10:49:55.635847+0000","last_active":"2024-05-12T10:50:02.076802+0000","last_peered":"2024-05-12T10:50:02.076802+0000","last_clean":"2024-05-12T10:50:02.076802+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:50:02.076802+0000","last_undegraded":"2024-05-12T10:50:02.076802+0000","last_fullsized":"2024-05-12T10:50:02.076802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:57:51.222099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.076561+0000","last_change":"2024-05-12T10:49:55.641921+0000","last_active":"2024-05-12T10:50:02.076561+0000","last_peered":"2024-05-12T10:50:02.076561+0000","last_clean":"2024-05-12T10:50:02.076561+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:50:02.076561+0000","last_undegraded":"2024-05-12T10:50:02.076561+0000","last_fullsized":"2024-05-12T10:50:02.076561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:44:57.787358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.921179+0000","last_change":"2024-05-12T10:49:55.635853+0000","last_active":"2024-05-12T10:50:02.921179+0000","last_peered":"2024-05-12T10:50:02.921179+0000","last_clean":"2024-05-12T10:50:02.921179+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:50:02.921179+0000","last_undegraded":"2024-05-12T10:50:02.921179+0000","last_fullsized":"2024-05-12T10:50:02.921179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:04:39.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.652297+0000","last_change":"2024-05-12T10:49:55.620107+0000","last_active":"2024-05-12T10:50:01.652297+0000","last_peered":"2024-05-12T10:50:01.652297+0000","last_clean":"2024-05-12T10:50:01.652297+0000","last_became_active":"2024-05-12T10:49:55.619802+0000","last_became_peered":"2024-05-12T10:49:55.619802+0000","last_unstale":"2024-05-12T10:50:01.652297+0000","last_undegraded":"2024-05-12T10:50:01.652297+0000","last_fullsized":"2024-05-12T10:50:01.652297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:52:39.033778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920076+0000","last_change":"2024-05-12T10:49:55.629001+0000","last_active":"2024-05-12T10:50:02.920076+0000","last_peered":"2024-05-12T10:50:02.920076+0000","last_clean":"2024-05-12T10:50:02.920076+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:50:02.920076+0000","last_undegraded":"2024-05-12T10:50:02.920076+0000","last_fullsized":"2024-05-12T10:50:02.920076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:42:39.042271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.659136+0000","last_change":"2024-05-12T10:49:55.625540+0000","last_active":"2024-05-12T10:50:01.659136+0000","last_peered":"2024-05-12T10:50:01.659136+0000","last_clean":"2024-05-12T10:50:01.659136+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:50:01.659136+0000","last_undegraded":"2024-05-12T10:50:01.659136+0000","last_fullsized":"2024-05-12T10:50:01.659136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:35.621918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.919665+0000","last_change":"2024-05-12T10:49:55.633576+0000","last_active":"2024-05-12T10:50:02.919665+0000","last_peered":"2024-05-12T10:50:02.919665+0000","last_clean":"2024-05-12T10:50:02.919665+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:50:02.919665+0000","last_undegraded":"2024-05-12T10:50:02.919665+0000","last_fullsized":"2024-05-12T10:50:02.919665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:06:16.255147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:01.657885+0000","last_change":"2024-05-12T10:49:55.624205+0000","last_active":"2024-05-12T10:50:01.657885+0000","last_peered":"2024-05-12T10:50:01.657885+0000","last_clean":"2024-05-12T10:50:01.657885+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:50:01.657885+0000","last_undegraded":"2024-05-12T10:50:01.657885+0000","last_fullsized":"2024-05-12T10:50:01.657885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:21.895269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.837757+0000","last_change":"2024-05-12T10:49:55.610461+0000","last_active":"2024-05-12T10:50:02.837757+0000","last_peered":"2024-05-12T10:50:02.837757+0000","last_clean":"2024-05-12T10:50:02.837757+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:50:02.837757+0000","last_undegraded":"2024-05-12T10:50:02.837757+0000","last_fullsized":"2024-05-12T10:50:02.837757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:44.511895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.916628+0000","last_change":"2024-05-12T10:49:55.608434+0000","last_active":"2024-05-12T10:50:02.916628+0000","last_peered":"2024-05-12T10:50:02.916628+0000","last_clean":"2024-05-12T10:50:02.916628+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:50:02.916628+0000","last_undegraded":"2024-05-12T10:50:02.916628+0000","last_fullsized":"2024-05-12T10:50:02.916628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:17.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-12T10:50:02.920943+0000","last_change":"2024-05-12T10:49:55.639296+0000","last_active":"2024-05-12T10:50:02.920943+0000","last_peered":"2024-05-12T10:50:02.920943+0000","last_clean":"2024-05-12T10:50:02.920943+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:50:02.920943+0000","last_undegraded":"2024-05-12T10:50:02.920943+0000","last_fullsized":"2024-05-12T10:50:02.920943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:47:15.862328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":888832,"data_stored":702380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":112074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":111410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":115250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":111514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":111640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":701724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:50:38.972 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:50:39.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f22a1600640 1 Processor -- start 2024-05-12T10:50:39.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f22a1600640 1 -- start start 2024-05-12T10:50:39.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f22a1600640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f229c153940 0x7f229c0c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f22a1600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f229c0c7680 0x7f229c0c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f22a1600640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f229c0c9400 con 0x7f229c15a1d0 2024-05-12T10:50:39.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f22a1600640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f229c0c8440 con 0x7f229c153940 2024-05-12T10:50:39.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f22a1600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f229c0c49c0 con 0x7f229c0c7680 2024-05-12T10:50:39.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f229aa00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f229c153940 0x7f229c0c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f229b400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f229c15a1d0 0x7f229c0cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50710/0 (socket says 172.21.15.115:50710) 2024-05-12T10:50:39.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f229b400640 1 -- 172.21.15.115:0/2026644631 learned_addr learned my addr 172.21.15.115:0/2026644631 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:39.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f229a000640 1 --2- 172.21.15.115:0/2026644631 >> v2:172.21.15.134:3300/0 conn(0x7f229c0c7680 0x7f229c0c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f229aa00640 1 -- 172.21.15.115:0/2026644631 >> v2:172.21.15.134:3300/0 conn(0x7f229c0c7680 msgr2=0x7f229c0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:39.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f229aa00640 1 --2- 172.21.15.115:0/2026644631 >> v2:172.21.15.134:3300/0 conn(0x7f229c0c7680 0x7f229c0c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f229aa00640 1 -- 172.21.15.115:0/2026644631 >> v1:172.21.15.115:6789/0 conn(0x7f229c15a1d0 legacy=0x7f229c0cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.152+0000 7f229aa00640 1 -- 172.21.15.115:0/2026644631 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229c0c4c60 con 0x7f229c153940 2024-05-12T10:50:39.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f229aa00640 1 --2- 172.21.15.115:0/2026644631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229c153940 0x7f229c0c7e20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f229c0caee0 tx=0x7f228c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2e15c484784512 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:39.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f2299600640 1 -- 172.21.15.115:0/2026644631 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c0b5070 con 0x7f229c153940 2024-05-12T10:50:39.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f2299600640 1 -- 172.21.15.115:0/2026644631 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228c0a8970 con 0x7f229c153940 2024-05-12T10:50:39.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f2299600640 1 -- 172.21.15.115:0/2026644631 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c0a8d40 con 0x7f229c153940 2024-05-12T10:50:39.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f22a1600640 1 -- 172.21.15.115:0/2026644631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229c153940 msgr2=0x7f229c0c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f22a1600640 1 --2- 172.21.15.115:0/2026644631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229c153940 0x7f229c0c7e20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f229c0caee0 tx=0x7f228c01ec70 comp rx=0 tx=0).stop 2024-05-12T10:50:39.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f22a1600640 1 -- 172.21.15.115:0/2026644631 shutdown_connections 2024-05-12T10:50:39.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f22a1600640 1 --2- 172.21.15.115:0/2026644631 >> v2:172.21.15.134:3300/0 conn(0x7f229c0c7680 0x7f229c0c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f22a1600640 1 --2- 172.21.15.115:0/2026644631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229c153940 0x7f229c0c7e20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f22a1600640 1 -- 172.21.15.115:0/2026644631 >> 172.21.15.115:0/2026644631 conn(0x7f229c0681c0 msgr2=0x7f229c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:39.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f22a1600640 1 -- 172.21.15.115:0/2026644631 shutdown_connections 2024-05-12T10:50:39.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.156+0000 7f22a1600640 1 -- 172.21.15.115:0/2026644631 wait complete. 2024-05-12T10:50:39.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f22a1600640 1 Processor -- start 2024-05-12T10:50:39.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f22a1600640 1 -- start start 2024-05-12T10:50:39.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f22a1600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f229c0c7680 0x7f229c1f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f22a1600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f229c153940 0x7f229c156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f22a1600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229c15a1d0 0x7f229c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f22a1600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f229c159cb0 con 0x7f229c15a1d0 2024-05-12T10:50:39.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f22a1600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f229c0c4f00 con 0x7f229c0c7680 2024-05-12T10:50:39.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f22a1600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f229c0cdaa0 con 0x7f229c153940 2024-05-12T10:50:39.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f229b400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229c15a1d0 0x7f229c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f229b400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229c15a1d0 0x7f229c15cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60954/0 (socket says 172.21.15.115:60954) 2024-05-12T10:50:39.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f229b400640 1 -- 172.21.15.115:0/606806994 learned_addr learned my addr 172.21.15.115:0/606806994 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:39.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f229a000640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f229c153940 0x7f229c156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f229aa00640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f229c0c7680 0x7f229c1f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f229b400640 1 -- 172.21.15.115:0/606806994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f229c153940 msgr2=0x7f229c156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f229b400640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f229c153940 0x7f229c156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f229b400640 1 -- 172.21.15.115:0/606806994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f229c0c7680 msgr2=0x7f229c1f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f229b400640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f229c0c7680 0x7f229c1f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f229b400640 1 -- 172.21.15.115:0/606806994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229c15acc0 con 0x7f229c15a1d0 2024-05-12T10:50:39.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f229b400640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229c15a1d0 0x7f229c15cb80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f229400cb40 tx=0x7f229400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:39.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f2292a00640 1 -- 172.21.15.115:0/606806994 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294017070 con 0x7f229c15a1d0 2024-05-12T10:50:39.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f2292a00640 1 -- 172.21.15.115:0/606806994 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229400ac40 con 0x7f229c15a1d0 2024-05-12T10:50:39.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f2292a00640 1 -- 172.21.15.115:0/606806994 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294012400 con 0x7f229c15a1d0 2024-05-12T10:50:39.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f22a1600640 1 -- 172.21.15.115:0/606806994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229c15afa0 con 0x7f229c15a1d0 2024-05-12T10:50:39.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.160+0000 7f22a1600640 1 -- 172.21.15.115:0/606806994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f229c15b560 con 0x7f229c15a1d0 2024-05-12T10:50:39.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.164+0000 7f22a1600640 1 -- 172.21.15.115:0/606806994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f229c069730 con 0x7f229c15a1d0 2024-05-12T10:50:39.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.164+0000 7f2292a00640 1 -- 172.21.15.115:0/606806994 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f229401a070 con 0x7f229c15a1d0 2024-05-12T10:50:39.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.164+0000 7f2292a00640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f227c06f430 0x7f227c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.164+0000 7f2292a00640 1 -- 172.21.15.115:0/606806994 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f229408f3c0 con 0x7f229c15a1d0 2024-05-12T10:50:39.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.164+0000 7f229aa00640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f227c06f430 0x7f227c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.164+0000 7f229aa00640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f227c06f430 0x7f227c0718f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f228c0b2000 tx=0x7f228c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:39.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.168+0000 7f2292a00640 1 -- 172.21.15.115:0/606806994 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f229c0c9400 con 0x7f229c15a1d0 2024-05-12T10:50:39.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.360+0000 7f22a1600640 1 -- 172.21.15.115:0/606806994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f229c0c88d0 con 0x7f229c15a1d0 2024-05-12T10:50:39.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.360+0000 7f2292a00640 1 -- 172.21.15.115:0/606806994 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f229405b7c0 con 0x7f229c15a1d0 2024-05-12T10:50:39.358 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:39.359 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:50:39.359 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:50:39.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 -- 172.21.15.115:0/606806994 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f227c06f430 msgr2=0x7f227c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f227c06f430 0x7f227c0718f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f228c0b2000 tx=0x7f228c008040 comp rx=0 tx=0).stop 2024-05-12T10:50:39.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 -- 172.21.15.115:0/606806994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229c15a1d0 msgr2=0x7f229c15cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229c15a1d0 0x7f229c15cb80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f229400cb40 tx=0x7f229400a060 comp rx=0 tx=0).stop 2024-05-12T10:50:39.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 -- 172.21.15.115:0/606806994 shutdown_connections 2024-05-12T10:50:39.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f227c06f430 0x7f227c0718f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f229c15a1d0 0x7f229c15cb80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f229c153940 0x7f229c156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 --2- 172.21.15.115:0/606806994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f229c0c7680 0x7f229c1f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 -- 172.21.15.115:0/606806994 >> 172.21.15.115:0/606806994 conn(0x7f229c0681c0 msgr2=0x7f229c1522f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:39.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 -- 172.21.15.115:0/606806994 shutdown_connections 2024-05-12T10:50:39.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.364+0000 7f22a1600640 1 -- 172.21.15.115:0/606806994 wait complete. 2024-05-12T10:50:39.379 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:50:39.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.516+0000 7f753f600640 1 Processor -- start 2024-05-12T10:50:39.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.516+0000 7f753f600640 1 -- start start 2024-05-12T10:50:39.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753f600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7538155c00 0x7f7538073e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753f600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 0x7f75380743b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753f600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753815bfe0 con 0x7f75380cb7d0 2024-05-12T10:50:39.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753f600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f753815cb60 con 0x7f7538155c00 2024-05-12T10:50:39.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753f600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f753815f350 con 0x7f7538071140 2024-05-12T10:50:39.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753d600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 0x7f75380743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753cc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7538155c00 0x7f7538073e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f752fe00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f75380cb7d0 0x7f753815f7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:58196/0 (socket says 172.21.15.115:58196) 2024-05-12T10:50:39.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753d600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 0x7f75380743b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:60094/0 (socket says 172.21.15.115:60094) 2024-05-12T10:50:39.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f752fe00640 1 -- 172.21.15.115:0/1042757819 learned_addr learned my addr 172.21.15.115:0/1042757819 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:39.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f7537e00640 1 -- 172.21.15.115:0/1042757819 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099125100 0 0) 0x7f753815bfe0 con 0x7f75380cb7d0 2024-05-12T10:50:39.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f7537e00640 1 -- 172.21.15.115:0/1042757819 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f751c003530 con 0x7f75380cb7d0 2024-05-12T10:50:39.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753cc00640 1 -- 172.21.15.115:0/1042757819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 msgr2=0x7f75380743b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:39.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753cc00640 1 --2- 172.21.15.115:0/1042757819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 0x7f75380743b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753cc00640 1 -- 172.21.15.115:0/1042757819 >> v1:172.21.15.134:6789/0 conn(0x7f75380cb7d0 legacy=0x7f753815f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753cc00640 1 -- 172.21.15.115:0/1042757819 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753815c2c0 con 0x7f7538155c00 2024-05-12T10:50:39.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.520+0000 7f753d600640 1 --2- 172.21.15.115:0/1042757819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 0x7f75380743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:50:39.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f753cc00640 1 --2- 172.21.15.115:0/1042757819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7538155c00 0x7f7538073e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f75280097c0 tx=0x7f752801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74cc949ff332964d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:39.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f7537e00640 1 -- 172.21.15.115:0/1042757819 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280b1070 con 0x7f7538155c00 2024-05-12T10:50:39.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f7537e00640 1 -- 172.21.15.115:0/1042757819 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75280a8050 con 0x7f7538155c00 2024-05-12T10:50:39.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f7537e00640 1 -- 172.21.15.115:0/1042757819 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280ac840 con 0x7f7538155c00 2024-05-12T10:50:39.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f753f600640 1 -- 172.21.15.115:0/1042757819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7538155c00 msgr2=0x7f7538073e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f753f600640 1 --2- 172.21.15.115:0/1042757819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7538155c00 0x7f7538073e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f75280097c0 tx=0x7f752801c3e0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f753f600640 1 -- 172.21.15.115:0/1042757819 shutdown_connections 2024-05-12T10:50:39.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f753f600640 1 --2- 172.21.15.115:0/1042757819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 0x7f75380743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f753f600640 1 --2- 172.21.15.115:0/1042757819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7538155c00 0x7f7538073e70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f753f600640 1 -- 172.21.15.115:0/1042757819 >> 172.21.15.115:0/1042757819 conn(0x7f75380681c0 msgr2=0x7f75380685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:39.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f753f600640 1 -- 172.21.15.115:0/1042757819 shutdown_connections 2024-05-12T10:50:39.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f753f600640 1 -- 172.21.15.115:0/1042757819 wait complete. 2024-05-12T10:50:39.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f753f600640 1 Processor -- start 2024-05-12T10:50:39.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.524+0000 7f753f600640 1 -- start start 2024-05-12T10:50:39.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753f600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 0x7f75380cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753f600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75380cb7d0 0x7f75381f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753f600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7538155c00 0x7f75381f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753f600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7538073640 con 0x7f7538155c00 2024-05-12T10:50:39.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753f600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75380734c0 con 0x7f75380cb7d0 2024-05-12T10:50:39.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753f600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f753815bba0 con 0x7f7538071140 2024-05-12T10:50:39.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753d600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7538155c00 0x7f75381f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753d600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7538155c00 0x7f75381f4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60966/0 (socket says 172.21.15.115:60966) 2024-05-12T10:50:39.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753d600640 1 -- 172.21.15.115:0/40498393 learned_addr learned my addr 172.21.15.115:0/40498393 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:39.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f752fe00640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75380cb7d0 0x7f75381f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753cc00640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 0x7f75380cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753d600640 1 -- 172.21.15.115:0/40498393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 msgr2=0x7f75380cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753d600640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 0x7f75380cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753d600640 1 -- 172.21.15.115:0/40498393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75380cb7d0 msgr2=0x7f75381f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753d600640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75380cb7d0 0x7f75381f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753d600640 1 -- 172.21.15.115:0/40498393 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7538155460 con 0x7f7538155c00 2024-05-12T10:50:39.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753d600640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7538155c00 0x7f75381f4f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f753000efc0 tx=0x7f753000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:39.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f7535600640 1 -- 172.21.15.115:0/40498393 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530018030 con 0x7f7538155c00 2024-05-12T10:50:39.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f7535600640 1 -- 172.21.15.115:0/40498393 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753000cd90 con 0x7f7538155c00 2024-05-12T10:50:39.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f7535600640 1 -- 172.21.15.115:0/40498393 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530003bc0 con 0x7f7538155c00 2024-05-12T10:50:39.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753f600640 1 -- 172.21.15.115:0/40498393 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753815ee60 con 0x7f7538155c00 2024-05-12T10:50:39.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753f600640 1 -- 172.21.15.115:0/40498393 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7538158e70 con 0x7f7538155c00 2024-05-12T10:50:39.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.528+0000 7f753f600640 1 -- 172.21.15.115:0/40498393 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7538069730 con 0x7f7538155c00 2024-05-12T10:50:39.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.532+0000 7f7535600640 1 -- 172.21.15.115:0/40498393 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f753001b070 con 0x7f7538155c00 2024-05-12T10:50:39.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.532+0000 7f7535600640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f751406f430 0x7f75140718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.532+0000 7f7535600640 1 -- 172.21.15.115:0/40498393 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f753008ff10 con 0x7f7538155c00 2024-05-12T10:50:39.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.532+0000 7f753cc00640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f751406f430 0x7f75140718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.532+0000 7f753cc00640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f751406f430 0x7f75140718f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75280ae000 tx=0x7f75280a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:39.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.536+0000 7f7535600640 1 -- 172.21.15.115:0/40498393 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7530022070 con 0x7f7538155c00 2024-05-12T10:50:39.728 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 -- 172.21.15.115:0/40498393 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75380c96d0 con 0x7f7538155c00 2024-05-12T10:50:39.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f7535600640 1 -- 172.21.15.115:0/40498393 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f7530010040 con 0x7f7538155c00 2024-05-12T10:50:39.729 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:39.729 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:50:39.730 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:50:39.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 -- 172.21.15.115:0/40498393 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f751406f430 msgr2=0x7f75140718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f751406f430 0x7f75140718f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75280ae000 tx=0x7f75280a7000 comp rx=0 tx=0).stop 2024-05-12T10:50:39.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 -- 172.21.15.115:0/40498393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7538155c00 msgr2=0x7f75381f4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7538155c00 0x7f75381f4f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f753000efc0 tx=0x7f753000c490 comp rx=0 tx=0).stop 2024-05-12T10:50:39.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 -- 172.21.15.115:0/40498393 shutdown_connections 2024-05-12T10:50:39.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f751406f430 0x7f75140718f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7538155c00 0x7f75381f4f20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75380cb7d0 0x7f75381f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 --2- 172.21.15.115:0/40498393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7538071140 0x7f75380cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 -- 172.21.15.115:0/40498393 >> 172.21.15.115:0/40498393 conn(0x7f75380681c0 msgr2=0x7f753815a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:39.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 -- 172.21.15.115:0/40498393 shutdown_connections 2024-05-12T10:50:39.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.732+0000 7f753f600640 1 -- 172.21.15.115:0/40498393 wait complete. 2024-05-12T10:50:39.751 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:50:39.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.892+0000 7f4539000640 1 Processor -- start 2024-05-12T10:50:39.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.892+0000 7f4539000640 1 -- start start 2024-05-12T10:50:39.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.892+0000 7f4539000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f45340c7680 0x7f45340c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.892+0000 7f4539000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f45340c5cd0 0x7f45340cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.892+0000 7f4539000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45340c9400 con 0x7f4534153940 2024-05-12T10:50:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.892+0000 7f4539000640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f45340c8440 con 0x7f45340c7680 2024-05-12T10:50:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.892+0000 7f4539000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f45340c49c0 con 0x7f45340c5cd0 2024-05-12T10:50:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.896+0000 7f4531400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f45340c7680 0x7f45340c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.896+0000 7f4531400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f45340c7680 0x7f45340c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60974/0 (socket says 172.21.15.115:60974) 2024-05-12T10:50:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.896+0000 7f4531400640 1 -- 172.21.15.115:0/3349949162 learned_addr learned my addr 172.21.15.115:0/3349949162 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.896+0000 7f4532800640 1 --2- 172.21.15.115:0/3349949162 >> v2:172.21.15.134:3300/0 conn(0x7f45340c5cd0 0x7f45340cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.896+0000 7f4531400640 1 -- 172.21.15.115:0/3349949162 >> v2:172.21.15.134:3300/0 conn(0x7f45340c5cd0 msgr2=0x7f45340cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.896+0000 7f4531400640 1 --2- 172.21.15.115:0/3349949162 >> v2:172.21.15.134:3300/0 conn(0x7f45340c5cd0 0x7f45340cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.896+0000 7f4531400640 1 -- 172.21.15.115:0/3349949162 >> v1:172.21.15.134:6789/0 conn(0x7f4534153940 legacy=0x7f453415a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.896+0000 7f4531400640 1 -- 172.21.15.115:0/3349949162 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45340c4c60 con 0x7f45340c7680 2024-05-12T10:50:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.896+0000 7f4531400640 1 --2- 172.21.15.115:0/3349949162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45340c7680 0x7f45340c7e20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f45340c7a90 tx=0x7f452001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3619057474e402 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4530a00640 1 -- 172.21.15.115:0/3349949162 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45200b5070 con 0x7f45340c7680 2024-05-12T10:50:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4530a00640 1 -- 172.21.15.115:0/3349949162 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45200a8a10 con 0x7f45340c7680 2024-05-12T10:50:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4530a00640 1 -- 172.21.15.115:0/3349949162 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45200a8de0 con 0x7f45340c7680 2024-05-12T10:50:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 -- 172.21.15.115:0/3349949162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45340c7680 msgr2=0x7f45340c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 --2- 172.21.15.115:0/3349949162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45340c7680 0x7f45340c7e20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f45340c7a90 tx=0x7f452001ed10 comp rx=0 tx=0).stop 2024-05-12T10:50:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 -- 172.21.15.115:0/3349949162 shutdown_connections 2024-05-12T10:50:39.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 --2- 172.21.15.115:0/3349949162 >> v2:172.21.15.134:3300/0 conn(0x7f45340c5cd0 0x7f45340cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 --2- 172.21.15.115:0/3349949162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45340c7680 0x7f45340c7e20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 -- 172.21.15.115:0/3349949162 >> 172.21.15.115:0/3349949162 conn(0x7f45340681c0 msgr2=0x7f45340685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:39.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 -- 172.21.15.115:0/3349949162 shutdown_connections 2024-05-12T10:50:39.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 -- 172.21.15.115:0/3349949162 wait complete. 2024-05-12T10:50:39.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 Processor -- start 2024-05-12T10:50:39.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 -- start start 2024-05-12T10:50:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45340c5cd0 0x7f4534070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45340c7680 0x7f45340cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4534153940 0x7f45340cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4534159cb0 con 0x7f45340c7680 2024-05-12T10:50:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f45340c4f00 con 0x7f45340c5cd0 2024-05-12T10:50:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4539000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f45340c60e0 con 0x7f4534153940 2024-05-12T10:50:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4531400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45340c7680 0x7f45340cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4531400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45340c7680 0x7f45340cd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60984/0 (socket says 172.21.15.115:60984) 2024-05-12T10:50:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4531400640 1 -- 172.21.15.115:0/3866128567 learned_addr learned my addr 172.21.15.115:0/3866128567 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.900+0000 7f4531e00640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45340c5cd0 0x7f4534070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f4532800640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4534153940 0x7f45340cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f4531400640 1 -- 172.21.15.115:0/3866128567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4534153940 msgr2=0x7f45340cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f4531400640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4534153940 0x7f45340cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f4531400640 1 -- 172.21.15.115:0/3866128567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45340c5cd0 msgr2=0x7f4534070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f4531400640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45340c5cd0 0x7f4534070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f4531400640 1 -- 172.21.15.115:0/3866128567 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45341513c0 con 0x7f45340c7680 2024-05-12T10:50:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f4531400640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45340c7680 0x7f45340cd070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f45200b3040 tx=0x7f452001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f452a000640 1 -- 172.21.15.115:0/3866128567 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45200b5070 con 0x7f45340c7680 2024-05-12T10:50:39.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f452a000640 1 -- 172.21.15.115:0/3866128567 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45200b0a50 con 0x7f45340c7680 2024-05-12T10:50:39.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f452a000640 1 -- 172.21.15.115:0/3866128567 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45200b0e40 con 0x7f45340c7680 2024-05-12T10:50:39.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f4539000640 1 -- 172.21.15.115:0/3866128567 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45341516a0 con 0x7f45340c7680 2024-05-12T10:50:39.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f4539000640 1 -- 172.21.15.115:0/3866128567 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4534151c60 con 0x7f45340c7680 2024-05-12T10:50:39.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f4539000640 1 -- 172.21.15.115:0/3866128567 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4534069730 con 0x7f45340c7680 2024-05-12T10:50:39.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f452a000640 1 -- 172.21.15.115:0/3866128567 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f45200c2060 con 0x7f45340c7680 2024-05-12T10:50:39.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.904+0000 7f452a000640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f451406f400 0x7f45140718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:39.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.908+0000 7f452a000640 1 -- 172.21.15.115:0/3866128567 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f452012c690 con 0x7f45340c7680 2024-05-12T10:50:39.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.908+0000 7f4531e00640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f451406f400 0x7f45140718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:39.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.908+0000 7f4531e00640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f451406f400 0x7f45140718c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4524007fd0 tx=0x7f4524009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:39.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:39.908+0000 7f452a000640 1 -- 172.21.15.115:0/3866128567 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4520018870 con 0x7f45340c7680 2024-05-12T10:50:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.068+0000 7f4539000640 1 -- 172.21.15.115:0/3866128567 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45340c88d0 con 0x7f45340c7680 2024-05-12T10:50:40.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f452a000640 1 -- 172.21.15.115:0/3866128567 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18937 (secure 0 0 0) 0x7f45200f9200 con 0x7f45340c7680 2024-05-12T10:50:40.068 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:40.068 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":28,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:36.829784+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:50:40.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 -- 172.21.15.115:0/3866128567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f451406f400 msgr2=0x7f45140718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:40.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f451406f400 0x7f45140718c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4524007fd0 tx=0x7f4524009040 comp rx=0 tx=0).stop 2024-05-12T10:50:40.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 -- 172.21.15.115:0/3866128567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45340c7680 msgr2=0x7f45340cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:40.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45340c7680 0x7f45340cd070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f45200b3040 tx=0x7f452001bab0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 -- 172.21.15.115:0/3866128567 shutdown_connections 2024-05-12T10:50:40.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f451406f400 0x7f45140718c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4534153940 0x7f45340cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45340c7680 0x7f45340cd070 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 --2- 172.21.15.115:0/3866128567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45340c5cd0 0x7f4534070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 -- 172.21.15.115:0/3866128567 >> 172.21.15.115:0/3866128567 conn(0x7f45340681c0 msgr2=0x7f453415a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:40.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 -- 172.21.15.115:0/3866128567 shutdown_connections 2024-05-12T10:50:40.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.072+0000 7f4539000640 1 -- 172.21.15.115:0/3866128567 wait complete. 2024-05-12T10:50:40.090 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get run_dir 2024-05-12T10:50:40.236 INFO:teuthology.orchestra.run.smithi115.stdout:{"run_dir":"/var/run/ceph"} 2024-05-12T10:50:40.237 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-05-12T10:50:40.237 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7749 2024-05-12T10:50:40.237 DEBUG:tasks.quiescer:Yielding 2024-05-12T10:50:40.237 INFO:teuthology.run_tasks:Running task workunit... 2024-05-12T10:50:40.250 INFO:tasks.workunit:Pulling workunits from ref f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:50:40.250 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-12T10:50:40.250 INFO:tasks.workunit:timeout=3h 2024-05-12T10:50:40.250 INFO:tasks.workunit:cleanup=True 2024-05-12T10:50:40.251 DEBUG:teuthology.orchestra.run.smithi115:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-12T10:50:40.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:50:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-12T10:50:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-12T10:50:40.260 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-05-12T10:50:40.260 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:50:40.260 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-12T10:50:40.260 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-12 10:50:00.617628992 +0000 2024-05-12T10:50:40.261 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-12 10:50:09.373631853 +0000 2024-05-12T10:50:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-05-12 10:50:00.617628992 +0000 2024-05-12T10:50:40.261 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-12T10:50:40.261 DEBUG:teuthology.orchestra.run.smithi115:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-12T10:50:40.338 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:50:40.390 INFO:tasks.workunit.client.0.smithi115.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-12T10:50:40.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee39a00640 1 Processor -- start 2024-05-12T10:50:40.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee39a00640 1 -- start start 2024-05-12T10:50:40.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee39a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fee3415a330 0x7fee340cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:40.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee39a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee34153fa0 con 0x7fee340713f0 2024-05-12T10:50:40.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee39a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee340ca6d0 con 0x7fee34153bc0 2024-05-12T10:50:40.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee39a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fee340ca350 con 0x7fee3415a330 2024-05-12T10:50:40.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee33400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fee340713f0 0x7fee340cb9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50724/0 (socket says 172.21.15.115:50724) 2024-05-12T10:50:40.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee33400640 1 -- 172.21.15.115:0/4253119138 learned_addr learned my addr 172.21.15.115:0/4253119138 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:40.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee39000640 1 --2- 172.21.15.115:0/4253119138 >> v2:172.21.15.115:3300/0 conn(0x7fee3415a330 0x7fee340cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:40.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee39000640 1 -- 172.21.15.115:0/4253119138 >> v1:172.21.15.134:6789/0 conn(0x7fee34153bc0 legacy=0x7fee34070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:40.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee39000640 1 -- 172.21.15.115:0/4253119138 >> v1:172.21.15.115:6789/0 conn(0x7fee340713f0 legacy=0x7fee340cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:40.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee39000640 1 -- 172.21.15.115:0/4253119138 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee340ca9b0 con 0x7fee3415a330 2024-05-12T10:50:40.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.396+0000 7fee32a00640 1 -- 172.21.15.115:0/4253119138 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415978611 0 0) 0x7fee34153fa0 con 0x7fee340713f0 2024-05-12T10:50:40.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.400+0000 7fee39000640 1 --2- 172.21.15.115:0/4253119138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3415a330 0x7fee340cc100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009d90 tx=0x7fee2c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9776611b5d91a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:40.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.400+0000 7fee32a00640 1 -- 172.21.15.115:0/4253119138 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0b2070 con 0x7fee3415a330 2024-05-12T10:50:40.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.400+0000 7fee32a00640 1 -- 172.21.15.115:0/4253119138 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee2c0a5940 con 0x7fee3415a330 2024-05-12T10:50:40.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.400+0000 7fee32a00640 1 -- 172.21.15.115:0/4253119138 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0a5d10 con 0x7fee3415a330 2024-05-12T10:50:40.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.400+0000 7fee39a00640 1 -- 172.21.15.115:0/4253119138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3415a330 msgr2=0x7fee340cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:40.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.400+0000 7fee39a00640 1 --2- 172.21.15.115:0/4253119138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3415a330 0x7fee340cc100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009d90 tx=0x7fee2c01c970 comp rx=0 tx=0).stop 2024-05-12T10:50:40.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.400+0000 7fee39a00640 1 -- 172.21.15.115:0/4253119138 shutdown_connections 2024-05-12T10:50:40.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.400+0000 7fee39a00640 1 --2- 172.21.15.115:0/4253119138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3415a330 0x7fee340cc100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.400+0000 7fee39a00640 1 -- 172.21.15.115:0/4253119138 >> 172.21.15.115:0/4253119138 conn(0x7fee34071e30 msgr2=0x7fee34072240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:40.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.400+0000 7fee39a00640 1 -- 172.21.15.115:0/4253119138 shutdown_connections 2024-05-12T10:50:40.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.400+0000 7fee39a00640 1 -- 172.21.15.115:0/4253119138 wait complete. 2024-05-12T10:50:40.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39a00640 1 Processor -- start 2024-05-12T10:50:40.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39a00640 1 -- start start 2024-05-12T10:50:40.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee340713f0 0x7fee3406ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:40.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee34153bc0 0x7fee34142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:40.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3415a330 0x7fee341431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:40.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fee34071090 con 0x7fee3415a330 2024-05-12T10:50:40.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee340cc640 con 0x7fee34153bc0 2024-05-12T10:50:40.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fee34071210 con 0x7fee340713f0 2024-05-12T10:50:40.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3415a330 0x7fee341431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:40.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3415a330 0x7fee341431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32770/0 (socket says 172.21.15.115:32770) 2024-05-12T10:50:40.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39000640 1 -- 172.21.15.115:0/2016025008 learned_addr learned my addr 172.21.15.115:0/2016025008 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:40.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee33400640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee34153bc0 0x7fee34142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:40.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee33e00640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee340713f0 0x7fee3406ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39000640 1 -- 172.21.15.115:0/2016025008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee340713f0 msgr2=0x7fee3406ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39000640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee340713f0 0x7fee3406ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39000640 1 -- 172.21.15.115:0/2016025008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee34153bc0 msgr2=0x7fee34142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39000640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee34153bc0 0x7fee34142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39000640 1 -- 172.21.15.115:0/2016025008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee340c9d50 con 0x7fee3415a330 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee33e00640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee340713f0 0x7fee3406ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee33400640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee34153bc0 0x7fee34142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39000640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3415a330 0x7fee341431c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0b0040 tx=0x7fee2c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee2be00640 1 -- 172.21.15.115:0/2016025008 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0b2040 con 0x7fee3415a330 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee2be00640 1 -- 172.21.15.115:0/2016025008 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee2c0bf070 con 0x7fee3415a330 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee2be00640 1 -- 172.21.15.115:0/2016025008 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0ad8c0 con 0x7fee3415a330 2024-05-12T10:50:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39a00640 1 -- 172.21.15.115:0/2016025008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee34069940 con 0x7fee3415a330 2024-05-12T10:50:40.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.404+0000 7fee39a00640 1 -- 172.21.15.115:0/2016025008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee3406d860 con 0x7fee3415a330 2024-05-12T10:50:40.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.408+0000 7fee39a00640 1 -- 172.21.15.115:0/2016025008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee34050750 con 0x7fee3415a330 2024-05-12T10:50:40.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.408+0000 7fee2be00640 1 -- 172.21.15.115:0/2016025008 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fee2c0ada60 con 0x7fee3415a330 2024-05-12T10:50:40.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.408+0000 7fee2be00640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee1406f430 0x7fee140718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:40.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.408+0000 7fee2be00640 1 -- 172.21.15.115:0/2016025008 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fee2c12a630 con 0x7fee3415a330 2024-05-12T10:50:40.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.408+0000 7fee33e00640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee1406f430 0x7fee140718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:40.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.408+0000 7fee33e00640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee1406f430 0x7fee140718f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee24000f70 tx=0x7fee24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:40.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.412+0000 7fee2be00640 1 -- 172.21.15.115:0/2016025008 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fee2c016560 con 0x7fee3415a330 2024-05-12T10:50:40.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.624+0000 7fee39a00640 1 -- 172.21.15.115:0/2016025008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee3406db40 con 0x7fee3415a330 2024-05-12T10:50:40.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee2be00640 1 -- 172.21.15.115:0/2016025008 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7fee2c0f7240 con 0x7fee3415a330 2024-05-12T10:50:40.624 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:40.624 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:50:40.624 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:50:40.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 -- 172.21.15.115:0/2016025008 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee1406f430 msgr2=0x7fee140718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:40.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee1406f430 0x7fee140718f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee24000f70 tx=0x7fee24009040 comp rx=0 tx=0).stop 2024-05-12T10:50:40.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 -- 172.21.15.115:0/2016025008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3415a330 msgr2=0x7fee341431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:40.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3415a330 0x7fee341431c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0b0040 tx=0x7fee2c019710 comp rx=0 tx=0).stop 2024-05-12T10:50:40.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 -- 172.21.15.115:0/2016025008 shutdown_connections 2024-05-12T10:50:40.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee1406f430 0x7fee140718f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3415a330 0x7fee341431c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee34153bc0 0x7fee34142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 --2- 172.21.15.115:0/2016025008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee340713f0 0x7fee3406ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:40.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 -- 172.21.15.115:0/2016025008 >> 172.21.15.115:0/2016025008 conn(0x7fee34071e30 msgr2=0x7fee34072210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:40.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 -- 172.21.15.115:0/2016025008 shutdown_connections 2024-05-12T10:50:40.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:40.628+0000 7fee39a00640 1 -- 172.21.15.115:0/2016025008 wait complete. 2024-05-12T10:50:41.249 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-12T10:49:54.988983+0000', 'modified': '2024-05-12T10:50:29.799298+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4321, 'mds_1': 4309, 'mds_2': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.115:6839/3194167246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 3194167246}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 3194167246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4309': {'gid': 4309, 'name': 'e', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.115:6837/4177777929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6835', 'nonce': 4177777929}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 4177777929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4321': {'gid': 4321, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6835/1447701149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 1447701149}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 1447701149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4321, 'qdb_cluster': [4260, 4309, 4321]} 2024-05-12T10:50:41.250 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-12T10:50:41.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-12T10:50:41.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.388+0000 7fe7b0a00640 1 Processor -- start 2024-05-12T10:50:41.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.388+0000 7fe7b0a00640 1 -- start start 2024-05-12T10:50:41.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7b0a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe7ac155e00 0x7fe7ac0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7b0a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe7ac1561e0 0x7fe7ac06c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7b0a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ac0687e0 con 0x7fe7ac0cc370 2024-05-12T10:50:41.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7b0a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ac0cbeb0 con 0x7fe7ac1561e0 2024-05-12T10:50:41.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7b0a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ac0cc950 con 0x7fe7ac155e00 2024-05-12T10:50:41.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a1400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe7ac1561e0 0x7fe7ac06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a1400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe7ac1561e0 0x7fe7ac06c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32784/0 (socket says 172.21.15.115:32784) 2024-05-12T10:50:41.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a1400640 1 -- 172.21.15.115:0/1858308394 learned_addr learned my addr 172.21.15.115:0/1858308394 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/1858308394 >> v2:172.21.15.134:3300/0 conn(0x7fe7ac155e00 0x7fe7ac0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a1400640 1 -- 172.21.15.115:0/1858308394 >> v2:172.21.15.134:3300/0 conn(0x7fe7ac155e00 msgr2=0x7fe7ac0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a1400640 1 --2- 172.21.15.115:0/1858308394 >> v2:172.21.15.134:3300/0 conn(0x7fe7ac155e00 0x7fe7ac0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a1400640 1 -- 172.21.15.115:0/1858308394 >> v1:172.21.15.134:6789/0 conn(0x7fe7ac0cc370 legacy=0x7fe7ac15f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a1400640 1 -- 172.21.15.115:0/1858308394 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac0ccc10 con 0x7fe7ac1561e0 2024-05-12T10:50:41.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a1400640 1 --2- 172.21.15.115:0/1858308394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7ac1561e0 0x7fe7ac06c440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac06d030 tx=0x7fe79401eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0396610effd8ac server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a9400640 1 -- 172.21.15.115:0/1858308394 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940b5070 con 0x7fe7ac1561e0 2024-05-12T10:50:41.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a9400640 1 -- 172.21.15.115:0/1858308394 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7940a87f0 con 0x7fe7ac1561e0 2024-05-12T10:50:41.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.392+0000 7fe7a9400640 1 -- 172.21.15.115:0/1858308394 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940a8bc0 con 0x7fe7ac1561e0 2024-05-12T10:50:41.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 -- 172.21.15.115:0/1858308394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7ac1561e0 msgr2=0x7fe7ac06c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 --2- 172.21.15.115:0/1858308394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7ac1561e0 0x7fe7ac06c440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac06d030 tx=0x7fe79401eb30 comp rx=0 tx=0).stop 2024-05-12T10:50:41.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 -- 172.21.15.115:0/1858308394 shutdown_connections 2024-05-12T10:50:41.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 --2- 172.21.15.115:0/1858308394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7ac1561e0 0x7fe7ac06c440 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 --2- 172.21.15.115:0/1858308394 >> v2:172.21.15.134:3300/0 conn(0x7fe7ac155e00 0x7fe7ac0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 -- 172.21.15.115:0/1858308394 >> 172.21.15.115:0/1858308394 conn(0x7fe7ac0cdb70 msgr2=0x7fe7ac0cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 -- 172.21.15.115:0/1858308394 shutdown_connections 2024-05-12T10:50:41.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 -- 172.21.15.115:0/1858308394 wait complete. 2024-05-12T10:50:41.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 Processor -- start 2024-05-12T10:50:41.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 -- start start 2024-05-12T10:50:41.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7ac0cc370 0x7fe7ac1f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ac155e00 0x7fe7ac159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1561e0 0x7fe7ac1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac0cd4b0 con 0x7fe7ac0cc370 2024-05-12T10:50:41.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac0cd1d0 con 0x7fe7ac155e00 2024-05-12T10:50:41.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7b0a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac0cd790 con 0x7fe7ac1561e0 2024-05-12T10:50:41.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7a9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7ac0cc370 0x7fe7ac1f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7a9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7ac0cc370 0x7fe7ac1f2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32788/0 (socket says 172.21.15.115:32788) 2024-05-12T10:50:41.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2155112642 learned_addr learned my addr 172.21.15.115:0/2155112642 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7a1400640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ac155e00 0x7fe7ac159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7aa800640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1561e0 0x7fe7ac1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2155112642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1561e0 msgr2=0x7fe7ac1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1561e0 0x7fe7ac1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2155112642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ac155e00 msgr2=0x7fe7ac159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ac155e00 0x7fe7ac159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.396+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2155112642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac156810 con 0x7fe7ac0cc370 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7aa800640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1561e0 0x7fe7ac1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7a1400640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ac155e00 0x7fe7ac159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7ac0cc370 0x7fe7ac1f2630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00d830 tx=0x7fe79c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7a2a00640 1 -- 172.21.15.115:0/2155112642 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00b6c0 con 0x7fe7ac0cc370 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7a2a00640 1 -- 172.21.15.115:0/2155112642 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79c019070 con 0x7fe7ac0cc370 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7b0a00640 1 -- 172.21.15.115:0/2155112642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac156af0 con 0x7fe7ac0cc370 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7a2a00640 1 -- 172.21.15.115:0/2155112642 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00ba60 con 0x7fe7ac0cc370 2024-05-12T10:50:41.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7b0a00640 1 -- 172.21.15.115:0/2155112642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac158970 con 0x7fe7ac0cc370 2024-05-12T10:50:41.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7a2a00640 1 -- 172.21.15.115:0/2155112642 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe79c01e460 con 0x7fe7ac0cc370 2024-05-12T10:50:41.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7a2a00640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe78806f430 0x7fe7880718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7a2a00640 1 -- 172.21.15.115:0/2155112642 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe79c08fd20 con 0x7fe7ac0cc370 2024-05-12T10:50:41.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7a1400640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe78806f430 0x7fe7880718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.400+0000 7fe7b3f96000 1 Processor -- start 2024-05-12T10:50:41.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 -- start start 2024-05-12T10:50:41.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7a1400640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe78806f430 0x7fe7880718f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe7940b2000 tx=0x7fe7940aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96bd8a0 0x562af96bdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96be1c0 0x562af96be5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96beae0 0x562af96c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562af9563600 con 0x562af96be1c0 2024-05-12T10:50:41.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562af947e720 con 0x562af96beae0 2024-05-12T10:50:41.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562af94cc070 con 0x562af96bd8a0 2024-05-12T10:50:41.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7a1400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96be1c0 0x562af96be5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7a1400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96be1c0 0x562af96be5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32798/0 (socket says 172.21.15.115:32798) 2024-05-12T10:50:41.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7a1400640 1 -- 172.21.15.115:0/2301063159 learned_addr learned my addr 172.21.15.115:0/2301063159 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/2301063159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96bd8a0 0x562af96bdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7aa800640 1 --2- 172.21.15.115:0/2301063159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96beae0 0x562af96c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7a1400640 1 -- 172.21.15.115:0/2301063159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96bd8a0 msgr2=0x562af96bdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7a1400640 1 --2- 172.21.15.115:0/2301063159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96bd8a0 0x562af96bdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7a1400640 1 -- 172.21.15.115:0/2301063159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96beae0 msgr2=0x562af96c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7a1400640 1 --2- 172.21.15.115:0/2301063159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96beae0 0x562af96c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7a1400640 1 -- 172.21.15.115:0/2301063159 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562af9660080 con 0x562af96be1c0 2024-05-12T10:50:41.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7a1400640 1 --2- 172.21.15.115:0/2301063159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96be1c0 0x562af96be5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7940b3040 tx=0x7fe794004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e77ff749691cd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe79aa00640 1 -- 172.21.15.115:0/2301063159 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940cc070 con 0x562af96be1c0 2024-05-12T10:50:41.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe79aa00640 1 -- 172.21.15.115:0/2301063159 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7940b6040 con 0x562af96be1c0 2024-05-12T10:50:41.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe79aa00640 1 -- 172.21.15.115:0/2301063159 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940c7670 con 0x562af96be1c0 2024-05-12T10:50:41.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2301063159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96be1c0 msgr2=0x562af96be5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2301063159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96be1c0 0x562af96be5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7940b3040 tx=0x7fe794004740 comp rx=0 tx=0).stop 2024-05-12T10:50:41.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2301063159 shutdown_connections 2024-05-12T10:50:41.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2301063159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96beae0 0x562af96c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2301063159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96be1c0 0x562af96be5a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2301063159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96bd8a0 0x562af96bdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2301063159 >> 172.21.15.115:0/2301063159 conn(0x562af96b9650 msgr2=0x562af96bba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2301063159 shutdown_connections 2024-05-12T10:50:41.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2301063159 wait complete. 2024-05-12T10:50:41.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 -- start start 2024-05-12T10:50:41.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.404+0000 7fe7b3f96000 1 Processor -- start 2024-05-12T10:50:41.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9681e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af9682350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96beae0 0x562af967d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562af94c8030 con 0x562af96bd8a0 2024-05-12T10:50:41.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562af9484ea0 con 0x562af96be1c0 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562af946bc70 con 0x562af96beae0 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 10 client.0 _ll_register_callbacks cb 0x562af9667e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9681e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a1400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af9682350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9681e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32806/0 (socket says 172.21.15.115:32806) 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2439767619 learned_addr learned my addr 172.21.15.115:0/2439767619 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7aa800640 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96beae0 0x562af967d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2439767619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96beae0 msgr2=0x562af967d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96beae0 0x562af967d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2439767619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 msgr2=0x562af9682350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af9682350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2439767619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562af95766d0 con 0x562af96bd8a0 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9681e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00d800 tx=0x7fe79c05bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1235a10a34e8ff38 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe78f400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe78f400640 1 -- 172.21.15.115:0/2439767619 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c08b060 con 0x562af96bd8a0 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe78f400640 1 -- 172.21.15.115:0/2439767619 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe79c05b5f0 con 0x562af96bd8a0 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2439767619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7940b6040 con 0x562af96bd8a0 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe78f400640 1 -- 172.21.15.115:0/2439767619 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fe79c075070 con 0x562af96bd8a0 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 10 client.4782 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2439767619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562af9572680 con 0x562af96bd8a0 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe78f400640 1 -- 172.21.15.115:0/2439767619 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7940b6040 con 0x562af96bd8a0 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe78f400640 1 -- 172.21.15.115:0/2439767619 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fe79c013070 con 0x562af96bd8a0 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 10 client.4782 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 10 client.4782 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 20 client.4782 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562af96d1290 0x562af96d3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 4 client.4782 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:50:41.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2439767619 --> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562af9464bc0 con 0x562af96d1290 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a1400640 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562af96d1290 0x562af96d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe7a1400640 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562af96d1290 0x562af96d3680 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=222ba034b397d306 server_cookie=ffde7c13cfd1f260 in_seq=0 out_seq=0 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.408+0000 7fe78f400640 10 client.4782 ms_handle_connect on v2:172.21.15.115:6836/3194167246 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe78f400640 1 -- 172.21.15.115:0/2439767619 <== mds.2 v2:172.21.15.115:6836/3194167246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562af9464bc0 con 0x562af96d1290 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe78f400640 10 client.4782 handle_command_reply: tid=0 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 1 client.4782 shutdown 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2439767619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 msgr2=0x562af9681e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9681e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00d800 tx=0x7fe79c05bca0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2439767619 shutdown_connections 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562af96d1290 0x562af96d3680 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96beae0 0x562af967d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af9682350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2439767619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9681e10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe78f400640 0 client.4782 ms_handle_reset on v2:172.21.15.115:6836/3194167246 2024-05-12T10:50:41.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2439767619 >> 172.21.15.115:0/2439767619 conn(0x562af96b9650 msgr2=0x562af96bba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2439767619 shutdown_connections 2024-05-12T10:50:41.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2439767619 wait complete. 2024-05-12T10:50:41.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.412+0000 7fe7b3f96000 20 client.4782 trim_cache size 0 max 16384 2024-05-12T10:50:41.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7b3f96000 1 Processor -- start 2024-05-12T10:50:41.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7b3f96000 1 -- start start 2024-05-12T10:50:41.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96b9650 0x562af96bce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96bd8a0 0x562af96b8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af96b8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac1fe8c0 con 0x562af96b9650 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac1f5e00 con 0x562af96be1c0 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac1fe1f0 con 0x562af96bd8a0 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7a9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96b9650 0x562af96bce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7a9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96b9650 0x562af96bce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32810/0 (socket says 172.21.15.115:32810) 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2059594232 learned_addr learned my addr 172.21.15.115:0/2059594232 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7aa800640 1 --2- 172.21.15.115:0/2059594232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af96b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7a1400640 1 --2- 172.21.15.115:0/2059594232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96bd8a0 0x562af96b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2059594232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96bd8a0 msgr2=0x562af96b8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/2059594232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96bd8a0 0x562af96b8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2059594232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 msgr2=0x562af96b8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/2059594232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af96b8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7a9e00640 1 -- 172.21.15.115:0/2059594232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562af94a5ad0 con 0x562af96b9650 2024-05-12T10:50:41.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.428+0000 7fe7a1400640 1 --2- 172.21.15.115:0/2059594232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96bd8a0 0x562af96b8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:41.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/2059594232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96b9650 0x562af96bce70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe79c058210 tx=0x7fe79c05f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a0447b435f5609 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe79a000640 1 -- 172.21.15.115:0/2059594232 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c08b070 con 0x562af96b9650 2024-05-12T10:50:41.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe79a000640 1 -- 172.21.15.115:0/2059594232 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79c060540 con 0x562af96b9650 2024-05-12T10:50:41.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe79a000640 1 -- 172.21.15.115:0/2059594232 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c05b900 con 0x562af96b9650 2024-05-12T10:50:41.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2059594232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96b9650 msgr2=0x562af96bce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2059594232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96b9650 0x562af96bce70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe79c058210 tx=0x7fe79c05f000 comp rx=0 tx=0).stop 2024-05-12T10:50:41.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2059594232 shutdown_connections 2024-05-12T10:50:41.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2059594232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af96b8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2059594232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96bd8a0 0x562af96b8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/2059594232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96b9650 0x562af96bce70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2059594232 >> 172.21.15.115:0/2059594232 conn(0x562af967caf0 msgr2=0x562af9680de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2059594232 shutdown_connections 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 -- 172.21.15.115:0/2059594232 wait complete. 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 -- start start 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 Processor -- start 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96b9650 0x562af9732d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9733260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af96d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562af94617b0 con 0x562af96bd8a0 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562af9476180 con 0x562af96be1c0 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562af946f7b0 con 0x562af96b9650 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 10 client.0 _ll_register_callbacks cb 0x7fe79c058860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a1400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9733260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a1400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9733260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32814/0 (socket says 172.21.15.115:32814) 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a1400640 1 -- 172.21.15.115:0/1533168056 learned_addr learned my addr 172.21.15.115:0/1533168056 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96b9650 0x562af9732d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7aa800640 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af96d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a1400640 1 -- 172.21.15.115:0/1533168056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96b9650 msgr2=0x562af9732d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a1400640 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96b9650 0x562af9732d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a1400640 1 -- 172.21.15.115:0/1533168056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 msgr2=0x562af96d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a1400640 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af96d46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a1400640 1 -- 172.21.15.115:0/1533168056 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562af94a4e20 con 0x562af96bd8a0 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96b9650 0x562af9732d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7a1400640 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9733260 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe794000c10 tx=0x7fe79401d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff8cae9edc3cb75 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe78f400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe78f400640 1 -- 172.21.15.115:0/1533168056 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940cc040 con 0x562af96bd8a0 2024-05-12T10:50:41.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe78f400640 1 -- 172.21.15.115:0/1533168056 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe7940c7750 con 0x562af96bd8a0 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.432+0000 7fe7b3f96000 1 -- 172.21.15.115:0/1533168056 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe79c060540 con 0x562af96bd8a0 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe78f400640 1 -- 172.21.15.115:0/1533168056 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fe7940db050 con 0x562af96bd8a0 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 10 client.4788 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 -- 172.21.15.115:0/1533168056 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562af954c4c0 con 0x562af96bd8a0 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe78f400640 1 -- 172.21.15.115:0/1533168056 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79c060540 con 0x562af96bd8a0 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe78f400640 1 -- 172.21.15.115:0/1533168056 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fe7940de080 con 0x562af96bd8a0 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 10 client.4788 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 10 client.4788 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 20 client.4788 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562af96beae0 0x562af96d5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 4 client.4788 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 -- 172.21.15.115:0/1533168056 --> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] -- command(tid 0: {"prefix": "status"}) -- 0x562af94d9c80 con 0x562af96beae0 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562af96beae0 0x562af96d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe78f400640 10 client.4788 ms_handle_connect on v2:172.21.15.115:6836/3194167246 2024-05-12T10:50:41.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7a9e00640 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562af96beae0 0x562af96d5090 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c7d898c89ace20f0 server_cookie=88e4535c68aac633 in_seq=0 out_seq=0 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe78f400640 1 -- 172.21.15.115:0/1533168056 <== mds.2 v2:172.21.15.115:6836/3194167246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562af94d9c80 con 0x562af96beae0 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe78f400640 10 client.4788 handle_command_reply: tid=0 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 client.4788 shutdown 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 -- 172.21.15.115:0/1533168056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 msgr2=0x562af9733260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9733260 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe794000c10 tx=0x7fe79401d370 comp rx=0 tx=0).stop 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 -- 172.21.15.115:0/1533168056 shutdown_connections 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562af96beae0 0x562af96d5090 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562af96be1c0 0x562af96d46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562af96bd8a0 0x562af9733260 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 --2- 172.21.15.115:0/1533168056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562af96b9650 0x562af9732d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe78f400640 0 client.4788 ms_handle_reset on v2:172.21.15.115:6836/3194167246 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 -- 172.21.15.115:0/1533168056 >> 172.21.15.115:0/1533168056 conn(0x562af967caf0 msgr2=0x562af9680de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 -- 172.21.15.115:0/1533168056 shutdown_connections 2024-05-12T10:50:41.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 1 -- 172.21.15.115:0/1533168056 wait complete. 2024-05-12T10:50:41.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b3f96000 20 client.4788 trim_cache size 0 max 16384 2024-05-12T10:50:41.438 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:50:41.438 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "afd333ea-2e10-495a-8d22-6858d0930293", 2024-05-12T10:50:41.438 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 2, 2024-05-12T10:50:41.438 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 4260, 2024-05-12T10:50:41.438 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2024-05-12T10:50:41.438 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2024-05-12T10:50:41.438 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2024-05-12T10:50:41.438 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 16.663236478999998, 2024-05-12T10:50:41.439 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 14, 2024-05-12T10:50:41.439 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 28, 2024-05-12T10:50:41.439 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 26, 2024-05-12T10:50:41.439 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 51.885635432000001 2024-05-12T10:50:41.439 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 -- 172.21.15.115:0/2155112642 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe78806f430 msgr2=0x7fe7880718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe78806f430 0x7fe7880718f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe7940b2000 tx=0x7fe7940aa070 comp rx=0 tx=0).stop 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 -- 172.21.15.115:0/2155112642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7ac0cc370 msgr2=0x7fe7ac1f2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7ac0cc370 0x7fe7ac1f2630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00d830 tx=0x7fe79c00dcf0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 -- 172.21.15.115:0/2155112642 shutdown_connections 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe78806f430 0x7fe7880718f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1561e0 0x7fe7ac1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ac155e00 0x7fe7ac159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 --2- 172.21.15.115:0/2155112642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7ac0cc370 0x7fe7ac1f2630 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 -- 172.21.15.115:0/2155112642 >> 172.21.15.115:0/2155112642 conn(0x7fe7ac0cdb70 msgr2=0x7fe7ac0c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 -- 172.21.15.115:0/2155112642 shutdown_connections 2024-05-12T10:50:41.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.436+0000 7fe7b0a00640 1 -- 172.21.15.115:0/2155112642 wait complete. 2024-05-12T10:50:41.452 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-12T10:50:41.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.592+0000 7f2d09600640 1 Processor -- start 2024-05-12T10:50:41.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.592+0000 7f2d09600640 1 -- start start 2024-05-12T10:50:41.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2d09600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d0415a560 0x7f2d04072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2d09600640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2d040c9230 0x7f2d040c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2d09600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d04160de0 con 0x7f2d040c86f0 2024-05-12T10:50:41.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2d09600640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f2d04163570 con 0x7f2d040c9230 2024-05-12T10:50:41.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2d09600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2d041640f0 con 0x7f2d0415a560 2024-05-12T10:50:41.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2cfa000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2d040c9230 0x7f2d040c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2cfa000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2d040c9230 0x7f2d040c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32816/0 (socket says 172.21.15.115:32816) 2024-05-12T10:50:41.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2cfa000640 1 -- 172.21.15.115:0/4101866196 learned_addr learned my addr 172.21.15.115:0/4101866196 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2d02a00640 1 --2- 172.21.15.115:0/4101866196 >> v2:172.21.15.134:3300/0 conn(0x7f2d0415a560 0x7f2d04072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2cfa000640 1 -- 172.21.15.115:0/4101866196 >> v2:172.21.15.134:3300/0 conn(0x7f2d0415a560 msgr2=0x7f2d04072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2cfa000640 1 --2- 172.21.15.115:0/4101866196 >> v2:172.21.15.134:3300/0 conn(0x7f2d0415a560 0x7f2d04072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2cfa000640 1 -- 172.21.15.115:0/4101866196 >> v1:172.21.15.134:6789/0 conn(0x7f2d040c86f0 legacy=0x7f2d040c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2cfa000640 1 -- 172.21.15.115:0/4101866196 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d041637c0 con 0x7f2d040c9230 2024-05-12T10:50:41.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2cfa000640 1 --2- 172.21.15.115:0/4101866196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d040c9230 0x7f2d040c81b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d040cb020 tx=0x7f2cec01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0a4b3a897b0aa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.596+0000 7f2d02000640 1 -- 172.21.15.115:0/4101866196 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0b5070 con 0x7f2d040c9230 2024-05-12T10:50:41.595 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d02000640 1 -- 172.21.15.115:0/4101866196 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cec0a89d0 con 0x7f2d040c9230 2024-05-12T10:50:41.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d02000640 1 -- 172.21.15.115:0/4101866196 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0a8da0 con 0x7f2d040c9230 2024-05-12T10:50:41.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 -- 172.21.15.115:0/4101866196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d040c9230 msgr2=0x7f2d040c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 --2- 172.21.15.115:0/4101866196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d040c9230 0x7f2d040c81b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d040cb020 tx=0x7f2cec01ed10 comp rx=0 tx=0).stop 2024-05-12T10:50:41.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 -- 172.21.15.115:0/4101866196 shutdown_connections 2024-05-12T10:50:41.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 --2- 172.21.15.115:0/4101866196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d040c9230 0x7f2d040c81b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 --2- 172.21.15.115:0/4101866196 >> v2:172.21.15.134:3300/0 conn(0x7f2d0415a560 0x7f2d04072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 -- 172.21.15.115:0/4101866196 >> 172.21.15.115:0/4101866196 conn(0x7f2d04076830 msgr2=0x7f2d040681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 -- 172.21.15.115:0/4101866196 shutdown_connections 2024-05-12T10:50:41.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 -- 172.21.15.115:0/4101866196 wait complete. 2024-05-12T10:50:41.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 Processor -- start 2024-05-12T10:50:41.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 -- start start 2024-05-12T10:50:41.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d040c86f0 0x7f2d040cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d040c9230 0x7f2d041f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0415a560 0x7f2d041f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2d04160a80 con 0x7f2d0415a560 2024-05-12T10:50:41.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d04163d80 con 0x7f2d040c86f0 2024-05-12T10:50:41.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d09600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2d040c7840 con 0x7f2d040c9230 2024-05-12T10:50:41.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d03400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0415a560 0x7f2d041f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d03400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0415a560 0x7f2d041f9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32820/0 (socket says 172.21.15.115:32820) 2024-05-12T10:50:41.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d03400640 1 -- 172.21.15.115:0/3306717143 learned_addr learned my addr 172.21.15.115:0/3306717143 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2d02a00640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d040c86f0 0x7f2d040cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.600+0000 7f2cfa000640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d040c9230 0x7f2d041f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2d03400640 1 -- 172.21.15.115:0/3306717143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d040c9230 msgr2=0x7f2d041f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2d03400640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d040c9230 0x7f2d041f6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2d03400640 1 -- 172.21.15.115:0/3306717143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d040c86f0 msgr2=0x7f2d040cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2d03400640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d040c86f0 0x7f2d040cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2d03400640 1 -- 172.21.15.115:0/3306717143 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d041559c0 con 0x7f2d0415a560 2024-05-12T10:50:41.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2d03400640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0415a560 0x7f2d041f9360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c780 tx=0x7f2cfc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2cfb400640 1 -- 172.21.15.115:0/3306717143 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc004b70 con 0x7f2d0415a560 2024-05-12T10:50:41.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2cfb400640 1 -- 172.21.15.115:0/3306717143 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cfc004d10 con 0x7f2d0415a560 2024-05-12T10:50:41.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2d09600640 1 -- 172.21.15.115:0/3306717143 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d04155c30 con 0x7f2d0415a560 2024-05-12T10:50:41.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2cfb400640 1 -- 172.21.15.115:0/3306717143 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc00aa90 con 0x7f2d0415a560 2024-05-12T10:50:41.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2d09600640 1 -- 172.21.15.115:0/3306717143 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d041f6140 con 0x7f2d0415a560 2024-05-12T10:50:41.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.604+0000 7f2cfb400640 1 -- 172.21.15.115:0/3306717143 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2cfc00ac30 con 0x7f2d0415a560 2024-05-12T10:50:41.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 Processor -- start 2024-05-12T10:50:41.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2cfb400640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2ce006f400 0x7f2ce00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 -- start start 2024-05-12T10:50:41.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2cfb400640 1 -- 172.21.15.115:0/3306717143 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2cfc08f980 con 0x7f2d0415a560 2024-05-12T10:50:41.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2cfa000640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2ce006f400 0x7f2ce00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2cfa000640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2ce006f400 0x7f2ce00718c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0b2000 tx=0x7f2cec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce494538a0 0x55ce49453c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494541c0 0x55ce494545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4945eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ce492f9600 con 0x55ce49454ae0 2024-05-12T10:50:41.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ce49214720 con 0x55ce494538a0 2024-05-12T10:50:41.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55ce49262070 con 0x55ce494541c0 2024-05-12T10:50:41.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d03400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4945eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d03400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4945eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32830/0 (socket says 172.21.15.115:32830) 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d03400640 1 -- 172.21.15.115:0/2000929025 learned_addr learned my addr 172.21.15.115:0/2000929025 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d02a00640 1 --2- 172.21.15.115:0/2000929025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce494538a0 0x55ce49453c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2cfa000640 1 --2- 172.21.15.115:0/2000929025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494541c0 0x55ce494545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d03400640 1 -- 172.21.15.115:0/2000929025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494541c0 msgr2=0x55ce494545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d03400640 1 --2- 172.21.15.115:0/2000929025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494541c0 0x55ce494545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d03400640 1 -- 172.21.15.115:0/2000929025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce494538a0 msgr2=0x55ce49453c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d03400640 1 --2- 172.21.15.115:0/2000929025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce494538a0 0x55ce49453c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d03400640 1 -- 172.21.15.115:0/2000929025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce493f6080 con 0x55ce49454ae0 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2cfa000640 1 --2- 172.21.15.115:0/2000929025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494541c0 0x55ce494545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d03400640 1 --2- 172.21.15.115:0/2000929025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4945eb30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc000f90 tx=0x7f2cfc05b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125ec7334f5543e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2cf3400640 1 -- 172.21.15.115:0/2000929025 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc08a020 con 0x55ce49454ae0 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2cf3400640 1 -- 172.21.15.115:0/2000929025 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cfc05bcd0 con 0x55ce49454ae0 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2cf3400640 1 -- 172.21.15.115:0/2000929025 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0648c0 con 0x55ce49454ae0 2024-05-12T10:50:41.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 -- 172.21.15.115:0/2000929025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 msgr2=0x55ce4945eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/2000929025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4945eb30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc000f90 tx=0x7f2cfc05b440 comp rx=0 tx=0).stop 2024-05-12T10:50:41.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 -- 172.21.15.115:0/2000929025 shutdown_connections 2024-05-12T10:50:41.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/2000929025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4945eb30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/2000929025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494541c0 0x55ce494545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/2000929025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce494538a0 0x55ce49453c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 -- 172.21.15.115:0/2000929025 >> 172.21.15.115:0/2000929025 conn(0x55ce4944f650 msgr2=0x55ce49451a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 -- 172.21.15.115:0/2000929025 shutdown_connections 2024-05-12T10:50:41.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.608+0000 7f2d0cac9000 1 -- 172.21.15.115:0/2000929025 wait complete. 2024-05-12T10:50:41.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 -- start start 2024-05-12T10:50:41.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 Processor -- start 2024-05-12T10:50:41.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce49417c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce49418160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce49454ae0 0x55ce49412f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ce4925e030 con 0x55ce494541c0 2024-05-12T10:50:41.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ce4921aea0 con 0x55ce49454ae0 2024-05-12T10:50:41.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55ce49201c70 con 0x55ce494538a0 2024-05-12T10:50:41.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 10 client.0 _ll_register_callbacks cb 0x55ce493fde40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2cfa000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce49418160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2cfa000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce49418160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32838/0 (socket says 172.21.15.115:32838) 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2cfa000640 1 -- 172.21.15.115:0/243327187 learned_addr learned my addr 172.21.15.115:0/243327187 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d02a00640 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce49417c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d03400640 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce49454ae0 0x55ce49412f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2cfa000640 1 -- 172.21.15.115:0/243327187 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 msgr2=0x55ce49417c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2cfa000640 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce49417c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2cfa000640 1 -- 172.21.15.115:0/243327187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce49454ae0 msgr2=0x55ce49412f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2cfa000640 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce49454ae0 0x55ce49412f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2cfa000640 1 -- 172.21.15.115:0/243327187 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4930c6d0 con 0x55ce494541c0 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d03400640 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce49454ae0 0x55ce49412f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:41.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2cfa000640 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce49418160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2cec008010 tx=0x7f2cec0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf111f791e1168dd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2ce7e00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:41.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2ce7e00640 1 -- 172.21.15.115:0/243327187 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0b5040 con 0x55ce494541c0 2024-05-12T10:50:41.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2ce7e00640 1 -- 172.21.15.115:0/243327187 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2cec0b0c50 con 0x55ce494541c0 2024-05-12T10:50:41.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 -- 172.21.15.115:0/243327187 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cfc05bcd0 con 0x55ce494541c0 2024-05-12T10:50:41.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2ce7e00640 1 -- 172.21.15.115:0/243327187 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f2cec0d3050 con 0x55ce494541c0 2024-05-12T10:50:41.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 10 client.4800 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:41.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 -- 172.21.15.115:0/243327187 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55ce49308680 con 0x55ce494541c0 2024-05-12T10:50:41.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2ce7e00640 1 -- 172.21.15.115:0/243327187 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cfc05bcd0 con 0x55ce494541c0 2024-05-12T10:50:41.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2ce7e00640 1 -- 172.21.15.115:0/243327187 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f2cec0d6020 con 0x55ce494541c0 2024-05-12T10:50:41.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 10 client.4800 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 10 client.4800 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 20 client.4800 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x55ce49467290 0x55ce49469680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 4 client.4800 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d0cac9000 1 -- 172.21.15.115:0/243327187 --> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce491fabc0 con 0x55ce49467290 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.612+0000 7f2d02a00640 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x55ce49467290 0x55ce49469680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d02a00640 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x55ce49467290 0x55ce49469680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ca206d0705471db server_cookie=24e77bee9f558798 in_seq=0 out_seq=0 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2ce7e00640 10 client.4800 ms_handle_connect on v2:172.21.15.115:6835/4177777929 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2ce7e00640 1 -- 172.21.15.115:0/243327187 <== mds.1 v2:172.21.15.115:6835/4177777929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ce491fabc0 con 0x55ce49467290 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2ce7e00640 10 client.4800 handle_command_reply: tid=0 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 1 client.4800 shutdown 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 1 -- 172.21.15.115:0/243327187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 msgr2=0x55ce49418160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce49418160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2cec008010 tx=0x7f2cec0046d0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 1 -- 172.21.15.115:0/243327187 shutdown_connections 2024-05-12T10:50:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x55ce49467290 0x55ce49469680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce49454ae0 0x55ce49412f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce49418160 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2ce7e00640 0 client.4800 ms_handle_reset on v2:172.21.15.115:6835/4177777929 2024-05-12T10:50:41.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/243327187 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce49417c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 1 -- 172.21.15.115:0/243327187 >> 172.21.15.115:0/243327187 conn(0x55ce4944f650 msgr2=0x55ce49451a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 1 -- 172.21.15.115:0/243327187 shutdown_connections 2024-05-12T10:50:41.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 1 -- 172.21.15.115:0/243327187 wait complete. 2024-05-12T10:50:41.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.616+0000 7f2d0cac9000 20 client.4800 trim_cache size 0 max 16384 2024-05-12T10:50:41.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.632+0000 7f2d0cac9000 1 Processor -- start 2024-05-12T10:50:41.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.632+0000 7f2d0cac9000 1 -- start start 2024-05-12T10:50:41.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce4946c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce4946cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce49454ae0 0x55ce49451a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2d04202da0 con 0x55ce494541c0 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d04151f60 con 0x55ce49454ae0 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2d042026f0 con 0x55ce494538a0 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cfa000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce4946cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cfa000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce4946cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32850/0 (socket says 172.21.15.115:32850) 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cfa000640 1 -- 172.21.15.115:0/3814662788 learned_addr learned my addr 172.21.15.115:0/3814662788 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d03400640 1 --2- 172.21.15.115:0/3814662788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce49454ae0 0x55ce49451a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d02a00640 1 --2- 172.21.15.115:0/3814662788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce4946c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cfa000640 1 -- 172.21.15.115:0/3814662788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 msgr2=0x55ce4946c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cfa000640 1 --2- 172.21.15.115:0/3814662788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce4946c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cfa000640 1 -- 172.21.15.115:0/3814662788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce49454ae0 msgr2=0x55ce49451a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cfa000640 1 --2- 172.21.15.115:0/3814662788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce49454ae0 0x55ce49451a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cfa000640 1 -- 172.21.15.115:0/3814662788 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4923bad0 con 0x55ce494541c0 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d02a00640 1 --2- 172.21.15.115:0/3814662788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce4946c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cfa000640 1 --2- 172.21.15.115:0/3814662788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce4946cbf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2cec01f5b0 tx=0x7f2cec009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7cbc0b704992e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cf2a00640 1 -- 172.21.15.115:0/3814662788 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0db070 con 0x55ce494541c0 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cf2a00640 1 -- 172.21.15.115:0/3814662788 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cec0cb070 con 0x55ce494541c0 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2cf2a00640 1 -- 172.21.15.115:0/3814662788 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0b5040 con 0x55ce494541c0 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- 172.21.15.115:0/3814662788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 msgr2=0x55ce4946cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/3814662788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce4946cbf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2cec01f5b0 tx=0x7f2cec009240 comp rx=0 tx=0).stop 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- 172.21.15.115:0/3814662788 shutdown_connections 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/3814662788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce49454ae0 0x55ce49451a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/3814662788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce494541c0 0x55ce4946cbf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/3814662788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce4946c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- 172.21.15.115:0/3814662788 >> 172.21.15.115:0/3814662788 conn(0x55ce4944f650 msgr2=0x55ce49416580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- 172.21.15.115:0/3814662788 shutdown_connections 2024-05-12T10:50:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- 172.21.15.115:0/3814662788 wait complete. 2024-05-12T10:50:41.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- start start 2024-05-12T10:50:41.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 Processor -- start 2024-05-12T10:50:41.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce494c5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce494541c0 0x55ce494c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4946a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ce492666a0 con 0x55ce49454ae0 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ce4920c180 con 0x55ce494541c0 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.636+0000 7f2d0cac9000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55ce491f77b0 con 0x55ce494538a0 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 10 client.0 _ll_register_callbacks cb 0x7f2cec0b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d03400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4946a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d03400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4946a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32854/0 (socket says 172.21.15.115:32854) 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d03400640 1 -- 172.21.15.115:0/1413181469 learned_addr learned my addr 172.21.15.115:0/1413181469 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d02a00640 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce494c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2cfa000640 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce494541c0 0x55ce494c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d03400640 1 -- 172.21.15.115:0/1413181469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 msgr2=0x55ce494c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d03400640 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce494c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d03400640 1 -- 172.21.15.115:0/1413181469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce494541c0 msgr2=0x55ce494c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d03400640 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce494541c0 0x55ce494c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d03400640 1 -- 172.21.15.115:0/1413181469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4923ae20 con 0x55ce49454ae0 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d03400640 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4946a6d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc05b980 tx=0x7f2cfc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eeba007a301d2b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2ce7e00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2ce7e00640 1 -- 172.21.15.115:0/1413181469 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc08a040 con 0x55ce49454ae0 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2ce7e00640 1 -- 172.21.15.115:0/1413181469 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2cfc086bb0 con 0x55ce49454ae0 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 -- 172.21.15.115:0/1413181469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cec0cb070 con 0x55ce49454ae0 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2ce7e00640 1 -- 172.21.15.115:0/1413181469 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f2cfc05bcd0 con 0x55ce49454ae0 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 10 client.4806 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 -- 172.21.15.115:0/1413181469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55ce492e24c0 con 0x55ce49454ae0 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2ce7e00640 1 -- 172.21.15.115:0/1413181469 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cec0cb070 con 0x55ce49454ae0 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2ce7e00640 1 -- 172.21.15.115:0/1413181469 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f2cfc05af30 con 0x55ce49454ae0 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 10 client.4806 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 10 client.4806 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 20 client.4806 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x55ce4946b090 0x55ce4946b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 4 client.4806 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 -- 172.21.15.115:0/1413181469 --> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] -- command(tid 0: {"prefix": "status"}) -- 0x55ce4926fc80 con 0x55ce4946b090 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d02a00640 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x55ce4946b090 0x55ce4946b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d02a00640 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x55ce4946b090 0x55ce4946b470 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9f1c875f97b2008 server_cookie=139409bf69c82597 in_seq=0 out_seq=0 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2ce7e00640 10 client.4806 ms_handle_connect on v2:172.21.15.115:6835/4177777929 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2ce7e00640 1 -- 172.21.15.115:0/1413181469 <== mds.1 v2:172.21.15.115:6835/4177777929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ce4926fc80 con 0x55ce4946b090 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2ce7e00640 10 client.4806 handle_command_reply: tid=0 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 client.4806 shutdown 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 -- 172.21.15.115:0/1413181469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 msgr2=0x55ce4946a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4946a6d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc05b980 tx=0x7f2cfc007f60 comp rx=0 tx=0).stop 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 -- 172.21.15.115:0/1413181469 shutdown_connections 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x55ce4946b090 0x55ce4946b470 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ce49454ae0 0x55ce4946a6d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ce494541c0 0x55ce494c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 --2- 172.21.15.115:0/1413181469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ce494538a0 0x55ce494c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2ce7e00640 0 client.4806 ms_handle_reset on v2:172.21.15.115:6835/4177777929 2024-05-12T10:50:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 -- 172.21.15.115:0/1413181469 >> 172.21.15.115:0/1413181469 conn(0x55ce4944f650 msgr2=0x55ce49415cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 -- 172.21.15.115:0/1413181469 shutdown_connections 2024-05-12T10:50:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 1 -- 172.21.15.115:0/1413181469 wait complete. 2024-05-12T10:50:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d0cac9000 20 client.4806 trim_cache size 0 max 16384 2024-05-12T10:50:41.643 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:50:41.643 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "afd333ea-2e10-495a-8d22-6858d0930293", 2024-05-12T10:50:41.643 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 1, 2024-05-12T10:50:41.643 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 4309, 2024-05-12T10:50:41.644 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2024-05-12T10:50:41.644 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2024-05-12T10:50:41.644 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2024-05-12T10:50:41.644 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 22.916044454000001, 2024-05-12T10:50:41.644 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 14, 2024-05-12T10:50:41.644 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 28, 2024-05-12T10:50:41.644 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 26, 2024-05-12T10:50:41.644 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 52.092539688000002 2024-05-12T10:50:41.644 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:50:41.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 -- 172.21.15.115:0/3306717143 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2ce006f400 msgr2=0x7f2ce00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2ce006f400 0x7f2ce00718c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0b2000 tx=0x7f2cec008040 comp rx=0 tx=0).stop 2024-05-12T10:50:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 -- 172.21.15.115:0/3306717143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0415a560 msgr2=0x7f2d041f9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0415a560 0x7f2d041f9360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c780 tx=0x7f2cfc00cc40 comp rx=0 tx=0).stop 2024-05-12T10:50:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 -- 172.21.15.115:0/3306717143 shutdown_connections 2024-05-12T10:50:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2ce006f400 0x7f2ce00718c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0415a560 0x7f2d041f9360 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d040c9230 0x7f2d041f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 --2- 172.21.15.115:0/3306717143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d040c86f0 0x7f2d040cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 -- 172.21.15.115:0/3306717143 >> 172.21.15.115:0/3306717143 conn(0x7f2d04076830 msgr2=0x7f2d040c9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 -- 172.21.15.115:0/3306717143 shutdown_connections 2024-05-12T10:50:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.640+0000 7f2d09600640 1 -- 172.21.15.115:0/3306717143 wait complete. 2024-05-12T10:50:41.657 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-12T10:50:41.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.796+0000 7f196ca00640 1 Processor -- start 2024-05-12T10:50:41.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.796+0000 7f196ca00640 1 -- start start 2024-05-12T10:50:41.796 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.800+0000 7f196ca00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1968153e90 0x7f1968159a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.796 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.800+0000 7f196ca00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19680cb3e0 con 0x7f19680cbba0 2024-05-12T10:50:41.796 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.800+0000 7f196ca00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19680c6570 con 0x7f1968071a30 2024-05-12T10:50:41.796 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.800+0000 7f196ca00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f19680caa40 con 0x7f1968153e90 2024-05-12T10:50:41.796 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.800+0000 7f1965e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1968153e90 0x7f1968159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.796 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.800+0000 7f1966800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f19680cbba0 0x7f1968164350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50726/0 (socket says 172.21.15.115:50726) 2024-05-12T10:50:41.796 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.800+0000 7f1965e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1968153e90 0x7f1968159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32862/0 (socket says 172.21.15.115:32862) 2024-05-12T10:50:41.796 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.800+0000 7f1966800640 1 -- 172.21.15.115:0/1307162074 learned_addr learned my addr 172.21.15.115:0/1307162074 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:50:41.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.800+0000 7f1965e00640 1 -- 172.21.15.115:0/1307162074 >> v1:172.21.15.134:6789/0 conn(0x7f1968071a30 legacy=0x7f19680cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.800+0000 7f1965e00640 1 -- 172.21.15.115:0/1307162074 >> v1:172.21.15.115:6789/0 conn(0x7f19680cbba0 legacy=0x7f1968164350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.800+0000 7f1965e00640 1 -- 172.21.15.115:0/1307162074 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19680ca170 con 0x7f1968153e90 2024-05-12T10:50:41.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f1965e00640 1 --2- 172.21.15.115:0/1307162074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1968153e90 0x7f1968159a30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f19580097c0 tx=0x7f195801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcff9fbbf0a42f66 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f1965400640 1 -- 172.21.15.115:0/1307162074 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19580b1070 con 0x7f1968153e90 2024-05-12T10:50:41.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f1965400640 1 -- 172.21.15.115:0/1307162074 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19580ac410 con 0x7f1968153e90 2024-05-12T10:50:41.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f1965400640 1 -- 172.21.15.115:0/1307162074 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19580ac7e0 con 0x7f1968153e90 2024-05-12T10:50:41.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 -- 172.21.15.115:0/1307162074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1968153e90 msgr2=0x7f1968159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 --2- 172.21.15.115:0/1307162074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1968153e90 0x7f1968159a30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f19580097c0 tx=0x7f195801c4a0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 -- 172.21.15.115:0/1307162074 shutdown_connections 2024-05-12T10:50:41.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 --2- 172.21.15.115:0/1307162074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1968153e90 0x7f1968159a30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 -- 172.21.15.115:0/1307162074 >> 172.21.15.115:0/1307162074 conn(0x7f1968072050 msgr2=0x7f1968072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 -- 172.21.15.115:0/1307162074 shutdown_connections 2024-05-12T10:50:41.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 -- 172.21.15.115:0/1307162074 wait complete. 2024-05-12T10:50:41.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 Processor -- start 2024-05-12T10:50:41.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 -- start start 2024-05-12T10:50:41.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1968071a30 0x7f1968072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19680cbba0 0x7f1968072970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1968153e90 0x7f19680c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1968168410 con 0x7f1968071a30 2024-05-12T10:50:41.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1968168290 con 0x7f1968153e90 2024-05-12T10:50:41.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f196ca00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1968168590 con 0x7f19680cbba0 2024-05-12T10:50:41.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f1965e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1968071a30 0x7f1968072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f1965e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1968071a30 0x7f1968072430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32864/0 (socket says 172.21.15.115:32864) 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f1965e00640 1 -- 172.21.15.115:0/3237167019 learned_addr learned my addr 172.21.15.115:0/3237167019 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f1966800640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1968153e90 0x7f19680c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.804+0000 7f195fe00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19680cbba0 0x7f1968072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f1965e00640 1 -- 172.21.15.115:0/3237167019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19680cbba0 msgr2=0x7f1968072970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f1965e00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19680cbba0 0x7f1968072970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f1965e00640 1 -- 172.21.15.115:0/3237167019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1968153e90 msgr2=0x7f19680c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f1965e00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1968153e90 0x7f19680c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f1965e00640 1 -- 172.21.15.115:0/3237167019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19680c9910 con 0x7f1968071a30 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f1965e00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1968071a30 0x7f1968072430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f19580af040 tx=0x7f1958019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f195e000640 1 -- 172.21.15.115:0/3237167019 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19580b9020 con 0x7f1968071a30 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f195e000640 1 -- 172.21.15.115:0/3237167019 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19580ace40 con 0x7f1968071a30 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f196ca00640 1 -- 172.21.15.115:0/3237167019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19681f9300 con 0x7f1968071a30 2024-05-12T10:50:41.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f195e000640 1 -- 172.21.15.115:0/3237167019 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19580b1040 con 0x7f1968071a30 2024-05-12T10:50:41.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f196ca00640 1 -- 172.21.15.115:0/3237167019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19680c6c50 con 0x7f1968071a30 2024-05-12T10:50:41.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.808+0000 7f195e000640 1 -- 172.21.15.115:0/3237167019 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f19580bc020 con 0x7f1968071a30 2024-05-12T10:50:41.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f195e000640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f194406f430 0x7f19440718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f195e000640 1 -- 172.21.15.115:0/3237167019 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f1958128f60 con 0x7f1968071a30 2024-05-12T10:50:41.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f195fe00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f194406f430 0x7f19440718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 Processor -- start 2024-05-12T10:50:41.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 -- start start 2024-05-12T10:50:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f195fe00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f194406f430 0x7f19440718f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f196814f3e0 tx=0x7f1950009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f68a0 0x562e725f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f71c0 0x562e725f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f7ae0 0x562e72601b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562e7249c600 con 0x562e725f7ae0 2024-05-12T10:50:41.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562e723b7720 con 0x562e725f68a0 2024-05-12T10:50:41.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562e72405070 con 0x562e725f71c0 2024-05-12T10:50:41.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1966800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f7ae0 0x562e72601b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1966800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f7ae0 0x562e72601b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32866/0 (socket says 172.21.15.115:32866) 2024-05-12T10:50:41.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1966800640 1 -- 172.21.15.115:0/3164168941 learned_addr learned my addr 172.21.15.115:0/3164168941 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1965e00640 1 --2- 172.21.15.115:0/3164168941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f68a0 0x562e725f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f195fe00640 1 --2- 172.21.15.115:0/3164168941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f71c0 0x562e725f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1966800640 1 -- 172.21.15.115:0/3164168941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f71c0 msgr2=0x562e725f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1966800640 1 --2- 172.21.15.115:0/3164168941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f71c0 0x562e725f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1966800640 1 -- 172.21.15.115:0/3164168941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f68a0 msgr2=0x562e725f6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1966800640 1 --2- 172.21.15.115:0/3164168941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f68a0 0x562e725f6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1966800640 1 -- 172.21.15.115:0/3164168941 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e72599080 con 0x562e725f7ae0 2024-05-12T10:50:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f195fe00640 1 --2- 172.21.15.115:0/3164168941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f71c0 0x562e725f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:50:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1966800640 1 --2- 172.21.15.115:0/3164168941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f7ae0 0x562e72601b30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1960002010 tx=0x7f196000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6d8cbf06b44146 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1956a00640 1 -- 172.21.15.115:0/3164168941 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960019070 con 0x562e725f7ae0 2024-05-12T10:50:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1956a00640 1 -- 172.21.15.115:0/3164168941 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196000ee50 con 0x562e725f7ae0 2024-05-12T10:50:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f1956a00640 1 -- 172.21.15.115:0/3164168941 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960014680 con 0x562e725f7ae0 2024-05-12T10:50:41.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 -- 172.21.15.115:0/3164168941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f7ae0 msgr2=0x562e72601b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 --2- 172.21.15.115:0/3164168941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f7ae0 0x562e72601b30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1960002010 tx=0x7f196000e530 comp rx=0 tx=0).stop 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 -- 172.21.15.115:0/3164168941 shutdown_connections 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 --2- 172.21.15.115:0/3164168941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f7ae0 0x562e72601b30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 --2- 172.21.15.115:0/3164168941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f71c0 0x562e725f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 --2- 172.21.15.115:0/3164168941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f68a0 0x562e725f6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 -- 172.21.15.115:0/3164168941 >> 172.21.15.115:0/3164168941 conn(0x562e725f2650 msgr2=0x562e725f4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 -- 172.21.15.115:0/3164168941 shutdown_connections 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.812+0000 7f196ff06000 1 -- 172.21.15.115:0/3164168941 wait complete. 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 -- start start 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 Processor -- start 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e725badb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e725bb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f7ae0 0x562e725b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562e72401030 con 0x562e725f71c0 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562e723bdea0 con 0x562e725f7ae0 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562e723a4c70 con 0x562e725f68a0 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 10 client.0 _ll_register_callbacks cb 0x562e725a0e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f195fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e725bb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f195fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e725bb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32876/0 (socket says 172.21.15.115:32876) 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f195fe00640 1 -- 172.21.15.115:0/3886391897 learned_addr learned my addr 172.21.15.115:0/3886391897 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f1966800640 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f7ae0 0x562e725b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f1965e00640 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e725badb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f195fe00640 1 -- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 msgr2=0x562e725badb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f195fe00640 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e725badb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f195fe00640 1 -- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f7ae0 msgr2=0x562e725b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f195fe00640 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f7ae0 0x562e725b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f195fe00640 1 -- 172.21.15.115:0/3886391897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e724af6d0 con 0x562e725f71c0 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f195fe00640 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e725bb2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f19500038b0 tx=0x7f1950000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a595887d657e98 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f194b400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f194b400640 1 -- 172.21.15.115:0/3886391897 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950003e30 con 0x562e725f71c0 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f194b400640 1 -- 172.21.15.115:0/3886391897 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f195000ec40 con 0x562e725f71c0 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 -- 172.21.15.115:0/3886391897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f196000ee50 con 0x562e725f71c0 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f194b400640 1 -- 172.21.15.115:0/3886391897 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f195000ee40 con 0x562e725f71c0 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 10 client.4821 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 -- 172.21.15.115:0/3886391897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562e724ab680 con 0x562e725f71c0 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f194b400640 1 -- 172.21.15.115:0/3886391897 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196000ee50 con 0x562e725f71c0 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f194b400640 1 -- 172.21.15.115:0/3886391897 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f195002d720 con 0x562e725f71c0 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 10 client.4821 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 10 client.4821 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T10:50:41.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 20 client.4821 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:41.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562e7260a290 0x562e7260c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 4 client.4821 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:50:41.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.816+0000 7f196ff06000 1 -- 172.21.15.115:0/3886391897 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e7239dbc0 con 0x562e7260a290 2024-05-12T10:50:41.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f1965e00640 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562e7260a290 0x562e7260c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f194b400640 10 client.4821 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:41.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f1965e00640 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562e7260a290 0x562e7260c680 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e94c2fe36c8b03b4 server_cookie=1959fff061ffffd in_seq=0 out_seq=0 2024-05-12T10:50:41.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f194b400640 1 -- 172.21.15.115:0/3886391897 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562e7239dbc0 con 0x562e7260a290 2024-05-12T10:50:41.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f194b400640 10 client.4821 handle_command_reply: tid=0 2024-05-12T10:50:41.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 1 client.4821 shutdown 2024-05-12T10:50:41.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 1 -- 172.21.15.115:0/3886391897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 msgr2=0x562e725bb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e725bb2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f19500038b0 tx=0x7f1950000bd0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 1 -- 172.21.15.115:0/3886391897 shutdown_connections 2024-05-12T10:50:41.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562e7260a290 0x562e7260c680 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f7ae0 0x562e725b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e725bb2f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 1 --2- 172.21.15.115:0/3886391897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e725badb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f194b400640 0 client.4821 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:41.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 1 -- 172.21.15.115:0/3886391897 >> 172.21.15.115:0/3886391897 conn(0x562e725f2650 msgr2=0x562e725f4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 1 -- 172.21.15.115:0/3886391897 shutdown_connections 2024-05-12T10:50:41.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 1 -- 172.21.15.115:0/3886391897 wait complete. 2024-05-12T10:50:41.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.820+0000 7f196ff06000 20 client.4821 trim_cache size 0 max 16384 2024-05-12T10:50:41.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 Processor -- start 2024-05-12T10:50:41.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 -- start start 2024-05-12T10:50:41.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f2650 0x562e725f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e725f1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f71c0 0x562e725f1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f196814e7d0 con 0x562e725f2650 2024-05-12T10:50:41.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1968201a90 con 0x562e725f71c0 2024-05-12T10:50:41.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562e723db380 con 0x562e725f68a0 2024-05-12T10:50:41.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1965e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f2650 0x562e725f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1965e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f2650 0x562e725f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32880/0 (socket says 172.21.15.115:32880) 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1965e00640 1 -- 172.21.15.115:0/155741655 learned_addr learned my addr 172.21.15.115:0/155741655 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1966800640 1 --2- 172.21.15.115:0/155741655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f71c0 0x562e725f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f195fe00640 1 --2- 172.21.15.115:0/155741655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e725f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1965e00640 1 -- 172.21.15.115:0/155741655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 msgr2=0x562e725f1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1965e00640 1 --2- 172.21.15.115:0/155741655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e725f1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1965e00640 1 -- 172.21.15.115:0/155741655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f71c0 msgr2=0x562e725f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1965e00640 1 --2- 172.21.15.115:0/155741655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f71c0 0x562e725f1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1965e00640 1 -- 172.21.15.115:0/155741655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e723dead0 con 0x562e725f2650 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1965e00640 1 --2- 172.21.15.115:0/155741655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f2650 0x562e725f5e70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1958006f90 tx=0x7f1958006c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27145ee2b872005b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1956000640 1 -- 172.21.15.115:0/155741655 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19580f4ee0 con 0x562e725f2650 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1956000640 1 -- 172.21.15.115:0/155741655 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19580f5ad0 con 0x562e725f2650 2024-05-12T10:50:41.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f1956000640 1 -- 172.21.15.115:0/155741655 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19580f53d0 con 0x562e725f2650 2024-05-12T10:50:41.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 -- 172.21.15.115:0/155741655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f2650 msgr2=0x562e725f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 --2- 172.21.15.115:0/155741655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f2650 0x562e725f5e70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1958006f90 tx=0x7f1958006c40 comp rx=0 tx=0).stop 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 -- 172.21.15.115:0/155741655 shutdown_connections 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 --2- 172.21.15.115:0/155741655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f71c0 0x562e725f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 --2- 172.21.15.115:0/155741655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e725f1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 --2- 172.21.15.115:0/155741655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f2650 0x562e725f5e70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 -- 172.21.15.115:0/155741655 >> 172.21.15.115:0/155741655 conn(0x562e725b5a90 msgr2=0x562e725b9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 -- 172.21.15.115:0/155741655 shutdown_connections 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.840+0000 7f196ff06000 1 -- 172.21.15.115:0/155741655 wait complete. 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 -- start start 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 Processor -- start 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f2650 0x562e7266bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e7266c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e7260d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562e724096a0 con 0x562e725f71c0 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562e723a87b0 con 0x562e725f2650 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562e7239a7b0 con 0x562e725f68a0 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 10 client.0 _ll_register_callbacks cb 0x7f1950001330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f1966800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e7260d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f1966800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e7260d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32892/0 (socket says 172.21.15.115:32892) 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f1966800640 1 -- 172.21.15.115:0/3543041759 learned_addr learned my addr 172.21.15.115:0/3543041759 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f195fe00640 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e7266c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f1965e00640 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f2650 0x562e7266bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f1966800640 1 -- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 msgr2=0x562e7266c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f1966800640 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e7266c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f1966800640 1 -- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f2650 msgr2=0x562e7266bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f1966800640 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f2650 0x562e7266bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f1966800640 1 -- 172.21.15.115:0/3543041759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e723dde20 con 0x562e725f71c0 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f1966800640 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e7260d6d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1960009010 tx=0x7f1960001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c155c9e0c91d9332 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f194b400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f194b400640 1 -- 172.21.15.115:0/3543041759 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960024070 con 0x562e725f71c0 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f194b400640 1 -- 172.21.15.115:0/3543041759 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f1960014690 con 0x562e725f71c0 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 -- 172.21.15.115:0/3543041759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19580f5ad0 con 0x562e725f71c0 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f194b400640 1 -- 172.21.15.115:0/3543041759 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f196002e050 con 0x562e725f71c0 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 10 client.4827 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 -- 172.21.15.115:0/3543041759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562e724854c0 con 0x562e725f71c0 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f194b400640 1 -- 172.21.15.115:0/3543041759 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19580f5ad0 con 0x562e725f71c0 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f194b400640 1 -- 172.21.15.115:0/3543041759 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f1960031020 con 0x562e725f71c0 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 10 client.4827 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 10 client.4827 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 20 client.4827 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:41.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562e725f7ae0 0x562e7260e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:41.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 4 client.4827 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T10:50:41.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f196ff06000 1 -- 172.21.15.115:0/3543041759 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "status"}) -- 0x562e72412c80 con 0x562e725f7ae0 2024-05-12T10:50:41.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.844+0000 7f1965e00640 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562e725f7ae0 0x562e7260e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:41.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f1965e00640 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562e725f7ae0 0x562e7260e150 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=548a5040370d9176 server_cookie=902b479cd22a69cf in_seq=0 out_seq=0 2024-05-12T10:50:41.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f194b400640 10 client.4827 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:41.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f194b400640 1 -- 172.21.15.115:0/3543041759 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x562e72412c80 con 0x562e725f7ae0 2024-05-12T10:50:41.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f194b400640 10 client.4827 handle_command_reply: tid=0 2024-05-12T10:50:41.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 1 client.4827 shutdown 2024-05-12T10:50:41.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 1 -- 172.21.15.115:0/3543041759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 msgr2=0x562e7260d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e7260d6d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1960009010 tx=0x7f1960001260 comp rx=0 tx=0).stop 2024-05-12T10:50:41.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 1 -- 172.21.15.115:0/3543041759 shutdown_connections 2024-05-12T10:50:41.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562e725f71c0 0x562e7260d6d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562e725f68a0 0x562e7266c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562e725f7ae0 0x562e7260e150 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 1 --2- 172.21.15.115:0/3543041759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562e725f2650 0x562e7266bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f194b400640 0 client.4827 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:41.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 1 -- 172.21.15.115:0/3543041759 >> 172.21.15.115:0/3543041759 conn(0x562e725b5a90 msgr2=0x562e725b9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 1 -- 172.21.15.115:0/3543041759 shutdown_connections 2024-05-12T10:50:41.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 1 -- 172.21.15.115:0/3543041759 wait complete. 2024-05-12T10:50:41.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ff06000 20 client.4827 trim_cache size 0 max 16384 2024-05-12T10:50:41.848 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:50:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "afd333ea-2e10-495a-8d22-6858d0930293", 2024-05-12T10:50:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2024-05-12T10:50:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 4321, 2024-05-12T10:50:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2024-05-12T10:50:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2024-05-12T10:50:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2024-05-12T10:50:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 46.236810828000003, 2024-05-12T10:50:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 14, 2024-05-12T10:50:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 28, 2024-05-12T10:50:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 26, 2024-05-12T10:50:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 52.292369512 2024-05-12T10:50:41.849 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:50:41.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 -- 172.21.15.115:0/3237167019 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f194406f430 msgr2=0x7f19440718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f194406f430 0x7f19440718f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f196814f3e0 tx=0x7f1950009040 comp rx=0 tx=0).stop 2024-05-12T10:50:41.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 -- 172.21.15.115:0/3237167019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1968071a30 msgr2=0x7f1968072430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:41.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1968071a30 0x7f1968072430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f19580af040 tx=0x7f1958019240 comp rx=0 tx=0).stop 2024-05-12T10:50:41.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 -- 172.21.15.115:0/3237167019 shutdown_connections 2024-05-12T10:50:41.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f194406f430 0x7f19440718f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1968153e90 0x7f19680c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19680cbba0 0x7f1968072970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 --2- 172.21.15.115:0/3237167019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1968071a30 0x7f1968072430 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:41.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 -- 172.21.15.115:0/3237167019 >> 172.21.15.115:0/3237167019 conn(0x7f1968072050 msgr2=0x7f19680cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:41.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 -- 172.21.15.115:0/3237167019 shutdown_connections 2024-05-12T10:50:41.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:41.848+0000 7f196ca00640 1 -- 172.21.15.115:0/3237167019 wait complete. 2024-05-12T10:50:41.866 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-05-12T10:50:49.158 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:50:49.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:50:56.867 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-05-12T10:50:56.868 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:50:57.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2233200640 1 Processor -- start 2024-05-12T10:50:57.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2233200640 1 -- start start 2024-05-12T10:50:57.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2233200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22340c4a70 0x7f22340c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2233200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22340c97d0 0x7f22340c5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2233200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22340ca0d0 con 0x7f2234153b70 2024-05-12T10:50:57.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2233200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f22340c9d80 con 0x7f22340c4a70 2024-05-12T10:50:57.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2233200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f22340ca3b0 con 0x7f22340c97d0 2024-05-12T10:50:57.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2231400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22340c4a70 0x7f22340c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2231400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22340c4a70 0x7f22340c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48212/0 (socket says 172.21.15.115:48212) 2024-05-12T10:50:57.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2231400640 1 -- 172.21.15.115:0/698138227 learned_addr learned my addr 172.21.15.115:0/698138227 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:57.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2232800640 1 --2- 172.21.15.115:0/698138227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22340c97d0 0x7f22340c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2231400640 1 -- 172.21.15.115:0/698138227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22340c97d0 msgr2=0x7f22340c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:57.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2231400640 1 --2- 172.21.15.115:0/698138227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22340c97d0 0x7f22340c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2231400640 1 -- 172.21.15.115:0/698138227 >> v1:172.21.15.134:6789/0 conn(0x7f2234153b70 legacy=0x7f22340c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.020+0000 7f2231400640 1 -- 172.21.15.115:0/698138227 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22340ca690 con 0x7f22340c4a70 2024-05-12T10:50:57.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2231400640 1 --2- 172.21.15.115:0/698138227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22340c4a70 0x7f22340c5410 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2220009870 tx=0x7f222001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2596c42883f61710 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2230a00640 1 -- 172.21.15.115:0/698138227 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22200a9620 con 0x7f22340c4a70 2024-05-12T10:50:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2230a00640 1 -- 172.21.15.115:0/698138227 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22200a97c0 con 0x7f22340c4a70 2024-05-12T10:50:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2230a00640 1 -- 172.21.15.115:0/698138227 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22200a9b90 con 0x7f22340c4a70 2024-05-12T10:50:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2233200640 1 -- 172.21.15.115:0/698138227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22340c4a70 msgr2=0x7f22340c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2233200640 1 --2- 172.21.15.115:0/698138227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22340c4a70 0x7f22340c5410 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2220009870 tx=0x7f222001c560 comp rx=0 tx=0).stop 2024-05-12T10:50:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2233200640 1 -- 172.21.15.115:0/698138227 shutdown_connections 2024-05-12T10:50:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2233200640 1 --2- 172.21.15.115:0/698138227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22340c97d0 0x7f22340c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2233200640 1 --2- 172.21.15.115:0/698138227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22340c4a70 0x7f22340c5410 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2233200640 1 -- 172.21.15.115:0/698138227 >> 172.21.15.115:0/698138227 conn(0x7f22340681c0 msgr2=0x7f22340685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2233200640 1 -- 172.21.15.115:0/698138227 shutdown_connections 2024-05-12T10:50:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2233200640 1 -- 172.21.15.115:0/698138227 wait complete. 2024-05-12T10:50:57.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2233200640 1 Processor -- start 2024-05-12T10:50:57.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.024+0000 7f2233200640 1 -- start start 2024-05-12T10:50:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2233200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22340c4a70 0x7f2234073910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2233200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22340c97d0 0x7f22341f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2233200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2234153b70 0x7f22341f7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2233200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f22341540d0 con 0x7f22340c97d0 2024-05-12T10:50:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2233200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2234153f50 con 0x7f22340c4a70 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2233200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f22340c7860 con 0x7f2234153b70 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2231400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22340c97d0 0x7f22341f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2231400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22340c97d0 0x7f22341f5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48218/0 (socket says 172.21.15.115:48218) 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2231400640 1 -- 172.21.15.115:0/3087638253 learned_addr learned my addr 172.21.15.115:0/3087638253 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2231e00640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22340c4a70 0x7f2234073910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2232800640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2234153b70 0x7f22341f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2231400640 1 -- 172.21.15.115:0/3087638253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2234153b70 msgr2=0x7f22341f7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2231400640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2234153b70 0x7f22341f7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2231400640 1 -- 172.21.15.115:0/3087638253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22340c4a70 msgr2=0x7f2234073910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2231400640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22340c4a70 0x7f2234073910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2231400640 1 -- 172.21.15.115:0/3087638253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223414f9d0 con 0x7f22340c97d0 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2231400640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22340c97d0 0x7f22341f5b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f222001ca40 tx=0x7f2220019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f222a000640 1 -- 172.21.15.115:0/3087638253 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22200ba480 con 0x7f22340c97d0 2024-05-12T10:50:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f222a000640 1 -- 172.21.15.115:0/3087638253 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22200ba620 con 0x7f22340c97d0 2024-05-12T10:50:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2233200640 1 -- 172.21.15.115:0/3087638253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223414fcb0 con 0x7f22340c97d0 2024-05-12T10:50:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f222a000640 1 -- 172.21.15.115:0/3087638253 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22200ba9f0 con 0x7f22340c97d0 2024-05-12T10:50:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2233200640 1 -- 172.21.15.115:0/3087638253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2234152ec0 con 0x7f22340c97d0 2024-05-12T10:50:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.028+0000 7f2233200640 1 -- 172.21.15.115:0/3087638253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22341530c0 con 0x7f22340c97d0 2024-05-12T10:50:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.032+0000 7f222a000640 1 -- 172.21.15.115:0/3087638253 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f22200b13f0 con 0x7f22340c97d0 2024-05-12T10:50:57.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.032+0000 7f222a000640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f221406f400 0x7f22140718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.032+0000 7f222a000640 1 -- 172.21.15.115:0/3087638253 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2220129f70 con 0x7f22340c97d0 2024-05-12T10:50:57.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.032+0000 7f2231e00640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f221406f400 0x7f22140718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.032+0000 7f2231e00640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f221406f400 0x7f22140718c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f22340ce630 tx=0x7f2224009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:57.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.036+0000 7f222a000640 1 -- 172.21.15.115:0/3087638253 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f22341530c0 con 0x7f22340c97d0 2024-05-12T10:50:57.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f2233200640 1 -- 172.21.15.115:0/3087638253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22341529d0 con 0x7f22340c97d0 2024-05-12T10:50:57.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f222a000640 1 -- 172.21.15.115:0/3087638253 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f22200bf060 con 0x7f22340c97d0 2024-05-12T10:50:57.221 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:50:57.221 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:50:57.222 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:50:57.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f2233200640 1 -- 172.21.15.115:0/3087638253 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f221406f400 msgr2=0x7f22140718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f2233200640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f221406f400 0x7f22140718c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f22340ce630 tx=0x7f2224009040 comp rx=0 tx=0).stop 2024-05-12T10:50:57.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f2233200640 1 -- 172.21.15.115:0/3087638253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22340c97d0 msgr2=0x7f22341f5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f2233200640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22340c97d0 0x7f22341f5b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f222001ca40 tx=0x7f2220019300 comp rx=0 tx=0).stop 2024-05-12T10:50:57.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f2233200640 1 -- 172.21.15.115:0/3087638253 shutdown_connections 2024-05-12T10:50:57.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f2233200640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f221406f400 0x7f22140718c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f2233200640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2234153b70 0x7f22341f7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f2233200640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22340c97d0 0x7f22341f5b10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f2233200640 1 --2- 172.21.15.115:0/3087638253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22340c4a70 0x7f2234073910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.224+0000 7f2233200640 1 -- 172.21.15.115:0/3087638253 >> 172.21.15.115:0/3087638253 conn(0x7f22340681c0 msgr2=0x7f2234149c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:57.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.228+0000 7f2233200640 1 -- 172.21.15.115:0/3087638253 shutdown_connections 2024-05-12T10:50:57.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.228+0000 7f2233200640 1 -- 172.21.15.115:0/3087638253 wait complete. 2024-05-12T10:50:57.243 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db / --timeout 60 --expiration 70 --await-for 42.0' 2024-05-12T10:50:57.243 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db / --timeout 60 --expiration 70 --await-for 42.0 2024-05-12T10:50:57.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb3e800640 1 Processor -- start 2024-05-12T10:50:57.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb3e800640 1 -- start start 2024-05-12T10:50:57.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb3e800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffb381560b0 0x7ffb380ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb3e800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffb3806d600 0x7ffb380cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb3e800640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb3815c1e0 con 0x7ffb380cd470 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb3e800640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7ffb380cdbc0 con 0x7ffb381560b0 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb3e800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ffb3815cd60 con 0x7ffb3806d600 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb37400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffb381560b0 0x7ffb380ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb37400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffb381560b0 0x7ffb380ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48230/0 (socket says 172.21.15.115:48230) 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb37400640 1 -- 172.21.15.115:0/4153872163 learned_addr learned my addr 172.21.15.115:0/4153872163 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb36a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ffb380cd470 0x7ffb3806cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:39614/0 (socket says 172.21.15.115:39614) 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb37e00640 1 --2- 172.21.15.115:0/4153872163 >> v2:172.21.15.134:3300/0 conn(0x7ffb3806d600 0x7ffb380cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb37400640 1 -- 172.21.15.115:0/4153872163 >> v2:172.21.15.134:3300/0 conn(0x7ffb3806d600 msgr2=0x7ffb380cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb37400640 1 --2- 172.21.15.115:0/4153872163 >> v2:172.21.15.134:3300/0 conn(0x7ffb3806d600 0x7ffb380cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb37400640 1 -- 172.21.15.115:0/4153872163 >> v1:172.21.15.115:6789/0 conn(0x7ffb380cd470 legacy=0x7ffb3806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb37400640 1 -- 172.21.15.115:0/4153872163 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3815c4c0 con 0x7ffb381560b0 2024-05-12T10:50:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.392+0000 7ffb36000640 1 -- 172.21.15.115:0/4153872163 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3251813019 0 0) 0x7ffb3815c1e0 con 0x7ffb380cd470 2024-05-12T10:50:57.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb37400640 1 --2- 172.21.15.115:0/4153872163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb381560b0 0x7ffb380ccf30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffb380cf2a0 tx=0x7ffb2801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475e3687572427d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:57.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb36000640 1 -- 172.21.15.115:0/4153872163 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb280b4070 con 0x7ffb381560b0 2024-05-12T10:50:57.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb36000640 1 -- 172.21.15.115:0/4153872163 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb280af400 con 0x7ffb381560b0 2024-05-12T10:50:57.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb36000640 1 -- 172.21.15.115:0/4153872163 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb280af7d0 con 0x7ffb381560b0 2024-05-12T10:50:57.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb3e800640 1 -- 172.21.15.115:0/4153872163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb381560b0 msgr2=0x7ffb380ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb3e800640 1 --2- 172.21.15.115:0/4153872163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb381560b0 0x7ffb380ccf30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffb380cf2a0 tx=0x7ffb2801f1e0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb3e800640 1 -- 172.21.15.115:0/4153872163 shutdown_connections 2024-05-12T10:50:57.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb3e800640 1 --2- 172.21.15.115:0/4153872163 >> v2:172.21.15.134:3300/0 conn(0x7ffb3806d600 0x7ffb380cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb3e800640 1 --2- 172.21.15.115:0/4153872163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb381560b0 0x7ffb380ccf30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb3e800640 1 -- 172.21.15.115:0/4153872163 >> 172.21.15.115:0/4153872163 conn(0x7ffb38073b70 msgr2=0x7ffb38073f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:57.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb3e800640 1 -- 172.21.15.115:0/4153872163 shutdown_connections 2024-05-12T10:50:57.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.396+0000 7ffb3e800640 1 -- 172.21.15.115:0/4153872163 wait complete. 2024-05-12T10:50:57.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb3e800640 1 Processor -- start 2024-05-12T10:50:57.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb3e800640 1 -- start start 2024-05-12T10:50:57.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb3e800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb3806d600 0x7ffb3815fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb3e800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb380cd470 0x7ffb3815e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb3e800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb381560b0 0x7ffb3815eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb3e800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3806c9d0 con 0x7ffb380cd470 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb3e800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3815ca80 con 0x7ffb3806d600 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb3e800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ffb38156490 con 0x7ffb381560b0 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb36a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb380cd470 0x7ffb3815e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb36a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb380cd470 0x7ffb3815e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48240/0 (socket says 172.21.15.115:48240) 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb36a00640 1 -- 172.21.15.115:0/124926191 learned_addr learned my addr 172.21.15.115:0/124926191 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb37400640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb3806d600 0x7ffb3815fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb37e00640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb381560b0 0x7ffb3815eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb36a00640 1 -- 172.21.15.115:0/124926191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb381560b0 msgr2=0x7ffb3815eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb36a00640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb381560b0 0x7ffb3815eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb36a00640 1 -- 172.21.15.115:0/124926191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb3806d600 msgr2=0x7ffb3815fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb36a00640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb3806d600 0x7ffb3815fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb36a00640 1 -- 172.21.15.115:0/124926191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3815d010 con 0x7ffb380cd470 2024-05-12T10:50:57.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb36a00640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb380cd470 0x7ffb3815e600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c490 tx=0x7ffb2400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:57.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb2f400640 1 -- 172.21.15.115:0/124926191 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb240074e0 con 0x7ffb380cd470 2024-05-12T10:50:57.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb2f400640 1 -- 172.21.15.115:0/124926191 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb240047f0 con 0x7ffb380cd470 2024-05-12T10:50:57.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb2f400640 1 -- 172.21.15.115:0/124926191 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24004be0 con 0x7ffb380cd470 2024-05-12T10:50:57.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb3e800640 1 -- 172.21.15.115:0/124926191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb3815d2f0 con 0x7ffb380cd470 2024-05-12T10:50:57.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.400+0000 7ffb3e800640 1 -- 172.21.15.115:0/124926191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb3815e0e0 con 0x7ffb380cd470 2024-05-12T10:50:57.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb2f400640 1 -- 172.21.15.115:0/124926191 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffb24011070 con 0x7ffb380cd470 2024-05-12T10:50:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb2f400640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ffb1806f400 0x7ffb180718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb2f400640 1 -- 172.21.15.115:0/124926191 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ffb2408f2d0 con 0x7ffb380cd470 2024-05-12T10:50:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb37400640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ffb1806f400 0x7ffb180718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb41ccd000 1 Processor -- start 2024-05-12T10:50:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb41ccd000 1 -- start start 2024-05-12T10:50:57.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb37400640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ffb1806f400 0x7ffb180718c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffb280b1000 tx=0x7ffb280aa000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:57.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511c3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c3c80 0x561a511c4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c8a10 0x561a511c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561a50fd70f0 con 0x561a511c8a10 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561a50f90670 con 0x561a511c3c80 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.404+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x561a50fd30b0 con 0x561a5118ddf0 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c8a10 0x561a511c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c8a10 0x561a511c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48248/0 (socket says 172.21.15.115:48248) 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37e00640 1 -- 172.21.15.115:0/3703310483 learned_addr learned my addr 172.21.15.115:0/3703310483 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37400640 1 --2- 172.21.15.115:0/3703310483 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb36a00640 1 --2- 172.21.15.115:0/3703310483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c3c80 0x561a511c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37e00640 1 -- 172.21.15.115:0/3703310483 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 msgr2=0x561a511c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37e00640 1 --2- 172.21.15.115:0/3703310483 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37e00640 1 -- 172.21.15.115:0/3703310483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c3c80 msgr2=0x561a511c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37e00640 1 --2- 172.21.15.115:0/3703310483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c3c80 0x561a511c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37e00640 1 -- 172.21.15.115:0/3703310483 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a50f99010 con 0x561a511c8a10 2024-05-12T10:50:57.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb36a00640 1 --2- 172.21.15.115:0/3703310483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c3c80 0x561a511c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:57.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37e00640 1 --2- 172.21.15.115:0/3703310483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c8a10 0x561a511c8df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009a80 tx=0x7ffb30009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7a1699dedcac96 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:57.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb23e00640 1 -- 172.21.15.115:0/3703310483 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb30019070 con 0x561a511c8a10 2024-05-12T10:50:57.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb23e00640 1 -- 172.21.15.115:0/3703310483 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb30011b60 con 0x561a511c8a10 2024-05-12T10:50:57.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb23e00640 1 -- 172.21.15.115:0/3703310483 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb30015460 con 0x561a511c8a10 2024-05-12T10:50:57.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3703310483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c8a10 msgr2=0x561a511c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3703310483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c8a10 0x561a511c8df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009a80 tx=0x7ffb30009190 comp rx=0 tx=0).stop 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3703310483 shutdown_connections 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3703310483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c8a10 0x561a511c8df0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3703310483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c3c80 0x561a511c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3703310483 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3703310483 >> 172.21.15.115:0/3703310483 conn(0x561a5106ff90 msgr2=0x561a511c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3703310483 shutdown_connections 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3703310483 wait complete. 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 -- start start 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 Processor -- start 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511c3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c8a10 0x561a51189150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561a50fe44f0 con 0x561a511c3c80 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561a50f77900 con 0x561a511c8a10 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x561a5118e1d0 con 0x561a5118ddf0 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb41ccd000 10 client.0 _ll_register_callbacks cb 0x561a51173180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb36a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb36a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511c3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48254/0 (socket says 172.21.15.115:48254) 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb36a00640 1 -- 172.21.15.115:0/3019838474 learned_addr learned my addr 172.21.15.115:0/3019838474 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37e00640 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c8a10 0x561a51189150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.408+0000 7ffb37400640 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb36a00640 1 -- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 msgr2=0x561a511c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb36a00640 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb36a00640 1 -- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c8a10 msgr2=0x561a51189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb36a00640 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c8a10 0x561a51189150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb36a00640 1 -- 172.21.15.115:0/3019838474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a50f89e40 con 0x561a511c3c80 2024-05-12T10:50:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb37e00640 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c8a10 0x561a51189150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb36a00640 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511c3270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400ce50 tx=0x7ffb2405b1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e6b98a6da5da88 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb20c00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb20c00640 1 -- 172.21.15.115:0/3019838474 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2405ab10 con 0x561a511c3c80 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb20c00640 1 -- 172.21.15.115:0/3019838474 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ffb24057020 con 0x561a511c3c80 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3019838474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb30011b60 con 0x561a511c3c80 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb20c00640 1 -- 172.21.15.115:0/3019838474 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ffb2405b6b0 con 0x561a511c3c80 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb41ccd000 10 client.4848 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3019838474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x561a510a1ab0 con 0x561a511c3c80 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb20c00640 1 -- 172.21.15.115:0/3019838474 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb30011b60 con 0x561a511c3c80 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb20c00640 1 -- 172.21.15.115:0/3019838474 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7ffb24057220 con 0x561a511c3c80 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb41ccd000 10 client.4848 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb41ccd000 10 client.4848 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb41ccd000 20 client.4848 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x561a51189ef0 0x561a5118a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb41ccd000 4 client.4848 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:50:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3019838474 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a50f707f0 con 0x561a51189ef0 2024-05-12T10:50:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb37400640 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x561a51189ef0 0x561a5118a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb37400640 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x561a51189ef0 0x561a5118a2d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e64edb16eceeaa3 server_cookie=197a6353fe350e11 in_seq=0 out_seq=0 2024-05-12T10:50:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb20c00640 10 client.4848 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb20c00640 1 -- 172.21.15.115:0/3019838474 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561a50f707f0 con 0x561a51189ef0 2024-05-12T10:50:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb20c00640 10 client.4848 handle_command_reply: tid=0 2024-05-12T10:50:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.412+0000 7ffb41ccd000 1 client.4848 shutdown 2024-05-12T10:50:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3019838474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 msgr2=0x561a511c3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511c3270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400ce50 tx=0x7ffb2405b1c0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3019838474 shutdown_connections 2024-05-12T10:50:57.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x561a51189ef0 0x561a5118a2d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a511c8a10 0x561a51189150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511c3270 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3019838474 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb20c00640 0 client.4848 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:57.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3019838474 >> 172.21.15.115:0/3019838474 conn(0x561a5106ff90 msgr2=0x561a511c6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:57.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3019838474 shutdown_connections 2024-05-12T10:50:57.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3019838474 wait complete. 2024-05-12T10:50:57.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.416+0000 7ffb41ccd000 20 client.4848 trim_cache size 0 max 16384 2024-05-12T10:50:57.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb41ccd000 1 Processor -- start 2024-05-12T10:50:57.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb41ccd000 1 -- start start 2024-05-12T10:50:57.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a5106ff90 0x561a5118cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a5118d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a51243b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ffb381ffd90 con 0x561a511c3c80 2024-05-12T10:50:57.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb381fe500 con 0x561a5106ff90 2024-05-12T10:50:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ffb381fd8a0 con 0x561a5118ddf0 2024-05-12T10:50:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb37e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a51243b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb37e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a51243b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48270/0 (socket says 172.21.15.115:48270) 2024-05-12T10:50:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb37e00640 1 -- 172.21.15.115:0/3318405469 learned_addr learned my addr 172.21.15.115:0/3318405469 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb37400640 1 --2- 172.21.15.115:0/3318405469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a5106ff90 0x561a5118cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb36a00640 1 --2- 172.21.15.115:0/3318405469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a5118d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb37e00640 1 -- 172.21.15.115:0/3318405469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 msgr2=0x561a5118d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb37e00640 1 --2- 172.21.15.115:0/3318405469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a5118d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb37e00640 1 -- 172.21.15.115:0/3318405469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a5106ff90 msgr2=0x561a5118cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb37e00640 1 --2- 172.21.15.115:0/3318405469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a5106ff90 0x561a5118cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb37e00640 1 -- 172.21.15.115:0/3318405469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a51057e30 con 0x561a511c3c80 2024-05-12T10:50:57.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb37e00640 1 --2- 172.21.15.115:0/3318405469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a51243b60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009a20 tx=0x7ffb30016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27415cf74b77eff6 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:57.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb23400640 1 -- 172.21.15.115:0/3318405469 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb30019040 con 0x561a511c3c80 2024-05-12T10:50:57.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb23400640 1 -- 172.21.15.115:0/3318405469 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb3002d070 con 0x561a511c3c80 2024-05-12T10:50:57.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.432+0000 7ffb23400640 1 -- 172.21.15.115:0/3318405469 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb300044e0 con 0x561a511c3c80 2024-05-12T10:50:57.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3318405469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 msgr2=0x561a51243b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3318405469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a51243b60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009a20 tx=0x7ffb30016000 comp rx=0 tx=0).stop 2024-05-12T10:50:57.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3318405469 shutdown_connections 2024-05-12T10:50:57.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3318405469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a51243b60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3318405469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a5118d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/3318405469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a5106ff90 0x561a5118cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3318405469 >> 172.21.15.115:0/3318405469 conn(0x561a511c3780 msgr2=0x561a511e4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3318405469 shutdown_connections 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 -- 172.21.15.115:0/3318405469 wait complete. 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 -- start start 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 Processor -- start 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a5106ff90 0x561a511e2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511e2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511e3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561a50f6d3e0 con 0x561a511c3c80 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb381fdea0 con 0x561a5106ff90 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x561a50fd6400 con 0x561a5118ddf0 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 10 client.0 _ll_register_callbacks cb 0x7ffb24062050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:50:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb37e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511e3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb37e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511e3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48278/0 (socket says 172.21.15.115:48278) 2024-05-12T10:50:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb37e00640 1 -- 172.21.15.115:0/2439456226 learned_addr learned my addr 172.21.15.115:0/2439456226 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:50:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb37400640 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a5106ff90 0x561a511e2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb36a00640 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511e2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb37e00640 1 -- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 msgr2=0x561a511e2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb37e00640 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511e2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb37e00640 1 -- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a5106ff90 msgr2=0x561a511e2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:50:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb37e00640 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a5106ff90 0x561a511e2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb37e00640 1 -- 172.21.15.115:0/2439456226 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a50f68d80 con 0x561a511c3c80 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb37e00640 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511e3290 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000b010 tx=0x7ffb30004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa43837dc40ab02 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb20c00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb20c00640 1 -- 172.21.15.115:0/2439456226 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb30019040 con 0x561a511c3c80 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 -- 172.21.15.115:0/2439456226 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb3002d070 con 0x561a511c3c80 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb20c00640 1 -- 172.21.15.115:0/2439456226 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ffb30011cb0 con 0x561a511c3c80 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb20c00640 1 -- 172.21.15.115:0/2439456226 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ffb3003d050 con 0x561a511c3c80 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 10 client.4854 fetch_fsmap learned FSMap version 14 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.436+0000 7ffb41ccd000 1 -- 172.21.15.115:0/2439456226 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x561a50f7bf80 con 0x561a511c3c80 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.440+0000 7ffb20c00640 1 -- 172.21.15.115:0/2439456226 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb3002d070 con 0x561a511c3c80 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.440+0000 7ffb20c00640 1 -- 172.21.15.115:0/2439456226 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7ffb30040020 con 0x561a511c3c80 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.440+0000 7ffb41ccd000 10 client.4854 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:50:57.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.440+0000 7ffb41ccd000 10 client.4854 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:50:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.440+0000 7ffb41ccd000 20 client.4854 populate_metadata read hostname 'smithi115' 2024-05-12T10:50:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.440+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x561a511c8a10 0x561a512519f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:50:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.440+0000 7ffb41ccd000 4 client.4854 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}] 2024-05-12T10:50:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.440+0000 7ffb41ccd000 1 -- 172.21.15.115:0/2439456226 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}) -- 0x561a50fe4d00 con 0x561a511c8a10 2024-05-12T10:50:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.440+0000 7ffb37400640 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x561a511c8a10 0x561a512519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:50:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.440+0000 7ffb20c00640 10 client.4854 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.440+0000 7ffb37400640 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x561a511c8a10 0x561a512519f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4402d2409a691481 server_cookie=1822d280cbc936b3 in_seq=0 out_seq=0 2024-05-12T10:50:57.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb20c00640 1 -- 172.21.15.115:0/2439456226 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x561a50fe4d00 con 0x561a511c8a10 2024-05-12T10:50:57.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb20c00640 10 client.4854 handle_command_reply: tid=0 2024-05-12T10:50:57.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 1 client.4854 shutdown 2024-05-12T10:50:57.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 1 -- 172.21.15.115:0/2439456226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 msgr2=0x561a511e3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511e3290 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000b010 tx=0x7ffb30004740 comp rx=0 tx=0).stop 2024-05-12T10:50:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 1 -- 172.21.15.115:0/2439456226 shutdown_connections 2024-05-12T10:50:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561a511c3c80 0x561a511e3290 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x561a5118ddf0 0x561a511e2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x561a511c8a10 0x561a512519f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 1 --2- 172.21.15.115:0/2439456226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a5106ff90 0x561a511e2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 1 -- 172.21.15.115:0/2439456226 >> 172.21.15.115:0/2439456226 conn(0x561a511c3780 msgr2=0x561a511e4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb20c00640 0 client.4854 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:50:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 1 -- 172.21.15.115:0/2439456226 shutdown_connections 2024-05-12T10:50:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 1 -- 172.21.15.115:0/2439456226 wait complete. 2024-05-12T10:50:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb41ccd000 20 client.4854 trim_cache size 0 max 16384 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 2, 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "49c8f64": { 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 2, 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:50:57.448 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 70.0, 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:50:57.449 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:50:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 -- 172.21.15.115:0/124926191 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ffb1806f400 msgr2=0x7ffb180718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ffb1806f400 0x7ffb180718c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffb280b1000 tx=0x7ffb280aa000 comp rx=0 tx=0).stop 2024-05-12T10:50:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 -- 172.21.15.115:0/124926191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb380cd470 msgr2=0x7ffb3815e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:50:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb380cd470 0x7ffb3815e600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c490 tx=0x7ffb2400c950 comp rx=0 tx=0).stop 2024-05-12T10:50:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 -- 172.21.15.115:0/124926191 shutdown_connections 2024-05-12T10:50:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ffb1806f400 0x7ffb180718c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb381560b0 0x7ffb3815eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb380cd470 0x7ffb3815e600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 --2- 172.21.15.115:0/124926191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb3806d600 0x7ffb3815fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:50:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 -- 172.21.15.115:0/124926191 >> 172.21.15.115:0/124926191 conn(0x7ffb38073b70 msgr2=0x7ffb3814edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:50:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 -- 172.21.15.115:0/124926191 shutdown_connections 2024-05-12T10:50:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:50:57.448+0000 7ffb3e800640 1 -- 172.21.15.115:0/124926191 wait complete. 2024-05-12T10:50:57.466 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '49c8f64', quiesce took 0.6 seconds. Will release after: 10 2024-05-12T10:51:07.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:51:07.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757e800640 1 Processor -- start 2024-05-12T10:51:07.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757e800640 1 -- start start 2024-05-12T10:51:07.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757e800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7578153f60 0x7f75780c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:07.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757e800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f75780ca660 0x7f7578159e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:07.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757e800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757815da10 con 0x7f7578153b80 2024-05-12T10:51:07.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757e800640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f75780b2160 con 0x7f7578153f60 2024-05-12T10:51:07.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757e800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f75780c4510 con 0x7f75780ca660 2024-05-12T10:51:07.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757ca00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7578153f60 0x7f75780c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:07.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757ca00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7578153f60 0x7f75780c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58912/0 (socket says 172.21.15.115:58912) 2024-05-12T10:51:07.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757ca00640 1 -- 172.21.15.115:0/2086235677 learned_addr learned my addr 172.21.15.115:0/2086235677 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:07.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757de00640 1 --2- 172.21.15.115:0/2086235677 >> v2:172.21.15.134:3300/0 conn(0x7f75780ca660 0x7f7578159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:07.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757ca00640 1 -- 172.21.15.115:0/2086235677 >> v2:172.21.15.134:3300/0 conn(0x7f75780ca660 msgr2=0x7f7578159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:07.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757ca00640 1 --2- 172.21.15.115:0/2086235677 >> v2:172.21.15.134:3300/0 conn(0x7f75780ca660 0x7f7578159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:07.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757ca00640 1 -- 172.21.15.115:0/2086235677 >> v1:172.21.15.134:6789/0 conn(0x7f7578153b80 legacy=0x7f7578071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:07.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757ca00640 1 -- 172.21.15.115:0/2086235677 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757815dcf0 con 0x7f7578153f60 2024-05-12T10:51:07.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.620+0000 7f757de00640 1 --2- 172.21.15.115:0/2086235677 >> v2:172.21.15.134:3300/0 conn(0x7f75780ca660 0x7f7578159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:51:07.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.624+0000 7f757ca00640 1 --2- 172.21.15.115:0/2086235677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7578153f60 0x7f75780c9ef0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f75780c5d40 tx=0x7f756401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b63c9e75b2c2df1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:07.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.624+0000 7f7577e00640 1 -- 172.21.15.115:0/2086235677 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75640b5070 con 0x7f7578153f60 2024-05-12T10:51:07.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.624+0000 7f7577e00640 1 -- 172.21.15.115:0/2086235677 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75640a8a10 con 0x7f7578153f60 2024-05-12T10:51:07.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.624+0000 7f7577e00640 1 -- 172.21.15.115:0/2086235677 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75640a8de0 con 0x7f7578153f60 2024-05-12T10:51:07.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 -- 172.21.15.115:0/2086235677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7578153f60 msgr2=0x7f75780c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:07.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 --2- 172.21.15.115:0/2086235677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7578153f60 0x7f75780c9ef0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f75780c5d40 tx=0x7f756401ed10 comp rx=0 tx=0).stop 2024-05-12T10:51:07.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 -- 172.21.15.115:0/2086235677 shutdown_connections 2024-05-12T10:51:07.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 --2- 172.21.15.115:0/2086235677 >> v2:172.21.15.134:3300/0 conn(0x7f75780ca660 0x7f7578159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:07.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 --2- 172.21.15.115:0/2086235677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7578153f60 0x7f75780c9ef0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:07.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 -- 172.21.15.115:0/2086235677 >> 172.21.15.115:0/2086235677 conn(0x7f7578071780 msgr2=0x7f7578076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:07.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 -- 172.21.15.115:0/2086235677 shutdown_connections 2024-05-12T10:51:07.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 -- 172.21.15.115:0/2086235677 wait complete. 2024-05-12T10:51:07.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 Processor -- start 2024-05-12T10:51:07.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 -- start start 2024-05-12T10:51:07.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75780ca660 0x7f75780ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:07.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7578153b80 0x7f75781e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:07.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7578153f60 0x7f75781efb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7578072530 con 0x7f7578153b80 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75780c4a40 con 0x7f7578153f60 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757e800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f75780726b0 con 0x7f75780ca660 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757ca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7578153b80 0x7f75781e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757ca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7578153b80 0x7f75781e6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58914/0 (socket says 172.21.15.115:58914) 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757ca00640 1 -- 172.21.15.115:0/2922137569 learned_addr learned my addr 172.21.15.115:0/2922137569 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757d400640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75780ca660 0x7f75780ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757de00640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7578153f60 0x7f75781efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757ca00640 1 -- 172.21.15.115:0/2922137569 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75780ca660 msgr2=0x7f75780ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757ca00640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75780ca660 0x7f75780ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757ca00640 1 -- 172.21.15.115:0/2922137569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7578153f60 msgr2=0x7f75781efb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757ca00640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7578153f60 0x7f75781efb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.628+0000 7f757ca00640 1 -- 172.21.15.115:0/2922137569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75781ef610 con 0x7f7578153b80 2024-05-12T10:51:07.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.632+0000 7f757ca00640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7578153b80 0x7f75781e6100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f756401b920 tx=0x7f756401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:07.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.632+0000 7f7575600640 1 -- 172.21.15.115:0/2922137569 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75640b5070 con 0x7f7578153b80 2024-05-12T10:51:07.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.632+0000 7f7575600640 1 -- 172.21.15.115:0/2922137569 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75640b0b30 con 0x7f7578153b80 2024-05-12T10:51:07.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.632+0000 7f7575600640 1 -- 172.21.15.115:0/2922137569 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75640bb410 con 0x7f7578153b80 2024-05-12T10:51:07.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.632+0000 7f757e800640 1 -- 172.21.15.115:0/2922137569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75780b37e0 con 0x7f7578153b80 2024-05-12T10:51:07.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.632+0000 7f757e800640 1 -- 172.21.15.115:0/2922137569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75780b4060 con 0x7f7578153b80 2024-05-12T10:51:07.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.632+0000 7f757e800640 1 -- 172.21.15.115:0/2922137569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7578050750 con 0x7f7578153b80 2024-05-12T10:51:07.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.632+0000 7f7575600640 1 -- 172.21.15.115:0/2922137569 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f75640c2060 con 0x7f7578153b80 2024-05-12T10:51:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.636+0000 7f7575600640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f755806f430 0x7f75580718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.636+0000 7f7575600640 1 -- 172.21.15.115:0/2922137569 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f756412c590 con 0x7f7578153b80 2024-05-12T10:51:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.636+0000 7f757d400640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f755806f430 0x7f75580718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:07.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.636+0000 7f757d400640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f755806f430 0x7f75580718f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f756c007fd0 tx=0x7f756c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:07.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.640+0000 7f7575600640 1 -- 172.21.15.115:0/2922137569 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7564018870 con 0x7f7578153b80 2024-05-12T10:51:07.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f757e800640 1 -- 172.21.15.115:0/2922137569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75780ccb10 con 0x7f7578153b80 2024-05-12T10:51:07.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f7575600640 1 -- 172.21.15.115:0/2922137569 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f75640f8ab0 con 0x7f7578153b80 2024-05-12T10:51:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:51:07.829 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:51:07.830 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:51:07.831 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f757e800640 1 -- 172.21.15.115:0/2922137569 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f755806f430 msgr2=0x7f75580718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:07.831 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f757e800640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f755806f430 0x7f75580718f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f756c007fd0 tx=0x7f756c009040 comp rx=0 tx=0).stop 2024-05-12T10:51:07.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f757e800640 1 -- 172.21.15.115:0/2922137569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7578153b80 msgr2=0x7f75781e6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:07.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f757e800640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7578153b80 0x7f75781e6100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f756401b920 tx=0x7f756401bab0 comp rx=0 tx=0).stop 2024-05-12T10:51:07.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f757e800640 1 -- 172.21.15.115:0/2922137569 shutdown_connections 2024-05-12T10:51:07.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f757e800640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f755806f430 0x7f75580718f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:07.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f757e800640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7578153f60 0x7f75781efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:07.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f757e800640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7578153b80 0x7f75781e6100 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:07.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f757e800640 1 --2- 172.21.15.115:0/2922137569 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75780ca660 0x7f75780ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:07.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.832+0000 7f757e800640 1 -- 172.21.15.115:0/2922137569 >> 172.21.15.115:0/2922137569 conn(0x7f7578071780 msgr2=0x7f7578151d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:07.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.836+0000 7f757e800640 1 -- 172.21.15.115:0/2922137569 shutdown_connections 2024-05-12T10:51:07.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:07.836+0000 7f757e800640 1 -- 172.21.15.115:0/2922137569 wait complete. 2024-05-12T10:51:07.850 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db --set-id 49c8f64 --release --await' 2024-05-12T10:51:07.850 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db --set-id 49c8f64 --release --await 2024-05-12T10:51:07.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1f1400640 1 Processor -- start 2024-05-12T10:51:07.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1f1400640 1 -- start start 2024-05-12T10:51:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1f1400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc1ec072400 0x7fc1ec15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1f1400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec070df0 con 0x7fc1ec153c50 2024-05-12T10:51:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1f1400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec0c6cd0 con 0x7fc1ec15d4f0 2024-05-12T10:51:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1f1400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc1ec0c7770 con 0x7fc1ec072400 2024-05-12T10:51:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1ea800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc1ec153c50 0x7fc1ec0c7e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50960/0 (socket says 172.21.15.115:50960) 2024-05-12T10:51:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1ea800640 1 -- 172.21.15.115:0/3752948545 learned_addr learned my addr 172.21.15.115:0/3752948545 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:51:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/3752948545 >> v2:172.21.15.134:3300/0 conn(0x7fc1ec072400 0x7fc1ec15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180122614 0 0) 0x7fc1ec070df0 con 0x7fc1ec153c50 2024-05-12T10:51:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1d0003530 con 0x7fc1ec153c50 2024-05-12T10:51:08.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2727329239 0 0) 0x7fc1d0003530 con 0x7fc1ec153c50 2024-05-12T10:51:08.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 >> v2:172.21.15.134:3300/0 conn(0x7fc1ec072400 msgr2=0x7fc1ec15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:08.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 --2- 172.21.15.115:0/3752948545 >> v2:172.21.15.134:3300/0 conn(0x7fc1ec072400 0x7fc1ec15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 >> v1:172.21.15.134:6789/0 conn(0x7fc1ec15d4f0 legacy=0x7fc1ec073580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:08.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec070830 con 0x7fc1ec153c50 2024-05-12T10:51:08.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fc1dc001700 con 0x7fc1ec153c50 2024-05-12T10:51:08.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 >> v1:172.21.15.115:6789/0 conn(0x7fc1ec153c50 legacy=0x7fc1ec0c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:08.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 --2- 172.21.15.115:0/3752948545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1d0003a60 0x7fc1d0003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 --2- 172.21.15.115:0/3752948545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1d0004810 0x7fc1d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 --2- 172.21.15.115:0/3752948545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1d00052f0 0x7fc1d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec0c7770 con 0x7fc1d0004810 2024-05-12T10:51:08.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d000c1c0 con 0x7fc1d00052f0 2024-05-12T10:51:08.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d000c3c0 con 0x7fc1d0003a60 2024-05-12T10:51:08.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/3752948545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1d0004810 0x7fc1d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1ea800640 1 --2- 172.21.15.115:0/3752948545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1d0003a60 0x7fc1d0003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.000+0000 7fc1eb200640 1 --2- 172.21.15.115:0/3752948545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1d00052f0 0x7fc1d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1e9e00640 1 -- 172.21.15.115:0/3752948545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1d0003a60 msgr2=0x7fc1d0003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:08.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/3752948545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1d0003a60 0x7fc1d0003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1e9e00640 1 -- 172.21.15.115:0/3752948545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1d00052f0 msgr2=0x7fc1d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:08.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/3752948545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1d00052f0 0x7fc1d000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1e9e00640 1 -- 172.21.15.115:0/3752948545 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d0003530 con 0x7fc1d0004810 2024-05-12T10:51:08.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1eb200640 1 -- 172.21.15.115:0/3752948545 reap_dead start 2024-05-12T10:51:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/3752948545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1d0004810 0x7fc1d0004c90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009ab0 tx=0x7fc1d801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38e494916a43f0f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80b2070 con 0x7fc1d0004810 2024-05-12T10:51:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d80a5530 con 0x7fc1d0004810 2024-05-12T10:51:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1e9400640 1 -- 172.21.15.115:0/3752948545 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80096b0 con 0x7fc1d0004810 2024-05-12T10:51:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1f1400640 1 -- 172.21.15.115:0/3752948545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1d0004810 msgr2=0x7fc1d0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1f1400640 1 --2- 172.21.15.115:0/3752948545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1d0004810 0x7fc1d0004c90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009ab0 tx=0x7fc1d801ca50 comp rx=0 tx=0).stop 2024-05-12T10:51:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1f1400640 1 -- 172.21.15.115:0/3752948545 shutdown_connections 2024-05-12T10:51:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1f1400640 1 --2- 172.21.15.115:0/3752948545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1d0004810 0x7fc1d0004c90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1f1400640 1 -- 172.21.15.115:0/3752948545 >> 172.21.15.115:0/3752948545 conn(0x7fc1ec0681c0 msgr2=0x7fc1ec0685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1f1400640 1 -- 172.21.15.115:0/3752948545 shutdown_connections 2024-05-12T10:51:08.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.004+0000 7fc1f1400640 1 -- 172.21.15.115:0/3752948545 wait complete. 2024-05-12T10:51:08.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1f1400640 1 Processor -- start 2024-05-12T10:51:08.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1f1400640 1 -- start start 2024-05-12T10:51:08.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1f1400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1d0004810 0x7fc1ec0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1f1400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1ec1f6b70 0x7fc1ec1f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1f1400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ec14aba0 0x7fc1ec14b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1f1400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec0c8420 con 0x7fc1ec14aba0 2024-05-12T10:51:08.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1f1400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec0c82a0 con 0x7fc1ec1f6b70 2024-05-12T10:51:08.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1f1400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ec0c9bd0 con 0x7fc1d0004810 2024-05-12T10:51:08.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1eb200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ec14aba0 0x7fc1ec14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1eb200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ec14aba0 0x7fc1ec14b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58938/0 (socket says 172.21.15.115:58938) 2024-05-12T10:51:08.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1eb200640 1 -- 172.21.15.115:0/2179471525 learned_addr learned my addr 172.21.15.115:0/2179471525 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:08.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1ec1f6b70 0x7fc1ec1f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1ea800640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1d0004810 0x7fc1ec0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1eb200640 1 -- 172.21.15.115:0/2179471525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1d0004810 msgr2=0x7fc1ec0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1eb200640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1d0004810 0x7fc1ec0cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1eb200640 1 -- 172.21.15.115:0/2179471525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1ec1f6b70 msgr2=0x7fc1ec1f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1eb200640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1ec1f6b70 0x7fc1ec1f6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1eb200640 1 -- 172.21.15.115:0/2179471525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec1f6100 con 0x7fc1ec14aba0 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1ea800640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1d0004810 0x7fc1ec0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1eb200640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ec14aba0 0x7fc1ec14b020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400f890 tx=0x7fc1e400fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1e2a00640 1 -- 172.21.15.115:0/2179471525 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4019070 con 0x7fc1ec14aba0 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1e2a00640 1 -- 172.21.15.115:0/2179471525 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e4006d70 con 0x7fc1ec14aba0 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1e2a00640 1 -- 172.21.15.115:0/2179471525 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4003ba0 con 0x7fc1ec14aba0 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1f1400640 1 -- 172.21.15.115:0/2179471525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ec1f7510 con 0x7fc1ec14aba0 2024-05-12T10:51:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.008+0000 7fc1f1400640 1 -- 172.21.15.115:0/2179471525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ec0cc8a0 con 0x7fc1ec14aba0 2024-05-12T10:51:08.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.012+0000 7fc1e2a00640 1 -- 172.21.15.115:0/2179471525 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc1e4005030 con 0x7fc1ec14aba0 2024-05-12T10:51:08.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.012+0000 7fc1e2a00640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1cc06f400 0x7fc1cc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.012+0000 7fc1e2a00640 1 -- 172.21.15.115:0/2179471525 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc1e408e850 con 0x7fc1ec14aba0 2024-05-12T10:51:08.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.012+0000 7fc1f4857000 1 Processor -- start 2024-05-12T10:51:08.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.012+0000 7fc1ea800640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1cc06f400 0x7fc1cc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.012+0000 7fc1f4857000 1 -- start start 2024-05-12T10:51:08.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.012+0000 7fc1ea800640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1cc06f400 0x7fc1cc0718c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000fc0 tx=0x7fc1dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:08.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.012+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5ac09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2270 0x5649f5ac2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2b90 0x5649f5ac2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5649f5981a60 con 0x5649f5ac0600 2024-05-12T10:51:08.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5649f58ea250 con 0x5649f5ac2270 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5649f588e4d0 con 0x5649f5ac2b90 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1ea800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5ac09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1ea800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5ac09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58946/0 (socket says 172.21.15.115:58946) 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1ea800640 1 -- 172.21.15.115:0/2650821901 learned_addr learned my addr 172.21.15.115:0/2650821901 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/2650821901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2270 0x5649f5ac2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1eb200640 1 --2- 172.21.15.115:0/2650821901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2b90 0x5649f5ac2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1ea800640 1 -- 172.21.15.115:0/2650821901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2b90 msgr2=0x5649f5ac2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1ea800640 1 --2- 172.21.15.115:0/2650821901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2b90 0x5649f5ac2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1ea800640 1 -- 172.21.15.115:0/2650821901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2270 msgr2=0x5649f5ac2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1ea800640 1 --2- 172.21.15.115:0/2650821901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2270 0x5649f5ac2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1ea800640 1 -- 172.21.15.115:0/2650821901 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f58c1970 con 0x5649f5ac0600 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1ea800640 1 --2- 172.21.15.115:0/2650821901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5ac09e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc001870 tx=0x7fc1dc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4329bd27c6cd78 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1d7400640 1 -- 172.21.15.115:0/2650821901 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc026070 con 0x5649f5ac0600 2024-05-12T10:51:08.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1d7400640 1 -- 172.21.15.115:0/2650821901 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1dc015e40 con 0x5649f5ac0600 2024-05-12T10:51:08.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1d7400640 1 -- 172.21.15.115:0/2650821901 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0147e0 con 0x5649f5ac0600 2024-05-12T10:51:08.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- 172.21.15.115:0/2650821901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 msgr2=0x5649f5ac09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:08.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 --2- 172.21.15.115:0/2650821901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5ac09e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc001870 tx=0x7fc1dc014000 comp rx=0 tx=0).stop 2024-05-12T10:51:08.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- 172.21.15.115:0/2650821901 shutdown_connections 2024-05-12T10:51:08.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 --2- 172.21.15.115:0/2650821901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2b90 0x5649f5ac2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 --2- 172.21.15.115:0/2650821901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2270 0x5649f5ac2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 --2- 172.21.15.115:0/2650821901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5ac09e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- 172.21.15.115:0/2650821901 >> 172.21.15.115:0/2650821901 conn(0x5649f5ad7430 msgr2=0x5649f5ad9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:08.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- 172.21.15.115:0/2650821901 shutdown_connections 2024-05-12T10:51:08.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- 172.21.15.115:0/2650821901 wait complete. 2024-05-12T10:51:08.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- start start 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 Processor -- start 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac0600 0x5649f5abf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5abff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2b90 0x5649f5ae1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5649f58e6210 con 0x5649f5ac2270 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5649f58f7650 con 0x5649f5ac0600 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5649f59285b0 con 0x5649f5ac2b90 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1f4857000 10 client.0 _ll_register_callbacks cb 0x5649f5a84f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1e9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5abff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1e9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5abff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58952/0 (socket says 172.21.15.115:58952) 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.016+0000 7fc1e9e00640 1 -- 172.21.15.115:0/2873492198 learned_addr learned my addr 172.21.15.115:0/2873492198 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1ea800640 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac0600 0x5649f5abf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1eb200640 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2b90 0x5649f5ae1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1e9e00640 1 -- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2b90 msgr2=0x5649f5ae1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2b90 0x5649f5ae1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1e9e00640 1 -- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac0600 msgr2=0x5649f5abf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac0600 0x5649f5abf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1e9e00640 1 -- 172.21.15.115:0/2873492198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f592e0e0 con 0x5649f5ac2270 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1ea800640 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac0600 0x5649f5abf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5abff20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80b0040 tx=0x7fc1d80197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee3a7e3ccbb989d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1cbe00640 1 -- 172.21.15.115:0/2873492198 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80bc020 con 0x5649f5ac2270 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1f4857000 1 -- 172.21.15.115:0/2873492198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5649f5883060 con 0x5649f5ac2270 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1cbe00640 1 -- 172.21.15.115:0/2873492198 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc1d80096b0 con 0x5649f5ac2270 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1cbe00640 1 -- 172.21.15.115:0/2873492198 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fc1d80b2040 con 0x5649f5ac2270 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1f4857000 10 client.4872 fetch_fsmap learned FSMap version 14 2024-05-12T10:51:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1f4857000 1 -- 172.21.15.115:0/2873492198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5649f589c9e0 con 0x5649f5ac2270 2024-05-12T10:51:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1cbe00640 1 -- 172.21.15.115:0/2873492198 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5649f5883060 con 0x5649f5ac2270 2024-05-12T10:51:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1cbe00640 1 -- 172.21.15.115:0/2873492198 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fc1d80059a0 con 0x5649f5ac2270 2024-05-12T10:51:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1f4857000 10 client.4872 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:51:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1f4857000 10 client.4872 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:51:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1f4857000 20 client.4872 populate_metadata read hostname 'smithi115' 2024-05-12T10:51:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1f4857000 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5649f5ae28a0 0x5649f5ae2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1f4857000 4 client.4872 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:51:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1f4857000 1 -- 172.21.15.115:0/2873492198 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649f58f7e60 con 0x5649f5ae28a0 2024-05-12T10:51:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1ea800640 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5649f5ae28a0 0x5649f5ae2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1ea800640 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5649f5ae28a0 0x5649f5ae2c80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6f5073745884567 server_cookie=b11511ed784679fc in_seq=0 out_seq=0 2024-05-12T10:51:08.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.020+0000 7fc1cbe00640 10 client.4872 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1cbe00640 1 -- 172.21.15.115:0/2873492198 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5649f58f7e60 con 0x5649f5ae28a0 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1cbe00640 10 client.4872 handle_command_reply: tid=0 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 1 client.4872 shutdown 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 1 -- 172.21.15.115:0/2873492198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 msgr2=0x5649f5abff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5abff20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80b0040 tx=0x7fc1d80197f0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 1 -- 172.21.15.115:0/2873492198 shutdown_connections 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2b90 0x5649f5ae1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5abff20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5649f5ae28a0 0x5649f5ae2c80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 1 --2- 172.21.15.115:0/2873492198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac0600 0x5649f5abf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 1 -- 172.21.15.115:0/2873492198 >> 172.21.15.115:0/2873492198 conn(0x5649f5ad7430 msgr2=0x5649f5ad9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:08.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1cbe00640 0 client.4872 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:08.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 1 -- 172.21.15.115:0/2873492198 shutdown_connections 2024-05-12T10:51:08.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 1 -- 172.21.15.115:0/2873492198 wait complete. 2024-05-12T10:51:08.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.024+0000 7fc1f4857000 20 client.4872 trim_cache size 0 max 16384 2024-05-12T10:51:08.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1f4857000 1 Processor -- start 2024-05-12T10:51:08.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1f4857000 1 -- start start 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac0600 0x5649f5aedbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5aecb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2b90 0x5649f5aed050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1f4857000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec202570 con 0x5649f5ac2270 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1f4857000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec201920 con 0x5649f5ac2b90 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1f4857000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ec201ed0 con 0x5649f5ac0600 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1e9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5aecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1e9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5aecb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58960/0 (socket says 172.21.15.115:58960) 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1e9e00640 1 -- 172.21.15.115:0/1156744196 learned_addr learned my addr 172.21.15.115:0/1156744196 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1eb200640 1 --2- 172.21.15.115:0/1156744196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2b90 0x5649f5aed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1ea800640 1 --2- 172.21.15.115:0/1156744196 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac0600 0x5649f5aedbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1e9e00640 1 -- 172.21.15.115:0/1156744196 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac0600 msgr2=0x5649f5aedbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:08.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/1156744196 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac0600 0x5649f5aedbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1e9e00640 1 -- 172.21.15.115:0/1156744196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2b90 msgr2=0x5649f5aed050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:08.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/1156744196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2b90 0x5649f5aed050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1e9e00640 1 -- 172.21.15.115:0/1156744196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f588e6e0 con 0x5649f5ac2270 2024-05-12T10:51:08.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1ea800640 1 --2- 172.21.15.115:0/1156744196 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac0600 0x5649f5aedbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:51:08.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/1156744196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5aecb10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80090e0 tx=0x7fc1d80b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179a790d5e994044 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:08.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1d6a00640 1 -- 172.21.15.115:0/1156744196 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80bc040 con 0x5649f5ac2270 2024-05-12T10:51:08.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1d6a00640 1 -- 172.21.15.115:0/1156744196 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d80c1e50 con 0x5649f5ac2270 2024-05-12T10:51:08.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.040+0000 7fc1d6a00640 1 -- 172.21.15.115:0/1156744196 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80059a0 con 0x5649f5ac2270 2024-05-12T10:51:08.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- 172.21.15.115:0/1156744196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 msgr2=0x5649f5aecb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:08.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 --2- 172.21.15.115:0/1156744196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5aecb10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80090e0 tx=0x7fc1d80b7000 comp rx=0 tx=0).stop 2024-05-12T10:51:08.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- 172.21.15.115:0/1156744196 shutdown_connections 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 --2- 172.21.15.115:0/1156744196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2b90 0x5649f5aed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 --2- 172.21.15.115:0/1156744196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac2270 0x5649f5aecb10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 --2- 172.21.15.115:0/1156744196 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac0600 0x5649f5aedbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- 172.21.15.115:0/1156744196 >> 172.21.15.115:0/1156744196 conn(0x5649f5ad7430 msgr2=0x5649f5ae1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- 172.21.15.115:0/1156744196 shutdown_connections 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- 172.21.15.115:0/1156744196 wait complete. 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- start start 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 Processor -- start 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5a9ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2270 0x5649f5ae2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2b90 0x5649f5ae31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5649f587fc50 con 0x5649f5ac0600 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5649f58e2d70 con 0x5649f5ac2b90 2024-05-12T10:51:08.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5649f58e9560 con 0x5649f5ac2270 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 10 client.0 _ll_register_callbacks cb 0x7fc1d0003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1ea800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5a9ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1ea800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5a9ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58968/0 (socket says 172.21.15.115:58968) 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1ea800640 1 -- 172.21.15.115:0/1352799451 learned_addr learned my addr 172.21.15.115:0/1352799451 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2270 0x5649f5ae2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1eb200640 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2b90 0x5649f5ae31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1ea800640 1 -- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2270 msgr2=0x5649f5ae2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1ea800640 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2270 0x5649f5ae2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1ea800640 1 -- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2b90 msgr2=0x5649f5ae31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1ea800640 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2b90 0x5649f5ae31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1ea800640 1 -- 172.21.15.115:0/1352799451 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f59412a0 con 0x5649f5ac0600 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1ea800640 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5a9ec10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc024040 tx=0x7fc1dc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0ab73f80e1358b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1cbe00640 1 -- 172.21.15.115:0/1352799451 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc03b060 con 0x5649f5ac0600 2024-05-12T10:51:08.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1cbe00640 1 -- 172.21.15.115:0/1352799451 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc1dc0149c0 con 0x5649f5ac0600 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- 172.21.15.115:0/1352799451 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1d80c1e50 con 0x5649f5ac0600 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1cbe00640 1 -- 172.21.15.115:0/1352799451 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fc1dc041050 con 0x5649f5ac0600 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 10 client.4878 fetch_fsmap learned FSMap version 14 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- 172.21.15.115:0/1352799451 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5649f587e9c0 con 0x5649f5ac0600 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1cbe00640 1 -- 172.21.15.115:0/1352799451 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d80c1e50 con 0x5649f5ac0600 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1cbe00640 1 -- 172.21.15.115:0/1352799451 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fc1dc044020 con 0x5649f5ac0600 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 10 client.4878 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 10 client.4878 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 20 client.4878 populate_metadata read hostname 'smithi115' 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5649f5ae3b80 0x5649f5ae3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 4 client.4878 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "49c8f64", "release": true, "await": true}] 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.044+0000 7fc1f4857000 1 -- 172.21.15.115:0/1352799451 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "set_id": "49c8f64", "release": true, "await": true}) -- 0x5649f58f1cd0 con 0x5649f5ae3b80 2024-05-12T10:51:08.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5649f5ae3b80 0x5649f5ae3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1e9e00640 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5649f5ae3b80 0x5649f5ae3f90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=261dbe603d04d225 server_cookie=ec5ae064531c0f21 in_seq=0 out_seq=0 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1cbe00640 10 client.4878 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1cbe00640 1 -- 172.21.15.115:0/1352799451 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x5649f58f1cd0 con 0x5649f5ae3b80 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1cbe00640 10 client.4878 handle_command_reply: tid=0 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 1 client.4878 shutdown 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 1 -- 172.21.15.115:0/1352799451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 msgr2=0x5649f5a9ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5a9ec10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc024040 tx=0x7fc1dc001a00 comp rx=0 tx=0).stop 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 1 -- 172.21.15.115:0/1352799451 shutdown_connections 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5649f5ae3b80 0x5649f5ae3f90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649f5ac2b90 0x5649f5ae31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5649f5ac2270 0x5649f5ae2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 1 --2- 172.21.15.115:0/1352799451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649f5ac0600 0x5649f5a9ec10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1cbe00640 0 client.4878 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:08.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 1 -- 172.21.15.115:0/1352799451 >> 172.21.15.115:0/1352799451 conn(0x5649f5ad7430 msgr2=0x5649f5ac1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:08.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 1 -- 172.21.15.115:0/1352799451 shutdown_connections 2024-05-12T10:51:08.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 1 -- 172.21.15.115:0/1352799451 wait complete. 2024-05-12T10:51:08.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f4857000 20 client.4878 trim_cache size 0 max 16384 2024-05-12T10:51:08.049 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:51:08.049 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:51:08.049 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:51:08.049 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 4, 2024-05-12T10:51:08.049 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:51:08.049 INFO:teuthology.orchestra.run.smithi115.stdout: "49c8f64": { 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 4, 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 70.0, 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:51:08.050 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:51:08.051 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:08.051 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:08.051 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:08.051 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:08.051 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:08.051 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:51:08.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f1400640 1 -- 172.21.15.115:0/2179471525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1cc06f400 msgr2=0x7fc1cc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:08.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f1400640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1cc06f400 0x7fc1cc0718c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000fc0 tx=0x7fc1dc009040 comp rx=0 tx=0).stop 2024-05-12T10:51:08.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f1400640 1 -- 172.21.15.115:0/2179471525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ec14aba0 msgr2=0x7fc1ec14b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:08.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f1400640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ec14aba0 0x7fc1ec14b020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400f890 tx=0x7fc1e400fd50 comp rx=0 tx=0).stop 2024-05-12T10:51:08.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.048+0000 7fc1f1400640 1 -- 172.21.15.115:0/2179471525 shutdown_connections 2024-05-12T10:51:08.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.052+0000 7fc1f1400640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1cc06f400 0x7fc1cc0718c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.052+0000 7fc1f1400640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ec14aba0 0x7fc1ec14b020 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.052+0000 7fc1f1400640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1ec1f6b70 0x7fc1ec1f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.052+0000 7fc1f1400640 1 --2- 172.21.15.115:0/2179471525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1d0004810 0x7fc1ec0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:08.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.052+0000 7fc1f1400640 1 -- 172.21.15.115:0/2179471525 >> 172.21.15.115:0/2179471525 conn(0x7fc1ec0681c0 msgr2=0x7fc1ec14cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:08.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.052+0000 7fc1f1400640 1 -- 172.21.15.115:0/2179471525 shutdown_connections 2024-05-12T10:51:08.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:08.052+0000 7fc1f1400640 1 -- 172.21.15.115:0/2179471525 wait complete. 2024-05-12T10:51:08.066 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '49c8f64', seconds elapsed: 11.2 2024-05-12T10:51:19.459 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:51:19.463 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:51:26.638 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.0 2024-05-12T10:51:26.639 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:51:26.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fe006200640 1 Processor -- start 2024-05-12T10:51:26.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fe006200640 1 -- start start 2024-05-12T10:51:26.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fe006200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe000153f60 0x7fe0000c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:26.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fe006200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ca660 0x7fe000159e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:26.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fe006200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00015da10 con 0x7fe000153b80 2024-05-12T10:51:26.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fe006200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe0000b2160 con 0x7fe000153f60 2024-05-12T10:51:26.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fe006200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe0000c4510 con 0x7fe0000ca660 2024-05-12T10:51:26.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fe004e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe000153b80 0x7fe000071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49822/0 (socket says 172.21.15.115:49822) 2024-05-12T10:51:26.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fe004e00640 1 -- 172.21.15.115:0/715323302 learned_addr learned my addr 172.21.15.115:0/715323302 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:51:26.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fdfffe00640 1 --2- 172.21.15.115:0/715323302 >> v2:172.21.15.134:3300/0 conn(0x7fe000153f60 0x7fe0000c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:26.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fe005800640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ca660 0x7fe000159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:26.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512832573 0 0) 0x7fe00015da10 con 0x7fe000153b80 2024-05-12T10:51:26.783 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfe4003530 con 0x7fe000153b80 2024-05-12T10:51:26.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.784+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 973431670 0 0) 0x7fdfe4003530 con 0x7fe000153b80 2024-05-12T10:51:26.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ca660 msgr2=0x7fe000159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:26.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ca660 0x7fe000159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:26.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 >> v2:172.21.15.134:3300/0 conn(0x7fe000153f60 msgr2=0x7fe0000c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:26.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 --2- 172.21.15.115:0/715323302 >> v2:172.21.15.134:3300/0 conn(0x7fe000153f60 0x7fe0000c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:26.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00015dcf0 con 0x7fe000153b80 2024-05-12T10:51:26.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fdff0001700 con 0x7fe000153b80 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 >> v1:172.21.15.115:6789/0 conn(0x7fe000153b80 legacy=0x7fe000071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ca660 0x7fdfe4003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfe4003fe0 0x7fdfe4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfe4004d50 0x7fdfe40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe0000b2160 con 0x7fdfe4003fe0 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0000c4510 con 0x7fdfe4004d50 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe400bab0 con 0x7fe0000ca660 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfffe00640 1 --2- 172.21.15.115:0/715323302 >> v2:172.21.15.134:3300/0 conn(0x7fe000153f60 0x7fe0000c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fe004e00640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ca660 0x7fdfe4003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfffe00640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfe4003fe0 0x7fdfe4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fe005800640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfe4004d50 0x7fdfe40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfffe00640 1 -- 172.21.15.115:0/715323302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ca660 msgr2=0x7fdfe4003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:26.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfffe00640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ca660 0x7fdfe4003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:26.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfffe00640 1 -- 172.21.15.115:0/715323302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfe4004d50 msgr2=0x7fdfe40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:26.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfffe00640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfe4004d50 0x7fdfe40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:26.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfffe00640 1 -- 172.21.15.115:0/715323302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe4003530 con 0x7fdfe4003fe0 2024-05-12T10:51:26.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.788+0000 7fdfffe00640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfe4003fe0 0x7fdfe4004810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009c90 tx=0x7fdfec01cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8124d5ff30f45b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:26.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec009860 con 0x7fdfe4003fe0 2024-05-12T10:51:26.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfec0a59c0 con 0x7fdfe4003fe0 2024-05-12T10:51:26.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fdfff400640 1 -- 172.21.15.115:0/715323302 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0a5df0 con 0x7fdfe4003fe0 2024-05-12T10:51:26.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 -- 172.21.15.115:0/715323302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfe4003fe0 msgr2=0x7fdfe4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:26.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 --2- 172.21.15.115:0/715323302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfe4003fe0 0x7fdfe4004810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009c90 tx=0x7fdfec01cd00 comp rx=0 tx=0).stop 2024-05-12T10:51:26.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe005800640 1 -- 172.21.15.115:0/715323302 reap_dead start 2024-05-12T10:51:26.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 -- 172.21.15.115:0/715323302 shutdown_connections 2024-05-12T10:51:26.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 -- 172.21.15.115:0/715323302 >> 172.21.15.115:0/715323302 conn(0x7fe000071780 msgr2=0x7fe000076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:26.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 -- 172.21.15.115:0/715323302 shutdown_connections 2024-05-12T10:51:26.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 -- 172.21.15.115:0/715323302 wait complete. 2024-05-12T10:51:26.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 Processor -- start 2024-05-12T10:51:26.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 -- start start 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfe4003fe0 0x7fe0000b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe000158ac0 0x7fe0000cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe00006dca0 0x7fe000144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe000072530 con 0x7fe000158ac0 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0000c4a40 con 0x7fe00006dca0 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe006200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe0000726b0 con 0x7fdfe4003fe0 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fdfffe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe000158ac0 0x7fe0000cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fdfffe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe000158ac0 0x7fe0000cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46248/0 (socket says 172.21.15.115:46248) 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fdfffe00640 1 -- 172.21.15.115:0/3371795030 learned_addr learned my addr 172.21.15.115:0/3371795030 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe004e00640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfe4003fe0 0x7fe0000b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fe005800640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe00006dca0 0x7fe000144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:26.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fdfffe00640 1 -- 172.21.15.115:0/3371795030 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfe4003fe0 msgr2=0x7fe0000b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:26.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fdfffe00640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfe4003fe0 0x7fe0000b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:26.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fdfffe00640 1 -- 172.21.15.115:0/3371795030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe00006dca0 msgr2=0x7fe000144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:26.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.792+0000 7fdfffe00640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe00006dca0 0x7fe000144d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:26.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fdfffe00640 1 -- 172.21.15.115:0/3371795030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe000154400 con 0x7fe000158ac0 2024-05-12T10:51:26.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fdfffe00640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe000158ac0 0x7fe0000cd550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdfec01cb30 tx=0x7fdfe4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:26.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fdffcc00640 1 -- 172.21.15.115:0/3371795030 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec005cf0 con 0x7fe000158ac0 2024-05-12T10:51:26.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fdffcc00640 1 -- 172.21.15.115:0/3371795030 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfec006040 con 0x7fe000158ac0 2024-05-12T10:51:26.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fe006200640 1 -- 172.21.15.115:0/3371795030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0001546a0 con 0x7fe000158ac0 2024-05-12T10:51:26.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fdffcc00640 1 -- 172.21.15.115:0/3371795030 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec006430 con 0x7fe000158ac0 2024-05-12T10:51:26.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fe006200640 1 -- 172.21.15.115:0/3371795030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe000154c60 con 0x7fe000158ac0 2024-05-12T10:51:26.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fe006200640 1 -- 172.21.15.115:0/3371795030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe000050750 con 0x7fe000158ac0 2024-05-12T10:51:26.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fdffcc00640 1 -- 172.21.15.115:0/3371795030 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdfec0c0020 con 0x7fe000158ac0 2024-05-12T10:51:26.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fdffcc00640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdfe006f3d0 0x7fdfe0071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:26.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fdffcc00640 1 -- 172.21.15.115:0/3371795030 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdfec12a150 con 0x7fe000158ac0 2024-05-12T10:51:26.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.796+0000 7fe004e00640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdfe006f3d0 0x7fdfe0071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:26.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.800+0000 7fe004e00640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdfe006f3d0 0x7fdfe0071890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdff0001020 tx=0x7fdff0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:26.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:26.804+0000 7fdffcc00640 1 -- 172.21.15.115:0/3371795030 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fdfec0c7020 con 0x7fe000158ac0 2024-05-12T10:51:27.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.016+0000 7fe006200640 1 -- 172.21.15.115:0/3371795030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe000157270 con 0x7fe000158ac0 2024-05-12T10:51:27.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.016+0000 7fdffcc00640 1 -- 172.21.15.115:0/3371795030 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7fdfec016980 con 0x7fe000158ac0 2024-05-12T10:51:27.015 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:51:27.015 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:51:27.015 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:51:27.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 -- 172.21.15.115:0/3371795030 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdfe006f3d0 msgr2=0x7fdfe0071890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdfe006f3d0 0x7fdfe0071890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdff0001020 tx=0x7fdff0009040 comp rx=0 tx=0).stop 2024-05-12T10:51:27.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 -- 172.21.15.115:0/3371795030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe000158ac0 msgr2=0x7fe0000cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe000158ac0 0x7fe0000cd550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdfec01cb30 tx=0x7fdfe4005840 comp rx=0 tx=0).stop 2024-05-12T10:51:27.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 -- 172.21.15.115:0/3371795030 shutdown_connections 2024-05-12T10:51:27.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdfe006f3d0 0x7fdfe0071890 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe00006dca0 0x7fe000144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe000158ac0 0x7fe0000cd550 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 --2- 172.21.15.115:0/3371795030 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfe4003fe0 0x7fe0000b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 -- 172.21.15.115:0/3371795030 >> 172.21.15.115:0/3371795030 conn(0x7fe000071780 msgr2=0x7fe0000760f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:27.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 -- 172.21.15.115:0/3371795030 shutdown_connections 2024-05-12T10:51:27.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.020+0000 7fe006200640 1 -- 172.21.15.115:0/3371795030 wait complete. 2024-05-12T10:51:27.037 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db / --timeout 60 --expiration 86.0 --await-for 42.0' 2024-05-12T10:51:27.037 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db / --timeout 60 --expiration 86.0 --await-for 42.0 2024-05-12T10:51:27.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f702a400640 1 Processor -- start 2024-05-12T10:51:27.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f702a400640 1 -- start start 2024-05-12T10:51:27.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f702a400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7024150ba0 0x7f70240c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f702a400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7024070c70 con 0x7f7024159b40 2024-05-12T10:51:27.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f702a400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7024070f30 con 0x7f70240c9fd0 2024-05-12T10:51:27.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f702a400640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f70240cba70 con 0x7f7024150ba0 2024-05-12T10:51:27.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f7023400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7024150ba0 0x7f70240c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f7023e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7024159b40 0x7f7024164480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49830/0 (socket says 172.21.15.115:49830) 2024-05-12T10:51:27.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f7023400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7024150ba0 0x7f70240c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46256/0 (socket says 172.21.15.115:46256) 2024-05-12T10:51:27.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f7023e00640 1 -- 172.21.15.115:0/3676781351 learned_addr learned my addr 172.21.15.115:0/3676781351 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:51:27.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f7023400640 1 -- 172.21.15.115:0/3676781351 >> v1:172.21.15.134:6789/0 conn(0x7f70240c9fd0 legacy=0x7f70240cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f7023400640 1 -- 172.21.15.115:0/3676781351 >> v1:172.21.15.115:6789/0 conn(0x7f7024159b40 legacy=0x7f7024164480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.192+0000 7f7023400640 1 -- 172.21.15.115:0/3676781351 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7024071210 con 0x7f7024150ba0 2024-05-12T10:51:27.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.196+0000 7f7023400640 1 --2- 172.21.15.115:0/3676781351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7024150ba0 0x7f70240c6440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70140097c0 tx=0x7f701401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f4bdf47df6d8b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:27.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.196+0000 7f7022a00640 1 -- 172.21.15.115:0/3676781351 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70140b5070 con 0x7f7024150ba0 2024-05-12T10:51:27.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.196+0000 7f7022a00640 1 -- 172.21.15.115:0/3676781351 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70140a8990 con 0x7f7024150ba0 2024-05-12T10:51:27.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.196+0000 7f7022a00640 1 -- 172.21.15.115:0/3676781351 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70140a8d60 con 0x7f7024150ba0 2024-05-12T10:51:27.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.196+0000 7f702a400640 1 -- 172.21.15.115:0/3676781351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7024150ba0 msgr2=0x7f70240c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.196+0000 7f702a400640 1 --2- 172.21.15.115:0/3676781351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7024150ba0 0x7f70240c6440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70140097c0 tx=0x7f701401ec90 comp rx=0 tx=0).stop 2024-05-12T10:51:27.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.196+0000 7f702a400640 1 -- 172.21.15.115:0/3676781351 shutdown_connections 2024-05-12T10:51:27.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.196+0000 7f702a400640 1 --2- 172.21.15.115:0/3676781351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7024150ba0 0x7f70240c6440 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.196+0000 7f702a400640 1 -- 172.21.15.115:0/3676781351 >> 172.21.15.115:0/3676781351 conn(0x7f702406c610 msgr2=0x7f702406ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:27.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.196+0000 7f702a400640 1 -- 172.21.15.115:0/3676781351 shutdown_connections 2024-05-12T10:51:27.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.196+0000 7f702a400640 1 -- 172.21.15.115:0/3676781351 wait complete. 2024-05-12T10:51:27.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f702a400640 1 Processor -- start 2024-05-12T10:51:27.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f702a400640 1 -- start start 2024-05-12T10:51:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f702a400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70240c9fd0 0x7f70240c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f702a400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7024150ba0 0x7f702414c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f702a400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7024159b40 0x7f70241f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f702a400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f70240cb700 con 0x7f70240c9fd0 2024-05-12T10:51:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f702a400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70240cb420 con 0x7f7024150ba0 2024-05-12T10:51:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f702a400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f70240ca410 con 0x7f7024159b40 2024-05-12T10:51:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f7023400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70240c9fd0 0x7f70240c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f7023400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70240c9fd0 0x7f70240c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46270/0 (socket says 172.21.15.115:46270) 2024-05-12T10:51:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f7023400640 1 -- 172.21.15.115:0/110350622 learned_addr learned my addr 172.21.15.115:0/110350622 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f701aa00640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7024150ba0 0x7f702414c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f7023e00640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7024159b40 0x7f70241f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f7023400640 1 -- 172.21.15.115:0/110350622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7024159b40 msgr2=0x7f70241f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f7023400640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7024159b40 0x7f70241f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f7023400640 1 -- 172.21.15.115:0/110350622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7024150ba0 msgr2=0x7f702414c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f7023400640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7024150ba0 0x7f702414c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f7023400640 1 -- 172.21.15.115:0/110350622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702406db40 con 0x7f70240c9fd0 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f7023400640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70240c9fd0 0x7f70240c69d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7014009710 tx=0x7f701401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f701be00640 1 -- 172.21.15.115:0/110350622 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70140bf070 con 0x7f70240c9fd0 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f701be00640 1 -- 172.21.15.115:0/110350622 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70140b0840 con 0x7f70240c9fd0 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f702a400640 1 -- 172.21.15.115:0/110350622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702406dde0 con 0x7f70240c9fd0 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f701be00640 1 -- 172.21.15.115:0/110350622 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70140b5040 con 0x7f70240c9fd0 2024-05-12T10:51:27.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.200+0000 7f702a400640 1 -- 172.21.15.115:0/110350622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702406edf0 con 0x7f70240c9fd0 2024-05-12T10:51:27.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f701be00640 1 -- 172.21.15.115:0/110350622 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f70140c2070 con 0x7f70240c9fd0 2024-05-12T10:51:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f701be00640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700006f430 0x7f70000718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f701be00640 1 -- 172.21.15.115:0/110350622 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f701412bef0 con 0x7f70240c9fd0 2024-05-12T10:51:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f701aa00640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700006f430 0x7f70000718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f702d8cb000 1 Processor -- start 2024-05-12T10:51:27.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f702d8cb000 1 -- start start 2024-05-12T10:51:27.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f701aa00640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700006f430 0x7f70000718f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f70240704b0 tx=0x7f700c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f80ccdf0 0x5614f8102740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8103060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f8107a10 0x5614f8107df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f702d8cb000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5614f7f160f0 con 0x5614f8102c80 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f702d8cb000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5614f7ecf670 con 0x5614f80ccdf0 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f702d8cb000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5614f7f120b0 con 0x5614f8107a10 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f701aa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f701aa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8103060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46274/0 (socket says 172.21.15.115:46274) 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f701aa00640 1 -- 172.21.15.115:0/3566080308 learned_addr learned my addr 172.21.15.115:0/3566080308 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f7023400640 1 --2- 172.21.15.115:0/3566080308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f80ccdf0 0x5614f8102740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.204+0000 7f7023e00640 1 --2- 172.21.15.115:0/3566080308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f8107a10 0x5614f8107df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f701aa00640 1 -- 172.21.15.115:0/3566080308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f8107a10 msgr2=0x5614f8107df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f701aa00640 1 --2- 172.21.15.115:0/3566080308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f8107a10 0x5614f8107df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f701aa00640 1 -- 172.21.15.115:0/3566080308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f80ccdf0 msgr2=0x5614f8102740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f701aa00640 1 --2- 172.21.15.115:0/3566080308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f80ccdf0 0x5614f8102740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f701aa00640 1 -- 172.21.15.115:0/3566080308 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f7ed8010 con 0x5614f8102c80 2024-05-12T10:51:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f701aa00640 1 --2- 172.21.15.115:0/3566080308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8103060 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f700c001e80 tx=0x7f700c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413cd8e17e935f33 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7013e00640 1 -- 172.21.15.115:0/3566080308 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c003600 con 0x5614f8102c80 2024-05-12T10:51:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7013e00640 1 -- 172.21.15.115:0/3566080308 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f700c0037a0 con 0x5614f8102c80 2024-05-12T10:51:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7013e00640 1 -- 172.21.15.115:0/3566080308 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c003b70 con 0x5614f8102c80 2024-05-12T10:51:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 -- 172.21.15.115:0/3566080308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 msgr2=0x5614f8103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 --2- 172.21.15.115:0/3566080308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8103060 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f700c001e80 tx=0x7f700c011000 comp rx=0 tx=0).stop 2024-05-12T10:51:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 -- 172.21.15.115:0/3566080308 shutdown_connections 2024-05-12T10:51:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 --2- 172.21.15.115:0/3566080308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f8107a10 0x5614f8107df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 --2- 172.21.15.115:0/3566080308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8103060 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 --2- 172.21.15.115:0/3566080308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f80ccdf0 0x5614f8102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 -- 172.21.15.115:0/3566080308 >> 172.21.15.115:0/3566080308 conn(0x5614f7faef90 msgr2=0x5614f81057d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 -- 172.21.15.115:0/3566080308 shutdown_connections 2024-05-12T10:51:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 -- 172.21.15.115:0/3566080308 wait complete. 2024-05-12T10:51:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 -- start start 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 Processor -- start 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f80ccdf0 0x5614f8101d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f8102c80 0x5614f8102270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8107a10 0x5614f80c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5614f7f234f0 con 0x5614f8107a10 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5614f7eb6900 con 0x5614f8102c80 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5614f80cd1d0 con 0x5614f80ccdf0 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f702d8cb000 10 client.0 _ll_register_callbacks cb 0x5614f80b2180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7023e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8107a10 0x5614f80c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7023e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8107a10 0x5614f80c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46280/0 (socket says 172.21.15.115:46280) 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7023e00640 1 -- 172.21.15.115:0/21513870 learned_addr learned my addr 172.21.15.115:0/21513870 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7023400640 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f80ccdf0 0x5614f8101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f701aa00640 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f8102c80 0x5614f8102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7023e00640 1 -- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f80ccdf0 msgr2=0x5614f8101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7023e00640 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f80ccdf0 0x5614f8101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7023e00640 1 -- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f8102c80 msgr2=0x5614f8102270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7023e00640 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f8102c80 0x5614f8102270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.208+0000 7f7023e00640 1 -- 172.21.15.115:0/21513870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f7ec8e40 con 0x5614f8107a10 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f7023e00640 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8107a10 0x5614f80c80f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f701c007510 tx=0x7f701c0079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1978e460b9d002d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f7010c00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f7010c00640 1 -- 172.21.15.115:0/21513870 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c018030 con 0x5614f8107a10 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f7010c00640 1 -- 172.21.15.115:0/21513870 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f701c0109d0 con 0x5614f8107a10 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f702d8cb000 1 -- 172.21.15.115:0/21513870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f700c0037a0 con 0x5614f8107a10 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f7010c00640 1 -- 172.21.15.115:0/21513870 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f701c021050 con 0x5614f8107a10 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f702d8cb000 10 client.4899 fetch_fsmap learned FSMap version 14 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f702d8cb000 1 -- 172.21.15.115:0/21513870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5614f7fe0ab0 con 0x5614f8107a10 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f7010c00640 1 -- 172.21.15.115:0/21513870 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f700c0037a0 con 0x5614f8107a10 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f7010c00640 1 -- 172.21.15.115:0/21513870 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f701c024020 con 0x5614f8107a10 2024-05-12T10:51:27.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f702d8cb000 10 client.4899 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:51:27.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f702d8cb000 10 client.4899 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:51:27.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f702d8cb000 20 client.4899 populate_metadata read hostname 'smithi115' 2024-05-12T10:51:27.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f702d8cb000 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5614f80c8e60 0x5614f80c9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f702d8cb000 4 client.4899 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:51:27.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f702d8cb000 1 -- 172.21.15.115:0/21513870 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614f7eaf7f0 con 0x5614f80c8e60 2024-05-12T10:51:27.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f7023400640 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5614f80c8e60 0x5614f80c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f7023400640 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5614f80c8e60 0x5614f80c9240 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15b678e02699e8ac server_cookie=c62cc33c30db7f1c in_seq=0 out_seq=0 2024-05-12T10:51:27.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.212+0000 7f7010c00640 10 client.4899 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f7010c00640 1 -- 172.21.15.115:0/21513870 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5614f7eaf7f0 con 0x5614f80c8e60 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f7010c00640 10 client.4899 handle_command_reply: tid=0 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 1 client.4899 shutdown 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 1 -- 172.21.15.115:0/21513870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8107a10 msgr2=0x5614f80c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8107a10 0x5614f80c80f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f701c007510 tx=0x7f701c0079d0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 1 -- 172.21.15.115:0/21513870 shutdown_connections 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8107a10 0x5614f80c80f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5614f80c8e60 0x5614f80c9240 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f8102c80 0x5614f8102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 1 --2- 172.21.15.115:0/21513870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f80ccdf0 0x5614f8101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 1 -- 172.21.15.115:0/21513870 >> 172.21.15.115:0/21513870 conn(0x5614f7faef90 msgr2=0x5614f8105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f7010c00640 0 client.4899 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 1 -- 172.21.15.115:0/21513870 shutdown_connections 2024-05-12T10:51:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 1 -- 172.21.15.115:0/21513870 wait complete. 2024-05-12T10:51:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.216+0000 7f702d8cb000 20 client.4899 trim_cache size 0 max 16384 2024-05-12T10:51:27.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f702d8cb000 1 Processor -- start 2024-05-12T10:51:27.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f702d8cb000 1 -- start start 2024-05-12T10:51:27.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f7faef90 0x5614f80cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f80ccdf0 0x5614f80cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8177320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f702d8cb000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7024200250 con 0x5614f8102c80 2024-05-12T10:51:27.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f702d8cb000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70241fe9c0 con 0x5614f7faef90 2024-05-12T10:51:27.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f702d8cb000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f70241fdd00 con 0x5614f80ccdf0 2024-05-12T10:51:27.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f7023e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8177320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f7023e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8177320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46286/0 (socket says 172.21.15.115:46286) 2024-05-12T10:51:27.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f7023e00640 1 -- 172.21.15.115:0/2398650841 learned_addr learned my addr 172.21.15.115:0/2398650841 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:27.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f7023400640 1 --2- 172.21.15.115:0/2398650841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f7faef90 0x5614f80cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f701aa00640 1 --2- 172.21.15.115:0/2398650841 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f80ccdf0 0x5614f80cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f7023e00640 1 -- 172.21.15.115:0/2398650841 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f80ccdf0 msgr2=0x5614f80cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:27.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f7023e00640 1 --2- 172.21.15.115:0/2398650841 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f80ccdf0 0x5614f80cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f7023e00640 1 -- 172.21.15.115:0/2398650841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f7faef90 msgr2=0x5614f80cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:27.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f7023e00640 1 --2- 172.21.15.115:0/2398650841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f7faef90 0x5614f80cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f7023e00640 1 -- 172.21.15.115:0/2398650841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f7f96e30 con 0x5614f8102c80 2024-05-12T10:51:27.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.240+0000 7f7023e00640 1 --2- 172.21.15.115:0/2398650841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8177320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f701c009010 tx=0x7f701c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ca42548e6910e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:27.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f7013400640 1 -- 172.21.15.115:0/2398650841 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c018070 con 0x5614f8102c80 2024-05-12T10:51:27.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f7013400640 1 -- 172.21.15.115:0/2398650841 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701c0105b0 con 0x5614f8102c80 2024-05-12T10:51:27.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f7013400640 1 -- 172.21.15.115:0/2398650841 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c0070c0 con 0x5614f8102c80 2024-05-12T10:51:27.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 -- 172.21.15.115:0/2398650841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 msgr2=0x5614f8177320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 --2- 172.21.15.115:0/2398650841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8177320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f701c009010 tx=0x7f701c00c000 comp rx=0 tx=0).stop 2024-05-12T10:51:27.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 -- 172.21.15.115:0/2398650841 shutdown_connections 2024-05-12T10:51:27.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 --2- 172.21.15.115:0/2398650841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f8102c80 0x5614f8177320 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 --2- 172.21.15.115:0/2398650841 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f80ccdf0 0x5614f80cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 --2- 172.21.15.115:0/2398650841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f7faef90 0x5614f80cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 -- 172.21.15.115:0/2398650841 >> 172.21.15.115:0/2398650841 conn(0x5614f8102780 msgr2=0x5614f8123670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:27.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 -- 172.21.15.115:0/2398650841 shutdown_connections 2024-05-12T10:51:27.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 -- 172.21.15.115:0/2398650841 wait complete. 2024-05-12T10:51:27.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 -- start start 2024-05-12T10:51:27.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 Processor -- start 2024-05-12T10:51:27.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f7faef90 0x5614f8180590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f80ccdf0 0x5614f8180ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f8102c80 0x5614f8121090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5614f7eac3e0 con 0x5614f80ccdf0 2024-05-12T10:51:27.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70241fe350 con 0x5614f7faef90 2024-05-12T10:51:27.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5614f7f15400 con 0x5614f8102c80 2024-05-12T10:51:27.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f702d8cb000 10 client.0 _ll_register_callbacks cb 0x7f701c001a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:51:27.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f701aa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f80ccdf0 0x5614f8180ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f701aa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f80ccdf0 0x5614f8180ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46292/0 (socket says 172.21.15.115:46292) 2024-05-12T10:51:27.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f701aa00640 1 -- 172.21.15.115:0/2749587494 learned_addr learned my addr 172.21.15.115:0/2749587494 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:27.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f7023400640 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f7faef90 0x5614f8180590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f7023e00640 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f8102c80 0x5614f8121090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f701aa00640 1 -- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f8102c80 msgr2=0x5614f8121090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f701aa00640 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f8102c80 0x5614f8121090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f701aa00640 1 -- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f7faef90 msgr2=0x5614f8180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f701aa00640 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f7faef90 0x5614f8180590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.244+0000 7f701aa00640 1 -- 172.21.15.115:0/2749587494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f7ea7d80 con 0x5614f80ccdf0 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f701aa00640 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f80ccdf0 0x5614f8180ad0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f700c00e530 tx=0x7f700c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f9aa54f25564cc server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f7010c00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f7010c00640 1 -- 172.21.15.115:0/2749587494 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c033060 con 0x5614f80ccdf0 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f7010c00640 1 -- 172.21.15.115:0/2749587494 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f700c003c90 con 0x5614f80ccdf0 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f702d8cb000 1 -- 172.21.15.115:0/2749587494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f701c0105b0 con 0x5614f80ccdf0 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f7010c00640 1 -- 172.21.15.115:0/2749587494 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f700c039050 con 0x5614f80ccdf0 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f702d8cb000 10 client.4905 fetch_fsmap learned FSMap version 14 2024-05-12T10:51:27.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f702d8cb000 1 -- 172.21.15.115:0/2749587494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5614f7ebaf80 con 0x5614f80ccdf0 2024-05-12T10:51:27.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f7010c00640 1 -- 172.21.15.115:0/2749587494 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701c0105b0 con 0x5614f80ccdf0 2024-05-12T10:51:27.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f7010c00640 1 -- 172.21.15.115:0/2749587494 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f700c03c020 con 0x5614f80ccdf0 2024-05-12T10:51:27.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f702d8cb000 10 client.4905 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:51:27.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f702d8cb000 10 client.4905 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:51:27.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f702d8cb000 20 client.4905 populate_metadata read hostname 'smithi115' 2024-05-12T10:51:27.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f702d8cb000 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5614f8107a10 0x5614f8121c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:27.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f702d8cb000 4 client.4905 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.0, "await_for": 42.0}] 2024-05-12T10:51:27.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f702d8cb000 1 -- 172.21.15.115:0/2749587494 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.0, "await_for": 42.0}) -- 0x5614f7f23d00 con 0x5614f8107a10 2024-05-12T10:51:27.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f7023400640 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5614f8107a10 0x5614f8121c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:27.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f7023400640 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5614f8107a10 0x5614f8121c80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65cc33e2eb95d948 server_cookie=585620239b58d5f8 in_seq=0 out_seq=0 2024-05-12T10:51:27.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.248+0000 7f7010c00640 10 client.4905 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:27.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.252+0000 7f7010c00640 1 -- 172.21.15.115:0/2749587494 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x5614f7f23d00 con 0x5614f8107a10 2024-05-12T10:51:27.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.252+0000 7f7010c00640 10 client.4905 handle_command_reply: tid=0 2024-05-12T10:51:27.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.252+0000 7f702d8cb000 1 client.4905 shutdown 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.252+0000 7f702d8cb000 1 -- 172.21.15.115:0/2749587494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f80ccdf0 msgr2=0x5614f8180ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.252+0000 7f702d8cb000 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f80ccdf0 0x5614f8180ad0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f700c00e530 tx=0x7f700c000bd0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702d8cb000 1 -- 172.21.15.115:0/2749587494 shutdown_connections 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702d8cb000 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5614f8102c80 0x5614f8121090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702d8cb000 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5614f80ccdf0 0x5614f8180ad0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702d8cb000 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5614f8107a10 0x5614f8121c80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702d8cb000 1 --2- 172.21.15.115:0/2749587494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614f7faef90 0x5614f8180590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702d8cb000 1 -- 172.21.15.115:0/2749587494 >> 172.21.15.115:0/2749587494 conn(0x5614f8102780 msgr2=0x5614f80cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f7010c00640 0 client.4905 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702d8cb000 1 -- 172.21.15.115:0/2749587494 shutdown_connections 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702d8cb000 1 -- 172.21.15.115:0/2749587494 wait complete. 2024-05-12T10:51:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702d8cb000 20 client.4905 trim_cache size 0 max 16384 2024-05-12T10:51:27.253 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:51:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:51:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:51:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 6, 2024-05-12T10:51:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:51:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "db357bcd": { 2024-05-12T10:51:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 6, 2024-05-12T10:51:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:51:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:51:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:51:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:51:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:51:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:51:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 86.0, 2024-05-12T10:51:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:51:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:51:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:51:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:51:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:51:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:51:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:27.259 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:51:27.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 -- 172.21.15.115:0/110350622 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700006f430 msgr2=0x7f70000718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700006f430 0x7f70000718f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f70240704b0 tx=0x7f700c009040 comp rx=0 tx=0).stop 2024-05-12T10:51:27.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 -- 172.21.15.115:0/110350622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70240c9fd0 msgr2=0x7f70240c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:27.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70240c9fd0 0x7f70240c69d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7014009710 tx=0x7f701401ba30 comp rx=0 tx=0).stop 2024-05-12T10:51:27.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 -- 172.21.15.115:0/110350622 shutdown_connections 2024-05-12T10:51:27.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f700006f430 0x7f70000718f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7024159b40 0x7f70241f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7024150ba0 0x7f702414c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 --2- 172.21.15.115:0/110350622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70240c9fd0 0x7f70240c69d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:27.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 -- 172.21.15.115:0/110350622 >> 172.21.15.115:0/110350622 conn(0x7f702406c610 msgr2=0x7f7024159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:27.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 -- 172.21.15.115:0/110350622 shutdown_connections 2024-05-12T10:51:27.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:27.256+0000 7f702a400640 1 -- 172.21.15.115:0/110350622 wait complete. 2024-05-12T10:51:27.272 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'db357bcd', quiesce took 0.6 seconds. Will release after: 26.0 2024-05-12T10:51:49.510 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:51:49.516 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:51:53.273 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:51:53.500 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f3602e00640 1 Processor -- start 2024-05-12T10:51:53.500 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f3602e00640 1 -- start start 2024-05-12T10:51:53.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f3602e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc159250 0x7f35fc0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:53.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f3602e00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35fc0cfb40 con 0x7f35fc06e150 2024-05-12T10:51:53.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f3602e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35fc15c7d0 con 0x7f35fc0cccc0 2024-05-12T10:51:53.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f3602e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f35fc06c440 con 0x7f35fc159250 2024-05-12T10:51:53.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f3602400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f35fc06e150 0x7f35fc166550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46572/0 (socket says 172.21.15.115:46572) 2024-05-12T10:51:53.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f3602400640 1 -- 172.21.15.115:0/2631003456 learned_addr learned my addr 172.21.15.115:0/2631003456 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:51:53.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f3601a00640 1 --2- 172.21.15.115:0/2631003456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc159250 0x7f35fc0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:53.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f35fbe00640 1 -- 172.21.15.115:0/2631003456 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268299523 0 0) 0x7f35fc0cfb40 con 0x7f35fc06e150 2024-05-12T10:51:53.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f35fbe00640 1 -- 172.21.15.115:0/2631003456 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35e4003530 con 0x7f35fc06e150 2024-05-12T10:51:53.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f35fbe00640 1 -- 172.21.15.115:0/2631003456 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792619832 0 0) 0x7f35fc15c7d0 con 0x7f35fc0cccc0 2024-05-12T10:51:53.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.507+0000 7f35fbe00640 1 -- 172.21.15.115:0/2631003456 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35fc0cfb40 con 0x7f35fc0cccc0 2024-05-12T10:51:53.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.511+0000 7f3601a00640 1 -- 172.21.15.115:0/2631003456 >> v1:172.21.15.134:6789/0 conn(0x7f35fc0cccc0 legacy=0x7f35fc070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:53.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.511+0000 7f3601a00640 1 -- 172.21.15.115:0/2631003456 >> v1:172.21.15.115:6789/0 conn(0x7f35fc06e150 legacy=0x7f35fc166550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:53.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.511+0000 7f3601a00640 1 -- 172.21.15.115:0/2631003456 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35fc15cab0 con 0x7f35fc159250 2024-05-12T10:51:53.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.515+0000 7f3601a00640 1 --2- 172.21.15.115:0/2631003456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc159250 0x7f35fc0ca920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35f00097f0 tx=0x7f35f001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8cda44946b358b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:53.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.515+0000 7f35fbe00640 1 -- 172.21.15.115:0/2631003456 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f00b0070 con 0x7f35fc159250 2024-05-12T10:51:53.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.515+0000 7f35fbe00640 1 -- 172.21.15.115:0/2631003456 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f00ab600 con 0x7f35fc159250 2024-05-12T10:51:53.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.515+0000 7f35fbe00640 1 -- 172.21.15.115:0/2631003456 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f00ab9d0 con 0x7f35fc159250 2024-05-12T10:51:53.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.515+0000 7f3602e00640 1 -- 172.21.15.115:0/2631003456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc159250 msgr2=0x7f35fc0ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:53.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.515+0000 7f3602e00640 1 --2- 172.21.15.115:0/2631003456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc159250 0x7f35fc0ca920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35f00097f0 tx=0x7f35f001c520 comp rx=0 tx=0).stop 2024-05-12T10:51:53.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.515+0000 7f3602e00640 1 -- 172.21.15.115:0/2631003456 shutdown_connections 2024-05-12T10:51:53.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.515+0000 7f3602e00640 1 --2- 172.21.15.115:0/2631003456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc159250 0x7f35fc0ca920 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:53.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.515+0000 7f3602e00640 1 -- 172.21.15.115:0/2631003456 >> 172.21.15.115:0/2631003456 conn(0x7f35fc071780 msgr2=0x7f35fc076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:53.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.515+0000 7f3602e00640 1 -- 172.21.15.115:0/2631003456 shutdown_connections 2024-05-12T10:51:53.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.515+0000 7f3602e00640 1 -- 172.21.15.115:0/2631003456 wait complete. 2024-05-12T10:51:53.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3602e00640 1 Processor -- start 2024-05-12T10:51:53.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3602e00640 1 -- start start 2024-05-12T10:51:53.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3602e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc06e150 0x7f35fc1f8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:53.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3602e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0cccc0 0x7f35fc144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:53.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3602e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc159250 0x7f35fc0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:53.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3602e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc070b20 con 0x7f35fc159250 2024-05-12T10:51:53.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3602e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc072230 con 0x7f35fc0cccc0 2024-05-12T10:51:53.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3602e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f35fc070ca0 con 0x7f35fc06e150 2024-05-12T10:51:53.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3602400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc159250 0x7f35fc0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:53.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3601000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0cccc0 0x7f35fc144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:53.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3602400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc159250 0x7f35fc0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33332/0 (socket says 172.21.15.115:33332) 2024-05-12T10:51:53.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3601a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc06e150 0x7f35fc1f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:53.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.519+0000 7f3602400640 1 -- 172.21.15.115:0/3769837504 learned_addr learned my addr 172.21.15.115:0/3769837504 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:53.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f3601a00640 1 -- 172.21.15.115:0/3769837504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0cccc0 msgr2=0x7f35fc144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:53.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f3601a00640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0cccc0 0x7f35fc144070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:53.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f3601a00640 1 -- 172.21.15.115:0/3769837504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc159250 msgr2=0x7f35fc0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:53.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f3601a00640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc159250 0x7f35fc0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:53.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f3601a00640 1 -- 172.21.15.115:0/3769837504 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35fc1f5820 con 0x7f35fc06e150 2024-05-12T10:51:53.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f3601a00640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc06e150 0x7f35fc1f8850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f35f00ab000 tx=0x7f35f00192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:53.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f35f9600640 1 -- 172.21.15.115:0/3769837504 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f00bb070 con 0x7f35fc06e150 2024-05-12T10:51:53.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f35f9600640 1 -- 172.21.15.115:0/3769837504 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f0004030 con 0x7f35fc06e150 2024-05-12T10:51:53.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f3602e00640 1 -- 172.21.15.115:0/3769837504 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35fc1f4ca0 con 0x7f35fc06e150 2024-05-12T10:51:53.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f35f9600640 1 -- 172.21.15.115:0/3769837504 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f00b0040 con 0x7f35fc06e150 2024-05-12T10:51:53.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f3602e00640 1 -- 172.21.15.115:0/3769837504 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35fc1f5260 con 0x7f35fc06e150 2024-05-12T10:51:53.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.523+0000 7f3602e00640 1 -- 172.21.15.115:0/3769837504 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35fc050750 con 0x7f35fc06e150 2024-05-12T10:51:53.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.527+0000 7f35f9600640 1 -- 172.21.15.115:0/3769837504 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f35f0004220 con 0x7f35fc06e150 2024-05-12T10:51:53.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.527+0000 7f35f9600640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f35dc06f430 0x7f35dc0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:53.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.527+0000 7f35f9600640 1 -- 172.21.15.115:0/3769837504 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f35f01284d0 con 0x7f35fc06e150 2024-05-12T10:51:53.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.527+0000 7f3601000640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f35dc06f430 0x7f35dc0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:53.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.531+0000 7f3601000640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f35dc06f430 0x7f35dc0718f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0cca70 tx=0x7f35e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:53.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.539+0000 7f35f9600640 1 -- 172.21.15.115:0/3769837504 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f35f0016110 con 0x7f35fc06e150 2024-05-12T10:51:53.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.939+0000 7f3602e00640 1 -- 172.21.15.115:0/3769837504 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35fc0ccaa0 con 0x7f35fc06e150 2024-05-12T10:51:53.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.939+0000 7f35f9600640 1 -- 172.21.15.115:0/3769837504 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f35f00f49e0 con 0x7f35fc06e150 2024-05-12T10:51:53.933 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:51:53.933 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:51:53.933 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:51:53.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 -- 172.21.15.115:0/3769837504 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f35dc06f430 msgr2=0x7f35dc0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:53.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f35dc06f430 0x7f35dc0718f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0cca70 tx=0x7f35e8009040 comp rx=0 tx=0).stop 2024-05-12T10:51:53.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 -- 172.21.15.115:0/3769837504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc06e150 msgr2=0x7f35fc1f8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:53.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc06e150 0x7f35fc1f8850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f35f00ab000 tx=0x7f35f00192c0 comp rx=0 tx=0).stop 2024-05-12T10:51:53.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 -- 172.21.15.115:0/3769837504 shutdown_connections 2024-05-12T10:51:53.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f35dc06f430 0x7f35dc0718f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:53.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35fc159250 0x7f35fc0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:53.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0cccc0 0x7f35fc144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:53.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 --2- 172.21.15.115:0/3769837504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35fc06e150 0x7f35fc1f8850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:53.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 -- 172.21.15.115:0/3769837504 >> 172.21.15.115:0/3769837504 conn(0x7f35fc071780 msgr2=0x7f35fc0ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:53.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 -- 172.21.15.115:0/3769837504 shutdown_connections 2024-05-12T10:51:53.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:53.943+0000 7f3602e00640 1 -- 172.21.15.115:0/3769837504 wait complete. 2024-05-12T10:51:53.964 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db --set-id db357bcd --release --await' 2024-05-12T10:51:53.964 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db --set-id db357bcd --release --await 2024-05-12T10:51:54.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.211+0000 7f3a92000640 1 Processor -- start 2024-05-12T10:51:54.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.211+0000 7f3a92000640 1 -- start start 2024-05-12T10:51:54.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a92000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3a8c0c8360 0x7f3a8c0c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a92000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3a8c0c79b0 0x7f3a8c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a92000640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8c15a3b0 con 0x7f3a8c153a10 2024-05-12T10:51:54.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a92000640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f3a8c0c9750 con 0x7f3a8c0c79b0 2024-05-12T10:51:54.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a92000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3a8c15a670 con 0x7f3a8c0c8360 2024-05-12T10:51:54.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a8be00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3a8c0c8360 0x7f3a8c0c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a90c00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3a8c153a10 0x7f3a8c0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46580/0 (socket says 172.21.15.115:46580) 2024-05-12T10:51:54.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a91600640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3a8c0c79b0 0x7f3a8c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a90c00640 1 -- 172.21.15.115:0/1623652759 learned_addr learned my addr 172.21.15.115:0/1623652759 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:51:54.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a8be00640 1 -- 172.21.15.115:0/1623652759 >> v2:172.21.15.115:3300/0 conn(0x7f3a8c0c79b0 msgr2=0x7f3a8c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:54.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a8be00640 1 --2- 172.21.15.115:0/1623652759 >> v2:172.21.15.115:3300/0 conn(0x7f3a8c0c79b0 0x7f3a8c0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a8be00640 1 -- 172.21.15.115:0/1623652759 >> v1:172.21.15.115:6789/0 conn(0x7f3a8c153a10 legacy=0x7f3a8c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:54.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.215+0000 7f3a8be00640 1 -- 172.21.15.115:0/1623652759 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8c15cda0 con 0x7f3a8c0c8360 2024-05-12T10:51:54.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.219+0000 7f3a8be00640 1 --2- 172.21.15.115:0/1623652759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a8c0c8360 0x7f3a8c0c5670 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c06fbb0 tx=0x7f3a7801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8da65b9692f6d9d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:54.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a8b400640 1 -- 172.21.15.115:0/1623652759 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780b5070 con 0x7f3a8c0c8360 2024-05-12T10:51:54.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a8b400640 1 -- 172.21.15.115:0/1623652759 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a780a8970 con 0x7f3a8c0c8360 2024-05-12T10:51:54.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a8b400640 1 -- 172.21.15.115:0/1623652759 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780a8d40 con 0x7f3a8c0c8360 2024-05-12T10:51:54.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a92000640 1 -- 172.21.15.115:0/1623652759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a8c0c8360 msgr2=0x7f3a8c0c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:54.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a92000640 1 --2- 172.21.15.115:0/1623652759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a8c0c8360 0x7f3a8c0c5670 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c06fbb0 tx=0x7f3a7801ec70 comp rx=0 tx=0).stop 2024-05-12T10:51:54.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a92000640 1 -- 172.21.15.115:0/1623652759 shutdown_connections 2024-05-12T10:51:54.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a92000640 1 --2- 172.21.15.115:0/1623652759 >> v2:172.21.15.115:3300/0 conn(0x7f3a8c0c79b0 0x7f3a8c0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a92000640 1 --2- 172.21.15.115:0/1623652759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a8c0c8360 0x7f3a8c0c5670 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a92000640 1 -- 172.21.15.115:0/1623652759 >> 172.21.15.115:0/1623652759 conn(0x7f3a8c070610 msgr2=0x7f3a8c070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:54.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a92000640 1 -- 172.21.15.115:0/1623652759 shutdown_connections 2024-05-12T10:51:54.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a92000640 1 -- 172.21.15.115:0/1623652759 wait complete. 2024-05-12T10:51:54.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.223+0000 7f3a92000640 1 Processor -- start 2024-05-12T10:51:54.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a92000640 1 -- start start 2024-05-12T10:51:54.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a92000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a8c0c79b0 0x7f3a8c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a92000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a8c0c8360 0x7f3a8c158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a92000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a8c153a10 0x7f3a8c14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a92000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c15d640 con 0x7f3a8c0c79b0 2024-05-12T10:51:54.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a92000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c15d360 con 0x7f3a8c153a10 2024-05-12T10:51:54.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a92000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8c153df0 con 0x7f3a8c0c8360 2024-05-12T10:51:54.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a90c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a8c0c79b0 0x7f3a8c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a90c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a8c0c79b0 0x7f3a8c157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33350/0 (socket says 172.21.15.115:33350) 2024-05-12T10:51:54.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a90c00640 1 -- 172.21.15.115:0/3157520920 learned_addr learned my addr 172.21.15.115:0/3157520920 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:54.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a8be00640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a8c0c8360 0x7f3a8c158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a91600640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a8c153a10 0x7f3a8c14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a90c00640 1 -- 172.21.15.115:0/3157520920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a8c0c8360 msgr2=0x7f3a8c158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a90c00640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a8c0c8360 0x7f3a8c158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a90c00640 1 -- 172.21.15.115:0/3157520920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a8c153a10 msgr2=0x7f3a8c14d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a90c00640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a8c153a10 0x7f3a8c14d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a90c00640 1 -- 172.21.15.115:0/3157520920 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8c157490 con 0x7f3a8c0c79b0 2024-05-12T10:51:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a90c00640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a8c0c79b0 0x7f3a8c157f30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3a80001ea0 tx=0x7f3a8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a88c00640 1 -- 172.21.15.115:0/3157520920 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80005cf0 con 0x7f3a8c0c79b0 2024-05-12T10:51:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a88c00640 1 -- 172.21.15.115:0/3157520920 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a80015030 con 0x7f3a8c0c79b0 2024-05-12T10:51:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.227+0000 7f3a88c00640 1 -- 172.21.15.115:0/3157520920 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a800072f0 con 0x7f3a8c0c79b0 2024-05-12T10:51:54.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.231+0000 7f3a92000640 1 -- 172.21.15.115:0/3157520920 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8c1594a0 con 0x7f3a8c0c79b0 2024-05-12T10:51:54.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.231+0000 7f3a92000640 1 -- 172.21.15.115:0/3157520920 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8c157730 con 0x7f3a8c0c79b0 2024-05-12T10:51:54.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a88c00640 1 -- 172.21.15.115:0/3157520920 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3a80007490 con 0x7f3a8c0c79b0 2024-05-12T10:51:54.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a96b60000 1 Processor -- start 2024-05-12T10:51:54.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a96b60000 1 -- start start 2024-05-12T10:51:54.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a88c00640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a6c06f450 0x7f3a6c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a88c00640 1 -- 172.21.15.115:0/3157520920 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f3a80093090 con 0x7f3a8c0c79b0 2024-05-12T10:51:54.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a91600640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a6c06f450 0x7f3a6c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 0x5615c2f239e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f25270 0x5615c2f25650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2f25f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a96b60000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5615c2de4a60 con 0x5615c2f23600 2024-05-12T10:51:54.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a96b60000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5615c2d4d250 con 0x5615c2f25b90 2024-05-12T10:51:54.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a96b60000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5615c2cf14d0 con 0x5615c2f25270 2024-05-12T10:51:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a8be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f25270 0x5615c2f25650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a91600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2f25f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.235+0000 7f3a91600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2f25f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:46906/0 (socket says 172.21.15.115:46906) 2024-05-12T10:51:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a91600640 1 -- 172.21.15.115:0/2426546086 learned_addr learned my addr 172.21.15.115:0/2426546086 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a90c00640 1 --2- 172.21.15.115:0/2426546086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 0x5615c2f239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a91600640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a6c06f450 0x7f3a6c071910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009fd0 tx=0x7f3a84009750 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a8be00640 1 -- 172.21.15.115:0/2426546086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 msgr2=0x5615c2f25f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a8be00640 1 --2- 172.21.15.115:0/2426546086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2f25f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a8be00640 1 -- 172.21.15.115:0/2426546086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 msgr2=0x5615c2f239e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a8be00640 1 --2- 172.21.15.115:0/2426546086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 0x5615c2f239e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a8be00640 1 -- 172.21.15.115:0/2426546086 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615c2d24970 con 0x5615c2f25270 2024-05-12T10:51:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a90c00640 1 --2- 172.21.15.115:0/2426546086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 0x5615c2f239e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:51:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a91600640 1 --2- 172.21.15.115:0/2426546086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2f25f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:51:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a8be00640 1 --2- 172.21.15.115:0/2426546086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f25270 0x5615c2f25650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a780af000 tx=0x7f3a780aa070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecc222f24803b4f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:54.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a7d600640 1 -- 172.21.15.115:0/2426546086 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780b5040 con 0x5615c2f25270 2024-05-12T10:51:54.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a7d600640 1 -- 172.21.15.115:0/2426546086 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a780a8a10 con 0x5615c2f25270 2024-05-12T10:51:54.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a7d600640 1 -- 172.21.15.115:0/2426546086 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780a8e00 con 0x5615c2f25270 2024-05-12T10:51:54.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a96b60000 1 -- 172.21.15.115:0/2426546086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f25270 msgr2=0x5615c2f25650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:54.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2426546086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f25270 0x5615c2f25650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a780af000 tx=0x7f3a780aa070 comp rx=0 tx=0).stop 2024-05-12T10:51:54.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a96b60000 1 -- 172.21.15.115:0/2426546086 shutdown_connections 2024-05-12T10:51:54.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2426546086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2f25f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2426546086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f25270 0x5615c2f25650 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2426546086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 0x5615c2f239e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a96b60000 1 -- 172.21.15.115:0/2426546086 >> 172.21.15.115:0/2426546086 conn(0x5615c2f3a430 msgr2=0x5615c2f3c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:54.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a96b60000 1 -- 172.21.15.115:0/2426546086 shutdown_connections 2024-05-12T10:51:54.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a96b60000 1 -- 172.21.15.115:0/2426546086 wait complete. 2024-05-12T10:51:54.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.239+0000 7f3a96b60000 1 -- start start 2024-05-12T10:51:54.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a96b60000 1 Processor -- start 2024-05-12T10:51:54.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f23600 0x5615c2f027f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 0x5615c2f448f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2f44e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a96b60000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5615c2d49210 con 0x5615c2f25270 2024-05-12T10:51:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a96b60000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5615c2d5a650 con 0x5615c2f25b90 2024-05-12T10:51:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a96b60000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5615c2d8b5b0 con 0x5615c2f23600 2024-05-12T10:51:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a96b60000 10 client.0 _ll_register_callbacks cb 0x5615c2ee7f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:51:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a8be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 0x5615c2f448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a8be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 0x5615c2f448f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33366/0 (socket says 172.21.15.115:33366) 2024-05-12T10:51:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a8be00640 1 -- 172.21.15.115:0/1812239017 learned_addr learned my addr 172.21.15.115:0/1812239017 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a90c00640 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f23600 0x5615c2f027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a91600640 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2f44e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a8be00640 1 -- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f23600 msgr2=0x5615c2f027f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:54.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a8be00640 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f23600 0x5615c2f027f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a8be00640 1 -- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 msgr2=0x5615c2f44e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:54.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a8be00640 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2f44e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a8be00640 1 -- 172.21.15.115:0/1812239017 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615c2d910e0 con 0x5615c2f25270 2024-05-12T10:51:54.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a90c00640 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f23600 0x5615c2f027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:51:54.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a8be00640 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 0x5615c2f448f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3a78008010 tx=0x7f3a7801d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11639c1effe6f73 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:54.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a72000640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:51:54.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a72000640 1 -- 172.21.15.115:0/1812239017 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780ca060 con 0x5615c2f25270 2024-05-12T10:51:54.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a72000640 1 -- 172.21.15.115:0/1812239017 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f3a78004040 con 0x5615c2f25270 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.243+0000 7f3a96b60000 1 -- 172.21.15.115:0/1812239017 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a780a8a10 con 0x5615c2f25270 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a72000640 1 -- 172.21.15.115:0/1812239017 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f3a780b5040 con 0x5615c2f25270 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a96b60000 10 client.4926 fetch_fsmap learned FSMap version 14 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a96b60000 1 -- 172.21.15.115:0/1812239017 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5615c2cff9e0 con 0x5615c2f25270 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a72000640 1 -- 172.21.15.115:0/1812239017 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a780a8a10 con 0x5615c2f25270 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a72000640 1 -- 172.21.15.115:0/1812239017 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f3a78004240 con 0x5615c2f25270 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a96b60000 10 client.4926 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a96b60000 10 client.4926 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a96b60000 20 client.4926 populate_metadata read hostname 'smithi115' 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a96b60000 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5615c2f22ac0 0x5615c2f22ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a96b60000 4 client.4926 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a96b60000 1 -- 172.21.15.115:0/1812239017 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615c2ce6060 con 0x5615c2f22ac0 2024-05-12T10:51:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a90c00640 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5615c2f22ac0 0x5615c2f22ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a90c00640 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5615c2f22ac0 0x5615c2f22ed0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b93823dfc498c9ee server_cookie=3d7f771b00cc012f in_seq=0 out_seq=0 2024-05-12T10:51:54.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a72000640 10 client.4926 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:54.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a72000640 1 -- 172.21.15.115:0/1812239017 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5615c2ce6060 con 0x5615c2f22ac0 2024-05-12T10:51:54.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a72000640 10 client.4926 handle_command_reply: tid=0 2024-05-12T10:51:54.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.247+0000 7f3a96b60000 1 client.4926 shutdown 2024-05-12T10:51:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a96b60000 1 -- 172.21.15.115:0/1812239017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 msgr2=0x5615c2f448f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a96b60000 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 0x5615c2f448f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3a78008010 tx=0x7f3a7801d4b0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a96b60000 1 -- 172.21.15.115:0/1812239017 shutdown_connections 2024-05-12T10:51:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a96b60000 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5615c2f22ac0 0x5615c2f22ed0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a96b60000 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2f44e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a96b60000 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 0x5615c2f448f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a96b60000 1 --2- 172.21.15.115:0/1812239017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f23600 0x5615c2f027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a96b60000 1 -- 172.21.15.115:0/1812239017 >> 172.21.15.115:0/1812239017 conn(0x5615c2f3a430 msgr2=0x5615c2f3c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:54.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a72000640 0 client.4926 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:54.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a96b60000 1 -- 172.21.15.115:0/1812239017 shutdown_connections 2024-05-12T10:51:54.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a96b60000 1 -- 172.21.15.115:0/1812239017 wait complete. 2024-05-12T10:51:54.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.251+0000 7f3a96b60000 20 client.4926 trim_cache size 0 max 16384 2024-05-12T10:51:54.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.283+0000 7f3a96b60000 1 Processor -- start 2024-05-12T10:51:54.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.283+0000 7f3a96b60000 1 -- start start 2024-05-12T10:51:54.279 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f23600 0x5615c2f38000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.279 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 0x5615c2f38540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.279 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2efc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.279 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c1fa1a0 con 0x5615c2f25270 2024-05-12T10:51:54.279 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c1f38d0 con 0x5615c2f25b90 2024-05-12T10:51:54.279 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8c0747e0 con 0x5615c2f23600 2024-05-12T10:51:54.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a91600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2efc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a8be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 0x5615c2f38540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a91600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2efc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:46932/0 (socket says 172.21.15.115:46932) 2024-05-12T10:51:54.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a90c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f23600 0x5615c2f38000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a91600640 1 -- 172.21.15.115:0/2245104057 learned_addr learned my addr 172.21.15.115:0/2245104057 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:54.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a91600640 1 -- 172.21.15.115:0/2245104057 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f23600 msgr2=0x5615c2f38000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:54.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a91600640 1 --2- 172.21.15.115:0/2245104057 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f23600 0x5615c2f38000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a91600640 1 -- 172.21.15.115:0/2245104057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 msgr2=0x5615c2f38540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:54.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a91600640 1 --2- 172.21.15.115:0/2245104057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 0x5615c2f38540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a91600640 1 -- 172.21.15.115:0/2245104057 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615c2cf16e0 con 0x5615c2f25b90 2024-05-12T10:51:54.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a91600640 1 --2- 172.21.15.115:0/2245104057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2efc290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a84019a10 tx=0x7f3a8401c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=324ce49e6337e836 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:54.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a7cc00640 1 -- 172.21.15.115:0/2245104057 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8401d070 con 0x5615c2f25b90 2024-05-12T10:51:54.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a7cc00640 1 -- 172.21.15.115:0/2245104057 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a84017bc0 con 0x5615c2f25b90 2024-05-12T10:51:54.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a7cc00640 1 -- 172.21.15.115:0/2245104057 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8402c430 con 0x5615c2f25b90 2024-05-12T10:51:54.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 -- 172.21.15.115:0/2245104057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 msgr2=0x5615c2efc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:54.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2245104057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2efc290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a84019a10 tx=0x7f3a8401c000 comp rx=0 tx=0).stop 2024-05-12T10:51:54.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 -- 172.21.15.115:0/2245104057 shutdown_connections 2024-05-12T10:51:54.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2245104057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2efc290 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2245104057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f25270 0x5615c2f38540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2245104057 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f23600 0x5615c2f38000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 -- 172.21.15.115:0/2245104057 >> 172.21.15.115:0/2245104057 conn(0x5615c2f3a430 msgr2=0x5615c2f502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:54.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 -- 172.21.15.115:0/2245104057 shutdown_connections 2024-05-12T10:51:54.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.287+0000 7f3a96b60000 1 -- 172.21.15.115:0/2245104057 wait complete. 2024-05-12T10:51:54.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a96b60000 1 -- start start 2024-05-12T10:51:54.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a96b60000 1 Processor -- start 2024-05-12T10:51:54.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 0x5615c2fb1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f25270 0x5615c2fad100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a96b60000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2fad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a96b60000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5615c2ce2c50 con 0x5615c2f23600 2024-05-12T10:51:54.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a96b60000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5615c2d45d70 con 0x5615c2f25b90 2024-05-12T10:51:54.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a96b60000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5615c2d4c560 con 0x5615c2f25270 2024-05-12T10:51:54.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a96b60000 10 client.0 _ll_register_callbacks cb 0x7f3a780b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:51:54.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a90c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 0x5615c2fb1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a90c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 0x5615c2fb1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33392/0 (socket says 172.21.15.115:33392) 2024-05-12T10:51:54.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a90c00640 1 -- 172.21.15.115:0/2279820168 learned_addr learned my addr 172.21.15.115:0/2279820168 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:51:54.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a8be00640 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f25270 0x5615c2fad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a91600640 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2fad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a90c00640 1 -- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f25270 msgr2=0x5615c2fad100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a90c00640 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f25270 0x5615c2fad100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a90c00640 1 -- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 msgr2=0x5615c2fad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a90c00640 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2fad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a90c00640 1 -- 172.21.15.115:0/2279820168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615c2da42a0 con 0x5615c2f23600 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a90c00640 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 0x5615c2fb1a10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a8005c810 tx=0x7f3a80000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef85ddbabd2c4f3c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.291+0000 7f3a72000640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a72000640 1 -- 172.21.15.115:0/2279820168 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8001f070 con 0x5615c2f23600 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a72000640 1 -- 172.21.15.115:0/2279820168 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f3a80068030 con 0x5615c2f23600 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a96b60000 1 -- 172.21.15.115:0/2279820168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a84017bc0 con 0x5615c2f23600 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a72000640 1 -- 172.21.15.115:0/2279820168 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f3a800113a0 con 0x5615c2f23600 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a96b60000 10 client.4932 fetch_fsmap learned FSMap version 14 2024-05-12T10:51:54.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a96b60000 1 -- 172.21.15.115:0/2279820168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5615c2ce19c0 con 0x5615c2f23600 2024-05-12T10:51:54.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a72000640 1 -- 172.21.15.115:0/2279820168 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a84017bc0 con 0x5615c2f23600 2024-05-12T10:51:54.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a72000640 1 -- 172.21.15.115:0/2279820168 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f3a80066b90 con 0x5615c2f23600 2024-05-12T10:51:54.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a96b60000 10 client.4932 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:51:54.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a96b60000 10 client.4932 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:51:54.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a96b60000 20 client.4932 populate_metadata read hostname 'smithi115' 2024-05-12T10:51:54.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5615c2fa9d70 0x5615c2faa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:51:54.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a96b60000 4 client.4932 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "db357bcd", "release": true, "await": true}] 2024-05-12T10:51:54.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a96b60000 1 -- 172.21.15.115:0/2279820168 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "set_id": "db357bcd", "release": true, "await": true}) -- 0x5615c2d5ae60 con 0x5615c2fa9d70 2024-05-12T10:51:54.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a8be00640 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5615c2fa9d70 0x5615c2faa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:51:54.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a8be00640 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5615c2fa9d70 0x5615c2faa180 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbecb468f2c0af4e server_cookie=988e9f5494c4b3f4 in_seq=0 out_seq=0 2024-05-12T10:51:54.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.295+0000 7f3a72000640 10 client.4932 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:54.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a72000640 1 -- 172.21.15.115:0/2279820168 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x5615c2d5ae60 con 0x5615c2fa9d70 2024-05-12T10:51:54.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a72000640 10 client.4932 handle_command_reply: tid=0 2024-05-12T10:51:54.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 1 client.4932 shutdown 2024-05-12T10:51:54.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 1 -- 172.21.15.115:0/2279820168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 msgr2=0x5615c2fb1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:54.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 0x5615c2fb1a10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a8005c810 tx=0x7f3a80000ee0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 1 -- 172.21.15.115:0/2279820168 shutdown_connections 2024-05-12T10:51:54.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5615c2fa9d70 0x5615c2faa180 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5615c2f25b90 0x5615c2fad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5615c2f25270 0x5615c2fad100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 1 --2- 172.21.15.115:0/2279820168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615c2f23600 0x5615c2fb1a10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 1 -- 172.21.15.115:0/2279820168 >> 172.21.15.115:0/2279820168 conn(0x5615c2f3a430 msgr2=0x5615c2f38ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:54.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a72000640 0 client.4932 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:51:54.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 1 -- 172.21.15.115:0/2279820168 shutdown_connections 2024-05-12T10:51:54.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 1 -- 172.21.15.115:0/2279820168 wait complete. 2024-05-12T10:51:54.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a96b60000 20 client.4932 trim_cache size 0 max 16384 2024-05-12T10:51:54.294 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:51:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:51:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:51:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 8, 2024-05-12T10:51:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "db357bcd": { 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 8, 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 86.0, 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:51:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:51:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:51:54.296 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:51:54.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 -- 172.21.15.115:0/3157520920 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a6c06f450 msgr2=0x7f3a6c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:54.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a6c06f450 0x7f3a6c071910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009fd0 tx=0x7f3a84009750 comp rx=0 tx=0).stop 2024-05-12T10:51:54.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 -- 172.21.15.115:0/3157520920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a8c0c79b0 msgr2=0x7f3a8c157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:51:54.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a8c0c79b0 0x7f3a8c157f30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3a80001ea0 tx=0x7f3a8000c8c0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 -- 172.21.15.115:0/3157520920 shutdown_connections 2024-05-12T10:51:54.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3a6c06f450 0x7f3a6c071910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a8c153a10 0x7f3a8c14d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a8c0c8360 0x7f3a8c158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 --2- 172.21.15.115:0/3157520920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a8c0c79b0 0x7f3a8c157f30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:51:54.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 -- 172.21.15.115:0/3157520920 >> 172.21.15.115:0/3157520920 conn(0x7f3a8c070610 msgr2=0x7f3a8c0cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:51:54.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 -- 172.21.15.115:0/3157520920 shutdown_connections 2024-05-12T10:51:54.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:51:54.299+0000 7f3a92000640 1 -- 172.21.15.115:0/3157520920 wait complete. 2024-05-12T10:51:54.323 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'db357bcd', seconds elapsed: 27.7 2024-05-12T10:52:10.067 INFO:tasks.workunit.client.0.smithi115.stderr:Updating files: 66% (8177/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-12T10:52:10.615 INFO:tasks.workunit.client.0.smithi115.stderr:Note: switching to 'f1ec882358465db8f363a3865fa83f099183688a'. 2024-05-12T10:52:10.615 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-05-12T10:52:10.615 INFO:tasks.workunit.client.0.smithi115.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-12T10:52:10.615 INFO:tasks.workunit.client.0.smithi115.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-12T10:52:10.615 INFO:tasks.workunit.client.0.smithi115.stderr:state without impacting any branches by switching back to a branch. 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr: git switch -c 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr:Or undo this operation with: 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr: git switch - 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-05-12T10:52:10.616 INFO:tasks.workunit.client.0.smithi115.stderr:HEAD is now at f1ec8823584 mds: don't clear `AUTHPIN_FROZEN` until `FROZEN` in rename_prep 2024-05-12T10:52:10.629 DEBUG:teuthology.orchestra.run.smithi115:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-12T10:52:10.638 INFO:tasks.workunit.client.0.smithi115.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-12T10:52:10.641 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-12T10:52:10.641 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-12T10:52:11.448 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-12T10:52:11.536 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-12T10:52:11.591 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-12T10:52:11.593 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-12T10:52:11.593 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-12T10:52:11.651 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-12T10:52:11.657 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:52:11.657 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-12T10:52:11.707 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-05-12T10:52:11.708 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-05-12T10:52:11.709 DEBUG:teuthology.orchestra.run.smithi115:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f1ec882358465db8f363a3865fa83f099183688a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-05-12T10:52:11.770 INFO:tasks.workunit.client.0.smithi115.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-12T10:52:11.860 INFO:tasks.workunit.client.0.smithi115.stdout: Iozone: Performance Test of File I/O 2024-05-12T10:52:11.860 INFO:tasks.workunit.client.0.smithi115.stdout: Version $Revision: 3.489 $ 2024-05-12T10:52:11.860 INFO:tasks.workunit.client.0.smithi115.stdout: Compiled for 64 bit mode. 2024-05-12T10:52:11.860 INFO:tasks.workunit.client.0.smithi115.stdout: Build: linux-AMD64 2024-05-12T10:52:11.860 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:52:11.860 INFO:tasks.workunit.client.0.smithi115.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-12T10:52:11.860 INFO:tasks.workunit.client.0.smithi115.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-12T10:52:11.860 INFO:tasks.workunit.client.0.smithi115.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Run began: Sun May 12 10:52:11 2024 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Include close in write timing 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Include fsync in write timing 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: File size set to 1048576 kB 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Record Size 16 kB 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-12T10:52:11.861 INFO:tasks.workunit.client.0.smithi115.stdout: Output is in kBytes/sec 2024-05-12T10:52:11.862 INFO:tasks.workunit.client.0.smithi115.stdout: Time Resolution = 0.000001 seconds. 2024-05-12T10:52:11.862 INFO:tasks.workunit.client.0.smithi115.stdout: Processor cache size set to 1024 kBytes. 2024-05-12T10:52:11.862 INFO:tasks.workunit.client.0.smithi115.stdout: Processor cache line size set to 32 bytes. 2024-05-12T10:52:11.862 INFO:tasks.workunit.client.0.smithi115.stdout: File stride size set to 17 * record size. 2024-05-12T10:52:11.862 INFO:tasks.workunit.client.0.smithi115.stdout: Throughput test with 1 process 2024-05-12T10:52:11.862 INFO:tasks.workunit.client.0.smithi115.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-05-12T10:52:17.971 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:52:17.971 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 initial writers = 171704.39 kB/sec 2024-05-12T10:52:17.971 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 initial writers = 171692.35 kB/sec 2024-05-12T10:52:17.971 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 171704.39 kB/sec 2024-05-12T10:52:17.972 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 171704.39 kB/sec 2024-05-12T10:52:17.972 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 171704.39 kB/sec 2024-05-12T10:52:17.972 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 1048576.00 kB 2024-05-12T10:52:19.582 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:52:19.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:52:26.819 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:52:26.819 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 rewriters = 226752.70 kB/sec 2024-05-12T10:52:26.819 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 rewriters = 226730.71 kB/sec 2024-05-12T10:52:26.819 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 226752.70 kB/sec 2024-05-12T10:52:26.819 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 226752.70 kB/sec 2024-05-12T10:52:26.819 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 226752.70 kB/sec 2024-05-12T10:52:26.819 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 1048576.00 kB 2024-05-12T10:52:30.330 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:52:30.331 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 readers = 2922714.00 kB/sec 2024-05-12T10:52:30.331 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 readers = 2918987.40 kB/sec 2024-05-12T10:52:30.331 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 2922714.00 kB/sec 2024-05-12T10:52:30.331 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 2922714.00 kB/sec 2024-05-12T10:52:30.331 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 2922714.00 kB/sec 2024-05-12T10:52:30.331 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 1048576.00 kB 2024-05-12T10:52:32.971 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:52:32.972 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 re-readers = 2131295.25 kB/sec 2024-05-12T10:52:32.972 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 re-readers = 2129334.60 kB/sec 2024-05-12T10:52:32.972 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 2131295.25 kB/sec 2024-05-12T10:52:32.972 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 2131295.25 kB/sec 2024-05-12T10:52:32.972 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 2131295.25 kB/sec 2024-05-12T10:52:32.972 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 1048576.00 kB 2024-05-12T10:52:42.610 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-12T10:52:42.610 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-12T10:52:42.610 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:52:42.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8af1600640 1 Processor -- start 2024-05-12T10:52:42.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8af1600640 1 -- start start 2024-05-12T10:52:42.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8af1600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec160040 0x7f8aec0c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:42.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8af1600640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aec0cc430 con 0x7f8aec0ca040 2024-05-12T10:52:42.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8af1600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aec0cb700 con 0x7f8aec06f3a0 2024-05-12T10:52:42.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8af1600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8aec160420 con 0x7f8aec160040 2024-05-12T10:52:42.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8aea000640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8aec0ca040 0x7f8aec0cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54178/0 (socket says 172.21.15.115:54178) 2024-05-12T10:52:42.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8aea000640 1 -- 172.21.15.115:0/3332230324 learned_addr learned my addr 172.21.15.115:0/3332230324 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:52:42.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8aeaa00640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec160040 0x7f8aec0c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:42.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108493999 0 0) 0x7f8aec0cc430 con 0x7f8aec0ca040 2024-05-12T10:52:42.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ad0003530 con 0x7f8aec0ca040 2024-05-12T10:52:42.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1370271222 0 0) 0x7f8ad0003530 con 0x7f8aec0ca040 2024-05-12T10:52:42.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec160040 msgr2=0x7f8aec0c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:42.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8ae9600640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec160040 0x7f8aec0c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:42.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 >> v1:172.21.15.134:6789/0 conn(0x7f8aec06f3a0 legacy=0x7f8aec06c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aec0cb9e0 con 0x7f8aec0ca040 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f8ad8001700 con 0x7f8aec0ca040 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 >> v1:172.21.15.115:6789/0 conn(0x7f8aec0ca040 legacy=0x7f8aec0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.758+0000 7f8ae9600640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad0003a90 0x7f8ad0003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8ae9600640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec160040 0x7f8ad0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8ae9600640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 0x7f8ad00051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad000bbf0 con 0x7f8ad0004d50 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad000bd70 con 0x7f8ad0003a90 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad000bf70 con 0x7f8aec160040 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8aeb400640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 0x7f8ad00051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8aeaa00640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad0003a90 0x7f8ad0003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8aea000640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec160040 0x7f8ad0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:42.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8aeb400640 1 -- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec160040 msgr2=0x7f8ad0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:42.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8aeb400640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec160040 0x7f8ad0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:42.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8aeb400640 1 -- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad0003a90 msgr2=0x7f8ad0003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:42.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8aeb400640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad0003a90 0x7f8ad0003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:42.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8aeb400640 1 -- 172.21.15.115:0/3332230324 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad0003530 con 0x7f8ad0004d50 2024-05-12T10:52:42.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8aeaa00640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad0003a90 0x7f8ad0003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:52:42.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8aeb400640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 0x7f8ad00051b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4001e30 tx=0x7f8ae401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5456ce04cf4ddd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:52:42.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4001a80 con 0x7f8ad0004d50 2024-05-12T10:52:42.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae4003b80 con 0x7f8ad0004d50 2024-05-12T10:52:42.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.762+0000 7f8ae9600640 1 -- 172.21.15.115:0/3332230324 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4005080 con 0x7f8ad0004d50 2024-05-12T10:52:42.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 -- 172.21.15.115:0/3332230324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 msgr2=0x7f8ad00051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:42.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 --2- 172.21.15.115:0/3332230324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 0x7f8ad00051b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4001e30 tx=0x7f8ae401c760 comp rx=0 tx=0).stop 2024-05-12T10:52:42.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aeb400640 1 -- 172.21.15.115:0/3332230324 reap_dead start 2024-05-12T10:52:42.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 -- 172.21.15.115:0/3332230324 shutdown_connections 2024-05-12T10:52:42.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 -- 172.21.15.115:0/3332230324 >> 172.21.15.115:0/3332230324 conn(0x7f8aec071200 msgr2=0x7f8aec071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:52:42.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 -- 172.21.15.115:0/3332230324 shutdown_connections 2024-05-12T10:52:42.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 -- 172.21.15.115:0/3332230324 wait complete. 2024-05-12T10:52:42.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 Processor -- start 2024-05-12T10:52:42.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 -- start start 2024-05-12T10:52:42.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 0x7f8aec1f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:42.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8aec15f360 0x7f8aec159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec15e570 0x7f8aec14cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8aec0cc0d0 con 0x7f8ad0004d50 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8aec0cc710 con 0x7f8aec15f360 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8af1600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8aec06cfc0 con 0x7f8aec15e570 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aeaa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 0x7f8aec1f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aeaa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 0x7f8aec1f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46700/0 (socket says 172.21.15.115:46700) 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aeaa00640 1 -- 172.21.15.115:0/654644742 learned_addr learned my addr 172.21.15.115:0/654644742 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aea000640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8aec15f360 0x7f8aec159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aeb400640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec15e570 0x7f8aec14cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aeaa00640 1 -- 172.21.15.115:0/654644742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec15e570 msgr2=0x7f8aec14cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aeaa00640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec15e570 0x7f8aec14cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aeaa00640 1 -- 172.21.15.115:0/654644742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8aec15f360 msgr2=0x7f8aec159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aeaa00640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8aec15f360 0x7f8aec159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:42.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aeaa00640 1 -- 172.21.15.115:0/654644742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aec1f5ad0 con 0x7f8ad0004d50 2024-05-12T10:52:42.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aea000640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8aec15f360 0x7f8aec159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:52:42.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.766+0000 7f8aeb400640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec15e570 0x7f8aec14cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:52:42.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.770+0000 7f8aeaa00640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 0x7f8aec1f5590 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0116a0 tx=0x7f8adc011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:52:42.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.770+0000 7f8ae2a00640 1 -- 172.21.15.115:0/654644742 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8adc004220 con 0x7f8ad0004d50 2024-05-12T10:52:42.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.770+0000 7f8ae2a00640 1 -- 172.21.15.115:0/654644742 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8adc0043c0 con 0x7f8ad0004d50 2024-05-12T10:52:42.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.770+0000 7f8ae2a00640 1 -- 172.21.15.115:0/654644742 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8adc00f9e0 con 0x7f8ad0004d50 2024-05-12T10:52:42.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.770+0000 7f8af1600640 1 -- 172.21.15.115:0/654644742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aec1f1650 con 0x7f8ad0004d50 2024-05-12T10:52:42.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.770+0000 7f8af1600640 1 -- 172.21.15.115:0/654644742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aec15b2c0 con 0x7f8ad0004d50 2024-05-12T10:52:42.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.770+0000 7f8af1600640 1 -- 172.21.15.115:0/654644742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aec069730 con 0x7f8ad0004d50 2024-05-12T10:52:42.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.770+0000 7f8ae2a00640 1 -- 172.21.15.115:0/654644742 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8adc00fb80 con 0x7f8ad0004d50 2024-05-12T10:52:42.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.770+0000 7f8ae2a00640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8acc06f400 0x7f8acc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:42.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.770+0000 7f8ae2a00640 1 -- 172.21.15.115:0/654644742 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f8adc08fcf0 con 0x7f8ad0004d50 2024-05-12T10:52:42.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.770+0000 7f8aea000640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8acc06f400 0x7f8acc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:42.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.774+0000 7f8aea000640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8acc06f400 0x7f8acc0718c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8aec06e310 tx=0x7f8ad8001de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:52:42.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.778+0000 7f8ae2a00640 1 -- 172.21.15.115:0/654644742 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8adc094070 con 0x7f8ad0004d50 2024-05-12T10:52:42.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.974+0000 7f8af1600640 1 -- 172.21.15.115:0/654644742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8aec0b1990 con 0x7f8ad0004d50 2024-05-12T10:52:42.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.974+0000 7f8ae2a00640 1 -- 172.21.15.115:0/654644742 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f8aec1f5ad0 con 0x7f8ad0004d50 2024-05-12T10:52:42.971 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:52:42.971 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:52:42.971 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:52:42.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 -- 172.21.15.115:0/654644742 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8acc06f400 msgr2=0x7f8acc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:42.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8acc06f400 0x7f8acc0718c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8aec06e310 tx=0x7f8ad8001de0 comp rx=0 tx=0).stop 2024-05-12T10:52:42.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 -- 172.21.15.115:0/654644742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 msgr2=0x7f8aec1f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:42.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 0x7f8aec1f5590 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0116a0 tx=0x7f8adc011b60 comp rx=0 tx=0).stop 2024-05-12T10:52:42.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 -- 172.21.15.115:0/654644742 shutdown_connections 2024-05-12T10:52:42.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f8acc06f400 0x7f8acc0718c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:42.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec15e570 0x7f8aec14cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:42.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8aec15f360 0x7f8aec159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:42.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 --2- 172.21.15.115:0/654644742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ad0004d50 0x7f8aec1f5590 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:42.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 -- 172.21.15.115:0/654644742 >> 172.21.15.115:0/654644742 conn(0x7f8aec071200 msgr2=0x7f8aec06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:52:42.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 -- 172.21.15.115:0/654644742 shutdown_connections 2024-05-12T10:52:42.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:42.978+0000 7f8af1600640 1 -- 172.21.15.115:0/654644742 wait complete. 2024-05-12T10:52:42.992 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-12T10:52:42.992 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-12T10:52:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a11400640 1 Processor -- start 2024-05-12T10:52:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a11400640 1 -- start start 2024-05-12T10:52:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a11400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a0c155bf0 0x7f2a0c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a11400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2a0c15b9a0 0x7f2a0c0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a11400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a0c15be50 con 0x7f2a0c0cd580 2024-05-12T10:52:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a11400640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0c0c68e0 con 0x7f2a0c155bf0 2024-05-12T10:52:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a11400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0c15c0c0 con 0x7f2a0c15b9a0 2024-05-12T10:52:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a0be00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a0c155bf0 0x7f2a0c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a0be00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a0c155bf0 0x7f2a0c0c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46706/0 (socket says 172.21.15.115:46706) 2024-05-12T10:52:43.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a0be00640 1 -- 172.21.15.115:0/1292874901 learned_addr learned my addr 172.21.15.115:0/1292874901 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:52:43.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a10a00640 1 --2- 172.21.15.115:0/1292874901 >> v2:172.21.15.134:3300/0 conn(0x7f2a0c15b9a0 0x7f2a0c0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a0be00640 1 -- 172.21.15.115:0/1292874901 >> v2:172.21.15.134:3300/0 conn(0x7f2a0c15b9a0 msgr2=0x7f2a0c0cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:43.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a0be00640 1 --2- 172.21.15.115:0/1292874901 >> v2:172.21.15.134:3300/0 conn(0x7f2a0c15b9a0 0x7f2a0c0cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a0be00640 1 -- 172.21.15.115:0/1292874901 >> v1:172.21.15.134:6789/0 conn(0x7f2a0c0cd580 legacy=0x7f2a0c0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:43.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a0be00640 1 -- 172.21.15.115:0/1292874901 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c15c3a0 con 0x7f2a0c155bf0 2024-05-12T10:52:43.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.146+0000 7f2a10a00640 1 --2- 172.21.15.115:0/1292874901 >> v2:172.21.15.134:3300/0 conn(0x7f2a0c15b9a0 0x7f2a0c0cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:52:43.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a0be00640 1 --2- 172.21.15.115:0/1292874901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a0c155bf0 0x7f2a0c0c6320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009870 tx=0x7f29fc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bbd34d7b6d0a01 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:52:43.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a0b400640 1 -- 172.21.15.115:0/1292874901 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0b0070 con 0x7f2a0c155bf0 2024-05-12T10:52:43.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a0b400640 1 -- 172.21.15.115:0/1292874901 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0ab600 con 0x7f2a0c155bf0 2024-05-12T10:52:43.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a0b400640 1 -- 172.21.15.115:0/1292874901 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0ab9d0 con 0x7f2a0c155bf0 2024-05-12T10:52:43.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a11400640 1 -- 172.21.15.115:0/1292874901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a0c155bf0 msgr2=0x7f2a0c0c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:43.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a11400640 1 --2- 172.21.15.115:0/1292874901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a0c155bf0 0x7f2a0c0c6320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009870 tx=0x7f29fc01c520 comp rx=0 tx=0).stop 2024-05-12T10:52:43.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a11400640 1 -- 172.21.15.115:0/1292874901 shutdown_connections 2024-05-12T10:52:43.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a11400640 1 --2- 172.21.15.115:0/1292874901 >> v2:172.21.15.134:3300/0 conn(0x7f2a0c15b9a0 0x7f2a0c0cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a11400640 1 --2- 172.21.15.115:0/1292874901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a0c155bf0 0x7f2a0c0c6320 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a11400640 1 -- 172.21.15.115:0/1292874901 >> 172.21.15.115:0/1292874901 conn(0x7f2a0c0681c0 msgr2=0x7f2a0c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:52:43.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a11400640 1 -- 172.21.15.115:0/1292874901 shutdown_connections 2024-05-12T10:52:43.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.150+0000 7f2a11400640 1 -- 172.21.15.115:0/1292874901 wait complete. 2024-05-12T10:52:43.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a11400640 1 Processor -- start 2024-05-12T10:52:43.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a11400640 1 -- start start 2024-05-12T10:52:43.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a11400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a0c0cd580 0x7f2a0c0ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a11400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a0c155bf0 0x7f2a0c0ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a11400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a0c15b9a0 0x7f2a0c1460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a11400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c0ceb90 con 0x7f2a0c15b9a0 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a11400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c0cea10 con 0x7f2a0c0cd580 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a11400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0c155fd0 con 0x7f2a0c155bf0 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a10a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a0c15b9a0 0x7f2a0c1460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a10a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a0c15b9a0 0x7f2a0c1460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46720/0 (socket says 172.21.15.115:46720) 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a10a00640 1 -- 172.21.15.115:0/3327530585 learned_addr learned my addr 172.21.15.115:0/3327530585 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a0be00640 1 --2- 172.21.15.115:0/3327530585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a0c0cd580 0x7f2a0c0ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a03e00640 1 --2- 172.21.15.115:0/3327530585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a0c155bf0 0x7f2a0c0ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a10a00640 1 -- 172.21.15.115:0/3327530585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a0c155bf0 msgr2=0x7f2a0c0ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a10a00640 1 --2- 172.21.15.115:0/3327530585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a0c155bf0 0x7f2a0c0ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a10a00640 1 -- 172.21.15.115:0/3327530585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a0c0cd580 msgr2=0x7f2a0c0ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:43.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a10a00640 1 --2- 172.21.15.115:0/3327530585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a0c0cd580 0x7f2a0c0ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a10a00640 1 -- 172.21.15.115:0/3327530585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c0c9e00 con 0x7f2a0c15b9a0 2024-05-12T10:52:43.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a0be00640 1 --2- 172.21.15.115:0/3327530585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a0c0cd580 0x7f2a0c0ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:52:43.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a10a00640 1 --2- 172.21.15.115:0/3327530585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a0c15b9a0 0x7f2a0c1460a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400cef0 tx=0x7f2a0400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:52:43.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a08c00640 1 -- 172.21.15.115:0/3327530585 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0401a070 con 0x7f2a0c15b9a0 2024-05-12T10:52:43.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a11400640 1 -- 172.21.15.115:0/3327530585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0c158a20 con 0x7f2a0c15b9a0 2024-05-12T10:52:43.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.154+0000 7f2a11400640 1 -- 172.21.15.115:0/3327530585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0c158fc0 con 0x7f2a0c15b9a0 2024-05-12T10:52:43.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.158+0000 7f2a08c00640 1 -- 172.21.15.115:0/3327530585 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0400d840 con 0x7f2a0c15b9a0 2024-05-12T10:52:43.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.158+0000 7f2a08c00640 1 -- 172.21.15.115:0/3327530585 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04024060 con 0x7f2a0c15b9a0 2024-05-12T10:52:43.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.158+0000 7f2a15e9f000 1 Processor -- start 2024-05-12T10:52:43.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.158+0000 7f2a08c00640 1 -- 172.21.15.115:0/3327530585 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2a0401d070 con 0x7f2a0c15b9a0 2024-05-12T10:52:43.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.158+0000 7f2a15e9f000 1 -- start start 2024-05-12T10:52:43.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a08c00640 1 --2- 172.21.15.115:0/3327530585 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f29e806f400 0x7f29e80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e665740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a08c00640 1 -- 172.21.15.115:0/3327530585 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2a0408ff00 con 0x7f2a0c15b9a0 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e665c80 0x562c2e666060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e66aa10 0x562c2e66adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562c2e4790f0 con 0x562c2e62fdf0 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562c2e432670 con 0x562c2e66aa10 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562c2e4750b0 con 0x562c2e665c80 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a03e00640 1 --2- 172.21.15.115:0/3327530585 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f29e806f400 0x7f29e80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a0be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e665740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a0be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e665740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46724/0 (socket says 172.21.15.115:46724) 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a0be00640 1 -- 172.21.15.115:0/1241520406 learned_addr learned my addr 172.21.15.115:0/1241520406 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a03e00640 1 --2- 172.21.15.115:0/1241520406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e665c80 0x562c2e666060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a10a00640 1 --2- 172.21.15.115:0/1241520406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e66aa10 0x562c2e66adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a0be00640 1 -- 172.21.15.115:0/1241520406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e665c80 msgr2=0x562c2e666060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:43.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a0be00640 1 --2- 172.21.15.115:0/1241520406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e665c80 0x562c2e666060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a0be00640 1 -- 172.21.15.115:0/1241520406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e66aa10 msgr2=0x562c2e66adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a0be00640 1 --2- 172.21.15.115:0/1241520406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e66aa10 0x562c2e66adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a0be00640 1 -- 172.21.15.115:0/1241520406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2e43b010 con 0x562c2e62fdf0 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a03e00640 1 --2- 172.21.15.115:0/3327530585 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f29e806f400 0x7f29e80718c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0c9810 tx=0x7f29f4009da0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a0be00640 1 --2- 172.21.15.115:0/1241520406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e665740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f29fc01abd0 tx=0x7f29fc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99988d99f691259c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a00c00640 1 -- 172.21.15.115:0/1241520406 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0b0040 con 0x562c2e62fdf0 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a00c00640 1 -- 172.21.15.115:0/1241520406 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0ab7c0 con 0x562c2e62fdf0 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a00c00640 1 -- 172.21.15.115:0/1241520406 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0abb70 con 0x562c2e62fdf0 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1241520406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 msgr2=0x562c2e665740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/1241520406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e665740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f29fc01abd0 tx=0x7f29fc004740 comp rx=0 tx=0).stop 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1241520406 shutdown_connections 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/1241520406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e66aa10 0x562c2e66adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/1241520406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e665c80 0x562c2e666060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/1241520406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e665740 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1241520406 >> 172.21.15.115:0/1241520406 conn(0x562c2e511f90 msgr2=0x562c2e6687d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:52:43.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1241520406 shutdown_connections 2024-05-12T10:52:43.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1241520406 wait complete. 2024-05-12T10:52:43.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 -- start start 2024-05-12T10:52:43.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.162+0000 7f2a15e9f000 1 Processor -- start 2024-05-12T10:52:43.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e62fdf0 0x562c2e664d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e665270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e66aa10 0x562c2e62b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562c2e4864f0 con 0x562c2e665c80 2024-05-12T10:52:43.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562c2e419900 con 0x562c2e62fdf0 2024-05-12T10:52:43.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562c2e6301d0 con 0x562c2e66aa10 2024-05-12T10:52:43.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 10 client.0 _ll_register_callbacks cb 0x562c2e615180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:52:43.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e665270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e665270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46734/0 (socket says 172.21.15.115:46734) 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a03e00640 1 -- 172.21.15.115:0/258820096 learned_addr learned my addr 172.21.15.115:0/258820096 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a0be00640 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e62fdf0 0x562c2e664d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a10a00640 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e66aa10 0x562c2e62b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a03e00640 1 -- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e66aa10 msgr2=0x562c2e62b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a03e00640 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e66aa10 0x562c2e62b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a03e00640 1 -- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e62fdf0 msgr2=0x562c2e664d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a03e00640 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e62fdf0 0x562c2e664d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a03e00640 1 -- 172.21.15.115:0/258820096 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2e42be40 con 0x562c2e665c80 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a0be00640 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e62fdf0 0x562c2e664d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a03e00640 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e665270 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f29f4011ef0 tx=0x7f29f4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddb06b075c11db server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f29f9600640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:52:43.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f29f9600640 1 -- 172.21.15.115:0/258820096 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4004020 con 0x562c2e665c80 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f29f9600640 1 -- 172.21.15.115:0/258820096 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f29f40041c0 con 0x562c2e665c80 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 1 -- 172.21.15.115:0/258820096 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29fc0ab7c0 con 0x562c2e665c80 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f29f9600640 1 -- 172.21.15.115:0/258820096 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f29f402d050 con 0x562c2e665c80 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 10 client.4950 fetch_fsmap learned FSMap version 14 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 1 -- 172.21.15.115:0/258820096 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562c2e543ab0 con 0x562c2e665c80 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f29f9600640 1 -- 172.21.15.115:0/258820096 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0ab7c0 con 0x562c2e665c80 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f29f9600640 1 -- 172.21.15.115:0/258820096 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f29f4030020 con 0x562c2e665c80 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 10 client.4950 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 10 client.4950 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 20 client.4950 populate_metadata read hostname 'smithi115' 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562c2e62bef0 0x562c2e62c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 4 client.4950 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a15e9f000 1 -- 172.21.15.115:0/258820096 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c2e4127f0 con 0x562c2e62bef0 2024-05-12T10:52:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a0be00640 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562c2e62bef0 0x562c2e62c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f2a0be00640 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562c2e62bef0 0x562c2e62c300 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfadb44aeb7be432 server_cookie=f7c2b1ffbf614447 in_seq=0 out_seq=0 2024-05-12T10:52:43.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.166+0000 7f29f9600640 10 client.4950 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:52:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f29f9600640 1 -- 172.21.15.115:0/258820096 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562c2e4127f0 con 0x562c2e62bef0 2024-05-12T10:52:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f29f9600640 10 client.4950 handle_command_reply: tid=0 2024-05-12T10:52:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 1 client.4950 shutdown 2024-05-12T10:52:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 1 -- 172.21.15.115:0/258820096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 msgr2=0x562c2e665270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e665270 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f29f4011ef0 tx=0x7f29f4014000 comp rx=0 tx=0).stop 2024-05-12T10:52:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 1 -- 172.21.15.115:0/258820096 shutdown_connections 2024-05-12T10:52:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e66aa10 0x562c2e62b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e665270 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562c2e62bef0 0x562c2e62c300 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/258820096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e62fdf0 0x562c2e664d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 1 -- 172.21.15.115:0/258820096 >> 172.21.15.115:0/258820096 conn(0x562c2e511f90 msgr2=0x562c2e668490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:52:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f29f9600640 0 client.4950 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:52:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 1 -- 172.21.15.115:0/258820096 shutdown_connections 2024-05-12T10:52:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 1 -- 172.21.15.115:0/258820096 wait complete. 2024-05-12T10:52:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.170+0000 7f2a15e9f000 20 client.4950 trim_cache size 0 max 16384 2024-05-12T10:52:43.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.186+0000 7f2a15e9f000 1 Processor -- start 2024-05-12T10:52:43.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.186+0000 7f2a15e9f000 1 -- start start 2024-05-12T10:52:43.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e511f90 0x562c2e62eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e62fdf0 0x562c2e62f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e6e5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f29e400e930 con 0x562c2e665c80 2024-05-12T10:52:43.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29e400d0a0 con 0x562c2e62fdf0 2024-05-12T10:52:43.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f29e400c360 con 0x562c2e511f90 2024-05-12T10:52:43.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a10a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e6e5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a10a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e6e5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46736/0 (socket says 172.21.15.115:46736) 2024-05-12T10:52:43.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a10a00640 1 -- 172.21.15.115:0/538165471 learned_addr learned my addr 172.21.15.115:0/538165471 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:52:43.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a03e00640 1 --2- 172.21.15.115:0/538165471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e62fdf0 0x562c2e62f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a0be00640 1 --2- 172.21.15.115:0/538165471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e511f90 0x562c2e62eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a10a00640 1 -- 172.21.15.115:0/538165471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e511f90 msgr2=0x562c2e62eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:43.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a10a00640 1 --2- 172.21.15.115:0/538165471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e511f90 0x562c2e62eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a10a00640 1 -- 172.21.15.115:0/538165471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e62fdf0 msgr2=0x562c2e62f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:43.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a10a00640 1 --2- 172.21.15.115:0/538165471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e62fdf0 0x562c2e62f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a10a00640 1 -- 172.21.15.115:0/538165471 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2e4f9e30 con 0x562c2e665c80 2024-05-12T10:52:43.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a10a00640 1 --2- 172.21.15.115:0/538165471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e6e5b60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2a04058450 tx=0x7f2a0400f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887899e4299e7f6f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:52:43.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f29fbe00640 1 -- 172.21.15.115:0/538165471 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a040606d0 con 0x562c2e665c80 2024-05-12T10:52:43.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f29fbe00640 1 -- 172.21.15.115:0/538165471 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0407a070 con 0x562c2e665c80 2024-05-12T10:52:43.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f29fbe00640 1 -- 172.21.15.115:0/538165471 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0407b470 con 0x562c2e665c80 2024-05-12T10:52:43.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- 172.21.15.115:0/538165471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 msgr2=0x562c2e6e5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:52:43.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/538165471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e6e5b60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2a04058450 tx=0x7f2a0400f040 comp rx=0 tx=0).stop 2024-05-12T10:52:43.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- 172.21.15.115:0/538165471 shutdown_connections 2024-05-12T10:52:43.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/538165471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e665c80 0x562c2e6e5b60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/538165471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e62fdf0 0x562c2e62f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/538165471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e511f90 0x562c2e62eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- 172.21.15.115:0/538165471 >> 172.21.15.115:0/538165471 conn(0x562c2e665780 msgr2=0x562c2e686670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:52:43.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- 172.21.15.115:0/538165471 shutdown_connections 2024-05-12T10:52:43.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- 172.21.15.115:0/538165471 wait complete. 2024-05-12T10:52:43.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- start start 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 Processor -- start 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e511f90 0x562c2e684a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e684f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e665c80 0x562c2e6854a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562c2e40f3e0 con 0x562c2e62fdf0 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29e400c9d0 con 0x562c2e665c80 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562c2e478400 con 0x562c2e511f90 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a15e9f000 10 client.0 _ll_register_callbacks cb 0x7f29f4009220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e684f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e684f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46752/0 (socket says 172.21.15.115:46752) 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a03e00640 1 -- 172.21.15.115:0/1139717471 learned_addr learned my addr 172.21.15.115:0/1139717471 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a10a00640 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e665c80 0x562c2e6854a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.190+0000 7f2a0be00640 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e511f90 0x562c2e684a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a03e00640 1 -- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e511f90 msgr2=0x562c2e684a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a03e00640 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e511f90 0x562c2e684a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a03e00640 1 -- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e665c80 msgr2=0x562c2e6854a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a03e00640 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e665c80 0x562c2e6854a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a03e00640 1 -- 172.21.15.115:0/1139717471 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2e40ad80 con 0x562c2e62fdf0 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a03e00640 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e684f60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f29f40091f0 tx=0x7f29f4004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956bb7114fd3445f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f29f9600640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f29f9600640 1 -- 172.21.15.115:0/1139717471 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4037070 con 0x562c2e62fdf0 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f29f9600640 1 -- 172.21.15.115:0/1139717471 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f29f4017df0 con 0x562c2e62fdf0 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1139717471 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a0407a070 con 0x562c2e62fdf0 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f29f9600640 1 -- 172.21.15.115:0/1139717471 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f29f4016ce0 con 0x562c2e62fdf0 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a15e9f000 10 client.4956 fetch_fsmap learned FSMap version 14 2024-05-12T10:52:43.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1139717471 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562c2e41df80 con 0x562c2e62fdf0 2024-05-12T10:52:43.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f29f9600640 1 -- 172.21.15.115:0/1139717471 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0407a070 con 0x562c2e62fdf0 2024-05-12T10:52:43.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f29f9600640 1 -- 172.21.15.115:0/1139717471 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f29f4045020 con 0x562c2e62fdf0 2024-05-12T10:52:43.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a15e9f000 10 client.4956 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:52:43.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a15e9f000 10 client.4956 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:52:43.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a15e9f000 20 client.4956 populate_metadata read hostname 'smithi115' 2024-05-12T10:52:43.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562c2e66aa10 0x562c2e6f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:52:43.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a15e9f000 4 client.4956 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-12T10:52:43.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1139717471 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x562c2e486d00 con 0x562c2e66aa10 2024-05-12T10:52:43.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a0be00640 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562c2e66aa10 0x562c2e6f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:52:43.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f2a0be00640 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562c2e66aa10 0x562c2e6f39f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d40fb2a0d4f56f8d server_cookie=a0c8a516267cac79 in_seq=0 out_seq=0 2024-05-12T10:52:43.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:52:43.194+0000 7f29f9600640 10 client.4956 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:52:50.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:52:50.167 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:53:20.217 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:53:20.220 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:53:25.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f29f9600640 1 -- 172.21.15.115:0/1139717471 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: -115 ) ==== 8+0+590 (crc 0 0 0) 0x562c2e486d00 con 0x562c2e66aa10 2024-05-12T10:53:25.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f29f9600640 10 client.4956 handle_command_reply: tid=0 2024-05-12T10:53:25.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 1 client.4956 shutdown 2024-05-12T10:53:25.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1139717471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 msgr2=0x562c2e684f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e684f60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f29f40091f0 tx=0x7f29f4004690 comp rx=0 tx=0).stop 2024-05-12T10:53:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1139717471 shutdown_connections 2024-05-12T10:53:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x562c2e66aa10 0x562c2e6f39f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c2e665c80 0x562c2e6854a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562c2e62fdf0 0x562c2e684f60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f29f9600640 0 client.4956 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:53:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 1 --2- 172.21.15.115:0/1139717471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562c2e511f90 0x562c2e684a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1139717471 >> 172.21.15.115:0/1139717471 conn(0x562c2e665780 msgr2=0x562c2e686670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1139717471 shutdown_connections 2024-05-12T10:53:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 1 -- 172.21.15.115:0/1139717471 wait complete. 2024-05-12T10:53:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.193+0000 7f2a15e9f000 20 client.4956 trim_cache size 0 max 16384 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 9, 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "5358179": { 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 9, 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCING", 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.0 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:53:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 90.0, 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCING", 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.0 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:53:25.192 INFO:teuthology.orchestra.run.smithi115.stderr:Error EINPROGRESS: 2024-05-12T10:53:25.196 DEBUG:teuthology.orchestra.run:got remote process result: 115 2024-05-12T10:53:25.197 WARNING:tasks.quiescer.fs.[cephfs]:Set '5358179' hasn't quiesced after 42.6 seconds (timeout: 60). Dumping ops with locks from all ranks. 2024-05-12T10:53:25.197 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:53:25.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.337+0000 7f28d4c00640 1 Processor -- start 2024-05-12T10:53:25.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.337+0000 7f28d4c00640 1 -- start start 2024-05-12T10:53:25.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28d4c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d00c7f70 0x7f28d0153e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28d4c00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d0073d40 con 0x7f28d00c7b90 2024-05-12T10:53:25.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28d4c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d00caa00 con 0x7f28d00c5150 2024-05-12T10:53:25.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28d4c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f28d00c9060 con 0x7f28d00c7f70 2024-05-12T10:53:25.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28cf400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f28d00c7b90 0x7f28d0153770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50770/0 (socket says 172.21.15.115:50770) 2024-05-12T10:53:25.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28cf400640 1 -- 172.21.15.115:0/1527617020 learned_addr learned my addr 172.21.15.115:0/1527617020 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:53:25.338 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28cea00640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d00c7f70 0x7f28d0153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.338 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130534804 0 0) 0x7f28d0073d40 con 0x7f28d00c7b90 2024-05-12T10:53:25.338 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28b4003530 con 0x7f28d00c7b90 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782064890 0 0) 0x7f28d00caa00 con 0x7f28d00c5150 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28d0073d40 con 0x7f28d00c5150 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3073774939 0 0) 0x7f28b4003530 con 0x7f28d00c7b90 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d00c7f70 msgr2=0x7f28d0153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d00c7f70 0x7f28d0153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 >> v1:172.21.15.134:6789/0 conn(0x7f28d00c5150 legacy=0x7f28d01643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d0073410 con 0x7f28d00c7b90 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f28c0001700 con 0x7f28d00c7b90 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 >> v1:172.21.15.115:6789/0 conn(0x7f28d00c7b90 legacy=0x7f28d0153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 0x7f28b4004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d00c7f70 0x7f28b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28b4004da0 0x7f28b4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f28d00c9060 con 0x7f28b4003c70 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f28b400bb90 con 0x7f28b4004da0 2024-05-12T10:53:25.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f28b400bd90 con 0x7f28d00c7f70 2024-05-12T10:53:25.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28cf400640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 0x7f28b4004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28cfe00640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28b4004da0 0x7f28b4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28cea00640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d00c7f70 0x7f28b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28cf400640 1 -- 172.21.15.115:0/1527617020 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d00c7f70 msgr2=0x7f28b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28cf400640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d00c7f70 0x7f28b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28cf400640 1 -- 172.21.15.115:0/1527617020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28b4004da0 msgr2=0x7f28b4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28cf400640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28b4004da0 0x7f28b4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.341+0000 7f28cf400640 1 -- 172.21.15.115:0/1527617020 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b4003530 con 0x7f28b4003c70 2024-05-12T10:53:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.345+0000 7f28cf400640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 0x7f28b4004070 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f28c000c110 tx=0x7f28c001cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2b254f6292d3d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.345+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0007c50 con 0x7f28b4003c70 2024-05-12T10:53:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.345+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c00a9070 con 0x7f28b4003c70 2024-05-12T10:53:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.345+0000 7f28ce000640 1 -- 172.21.15.115:0/1527617020 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0005d20 con 0x7f28b4003c70 2024-05-12T10:53:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.345+0000 7f28d4c00640 1 -- 172.21.15.115:0/1527617020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 msgr2=0x7f28b4004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.345+0000 7f28d4c00640 1 --2- 172.21.15.115:0/1527617020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 0x7f28b4004070 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f28c000c110 tx=0x7f28c001cad0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.345+0000 7f28cfe00640 1 -- 172.21.15.115:0/1527617020 reap_dead start 2024-05-12T10:53:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.345+0000 7f28d4c00640 1 -- 172.21.15.115:0/1527617020 shutdown_connections 2024-05-12T10:53:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.345+0000 7f28d4c00640 1 -- 172.21.15.115:0/1527617020 >> 172.21.15.115:0/1527617020 conn(0x7f28d00ce220 msgr2=0x7f28d00ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.345+0000 7f28d4c00640 1 -- 172.21.15.115:0/1527617020 shutdown_connections 2024-05-12T10:53:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.345+0000 7f28d4c00640 1 -- 172.21.15.115:0/1527617020 wait complete. 2024-05-12T10:53:25.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28d4c00640 1 Processor -- start 2024-05-12T10:53:25.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28d4c00640 1 -- start start 2024-05-12T10:53:25.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28d4c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 0x7f28d00c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28d4c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d00cc020 0x7f28d014bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28d4c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d01476a0 0x7f28d0147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28d4c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f28d00c8c20 con 0x7f28b4003c70 2024-05-12T10:53:25.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28d4c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f28d0154290 con 0x7f28d00cc020 2024-05-12T10:53:25.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28d4c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f28d00c8da0 con 0x7f28d01476a0 2024-05-12T10:53:25.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cf400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 0x7f28d00c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cf400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 0x7f28d00c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50846/0 (socket says 172.21.15.115:50846) 2024-05-12T10:53:25.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cf400640 1 -- 172.21.15.115:0/3838130144 learned_addr learned my addr 172.21.15.115:0/3838130144 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cea00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d00cc020 0x7f28d014bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cfe00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d01476a0 0x7f28d0147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cf400640 1 -- 172.21.15.115:0/3838130144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d01476a0 msgr2=0x7f28d0147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cf400640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d01476a0 0x7f28d0147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cf400640 1 -- 172.21.15.115:0/3838130144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d00cc020 msgr2=0x7f28d014bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cf400640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d00cc020 0x7f28d014bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cf400640 1 -- 172.21.15.115:0/3838130144 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d00ccbf0 con 0x7f28b4003c70 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cea00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d00cc020 0x7f28d014bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cfe00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d01476a0 0x7f28d0147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28cf400640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 0x7f28d00c5bc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f28c000c110 tx=0x7f28b4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28c7400640 1 -- 172.21.15.115:0/3838130144 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0007c50 con 0x7f28b4003c70 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28c7400640 1 -- 172.21.15.115:0/3838130144 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c00a6d60 con 0x7f28b4003c70 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28d4c00640 1 -- 172.21.15.115:0/3838130144 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d0152f00 con 0x7f28b4003c70 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28c7400640 1 -- 172.21.15.115:0/3838130144 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00047f0 con 0x7f28b4003c70 2024-05-12T10:53:25.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28d4c00640 1 -- 172.21.15.115:0/3838130144 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d00cd170 con 0x7f28b4003c70 2024-05-12T10:53:25.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.349+0000 7f28d4c00640 1 -- 172.21.15.115:0/3838130144 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d0050750 con 0x7f28b4003c70 2024-05-12T10:53:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.353+0000 7f28c7400640 1 -- 172.21.15.115:0/3838130144 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f28c0004990 con 0x7f28b4003c70 2024-05-12T10:53:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.353+0000 7f28c7400640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b006f400 0x7f28b00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.353+0000 7f28c7400640 1 -- 172.21.15.115:0/3838130144 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f28c0129110 con 0x7f28b4003c70 2024-05-12T10:53:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.353+0000 7f28cea00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b006f400 0x7f28b00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.353+0000 7f28cea00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b006f400 0x7f28b00718c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f28d014fe70 tx=0x7f28bc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.357+0000 7f28c7400640 1 -- 172.21.15.115:0/3838130144 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f28c00bf060 con 0x7f28b4003c70 2024-05-12T10:53:25.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.549+0000 7f28d4c00640 1 -- 172.21.15.115:0/3838130144 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28d0069bd0 con 0x7f28b4003c70 2024-05-12T10:53:25.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.549+0000 7f28c7400640 1 -- 172.21.15.115:0/3838130144 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f28c00168b0 con 0x7f28b4003c70 2024-05-12T10:53:25.546 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:53:25.546 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:53:25.546 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:53:25.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 -- 172.21.15.115:0/3838130144 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b006f400 msgr2=0x7f28b00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b006f400 0x7f28b00718c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f28d014fe70 tx=0x7f28bc008040 comp rx=0 tx=0).stop 2024-05-12T10:53:25.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 -- 172.21.15.115:0/3838130144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 msgr2=0x7f28d00c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 0x7f28d00c5bc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f28c000c110 tx=0x7f28b4005840 comp rx=0 tx=0).stop 2024-05-12T10:53:25.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 -- 172.21.15.115:0/3838130144 shutdown_connections 2024-05-12T10:53:25.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b006f400 0x7f28b00718c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d01476a0 0x7f28d0147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d00cc020 0x7f28d014bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 --2- 172.21.15.115:0/3838130144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28b4003c70 0x7f28d00c5bc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 -- 172.21.15.115:0/3838130144 >> 172.21.15.115:0/3838130144 conn(0x7f28d00ce220 msgr2=0x7f28d01582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 -- 172.21.15.115:0/3838130144 shutdown_connections 2024-05-12T10:53:25.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.553+0000 7f28d4c00640 1 -- 172.21.15.115:0/3838130144 wait complete. 2024-05-12T10:53:25.567 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 2 (a) to a remote file /var/run/ceph/ops-5358179-1-mds.a.json 2024-05-12T10:53:25.567 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 ops --flags=locks --path=/var/run/ceph/ops-5358179-1-mds.a.json 2024-05-12T10:53:25.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f6794e00640 1 Processor -- start 2024-05-12T10:53:25.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f6794e00640 1 -- start start 2024-05-12T10:53:25.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f6794e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f67900b1fc0 0x7f67900700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f6794e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6790155f80 0x7f67900cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f6794e00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f679015ba10 con 0x7f6790155ba0 2024-05-12T10:53:25.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f6794e00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f67900ca6c0 con 0x7f6790155f80 2024-05-12T10:53:25.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f6794e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f67900ca9a0 con 0x7f67900b1fc0 2024-05-12T10:53:25.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f678fe00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6790155f80 0x7f67900cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f678f400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6790155ba0 0x7f67900c9ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50778/0 (socket says 172.21.15.115:50778) 2024-05-12T10:53:25.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f678f400640 1 -- 172.21.15.115:0/1746622625 learned_addr learned my addr 172.21.15.115:0/1746622625 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:53:25.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f6786a00640 1 --2- 172.21.15.115:0/1746622625 >> v2:172.21.15.134:3300/0 conn(0x7f67900b1fc0 0x7f67900700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f678fe00640 1 -- 172.21.15.115:0/1746622625 >> v2:172.21.15.134:3300/0 conn(0x7f67900b1fc0 msgr2=0x7f67900700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f678fe00640 1 --2- 172.21.15.115:0/1746622625 >> v2:172.21.15.134:3300/0 conn(0x7f67900b1fc0 0x7f67900700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f678fe00640 1 -- 172.21.15.115:0/1746622625 >> v1:172.21.15.115:6789/0 conn(0x7f6790155ba0 legacy=0x7f67900c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f678fe00640 1 -- 172.21.15.115:0/1746622625 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679015bc90 con 0x7f6790155f80 2024-05-12T10:53:25.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.721+0000 7f678ea00640 1 -- 172.21.15.115:0/1746622625 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3143607851 0 0) 0x7f6780001120 con 0x7f6790155ba0 2024-05-12T10:53:25.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f678fe00640 1 --2- 172.21.15.115:0/1746622625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6790155f80 0x7f67900cbf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f67900d05b0 tx=0x7f678801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfed43c9e460602 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f678ea00640 1 -- 172.21.15.115:0/1746622625 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67880b4070 con 0x7f6790155f80 2024-05-12T10:53:25.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f678ea00640 1 -- 172.21.15.115:0/1746622625 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880af600 con 0x7f6790155f80 2024-05-12T10:53:25.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f678ea00640 1 -- 172.21.15.115:0/1746622625 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67880af9d0 con 0x7f6790155f80 2024-05-12T10:53:25.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f6794e00640 1 -- 172.21.15.115:0/1746622625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6790155f80 msgr2=0x7f67900cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f6794e00640 1 --2- 172.21.15.115:0/1746622625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6790155f80 0x7f67900cbf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f67900d05b0 tx=0x7f678801f110 comp rx=0 tx=0).stop 2024-05-12T10:53:25.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f6794e00640 1 -- 172.21.15.115:0/1746622625 shutdown_connections 2024-05-12T10:53:25.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f6794e00640 1 --2- 172.21.15.115:0/1746622625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6790155f80 0x7f67900cbf80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f6794e00640 1 --2- 172.21.15.115:0/1746622625 >> v2:172.21.15.134:3300/0 conn(0x7f67900b1fc0 0x7f67900700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f6794e00640 1 -- 172.21.15.115:0/1746622625 >> 172.21.15.115:0/1746622625 conn(0x7f6790071f30 msgr2=0x7f6790072340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f6794e00640 1 -- 172.21.15.115:0/1746622625 shutdown_connections 2024-05-12T10:53:25.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.725+0000 7f6794e00640 1 -- 172.21.15.115:0/1746622625 wait complete. 2024-05-12T10:53:25.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6794e00640 1 Processor -- start 2024-05-12T10:53:25.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6794e00640 1 -- start start 2024-05-12T10:53:25.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6794e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67900b1fc0 0x7f67901e8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6794e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6790155ba0 0x7f679014e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6794e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6790155f80 0x7f679014e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6794e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6790070630 con 0x7f67900b1fc0 2024-05-12T10:53:25.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6794e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f679015c250 con 0x7f6790155f80 2024-05-12T10:53:25.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6794e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f679015c770 con 0x7f6790155ba0 2024-05-12T10:53:25.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f678f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67900b1fc0 0x7f67901e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f678f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67900b1fc0 0x7f67901e8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50856/0 (socket says 172.21.15.115:50856) 2024-05-12T10:53:25.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f678f400640 1 -- 172.21.15.115:0/3255181063 learned_addr learned my addr 172.21.15.115:0/3255181063 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f678fe00640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6790155f80 0x7f679014e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6786a00640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6790155ba0 0x7f679014e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f678f400640 1 -- 172.21.15.115:0/3255181063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6790155ba0 msgr2=0x7f679014e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f678f400640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6790155ba0 0x7f679014e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f678f400640 1 -- 172.21.15.115:0/3255181063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6790155f80 msgr2=0x7f679014e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f678f400640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6790155f80 0x7f679014e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f678f400640 1 -- 172.21.15.115:0/3255181063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67901569f0 con 0x7f67900b1fc0 2024-05-12T10:53:25.727 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f678f400640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67900b1fc0 0x7f67901e8350 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f678000c730 tx=0x7f678000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.727 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6787e00640 1 -- 172.21.15.115:0/3255181063 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780018070 con 0x7f67900b1fc0 2024-05-12T10:53:25.727 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6787e00640 1 -- 172.21.15.115:0/3255181063 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67800070d0 con 0x7f67900b1fc0 2024-05-12T10:53:25.727 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6794e00640 1 -- 172.21.15.115:0/3255181063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6790156cd0 con 0x7f67900b1fc0 2024-05-12T10:53:25.727 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6787e00640 1 -- 172.21.15.115:0/3255181063 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780007500 con 0x7f67900b1fc0 2024-05-12T10:53:25.727 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.729+0000 7f6794e00640 1 -- 172.21.15.115:0/3255181063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67900cd2f0 con 0x7f67900b1fc0 2024-05-12T10:53:25.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.733+0000 7f6787e00640 1 -- 172.21.15.115:0/3255181063 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f678001b070 con 0x7f67900b1fc0 2024-05-12T10:53:25.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.733+0000 7f6787e00640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f676c06f400 0x7f676c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.733+0000 7f67998c3000 1 Processor -- start 2024-05-12T10:53:25.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.733+0000 7f6787e00640 1 -- 172.21.15.115:0/3255181063 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f678008e880 con 0x7f67900b1fc0 2024-05-12T10:53:25.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.733+0000 7f67998c3000 1 -- start start 2024-05-12T10:53:25.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.733+0000 7f6786a00640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f676c06f400 0x7f676c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f6786a00640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f676c06f400 0x7f676c0718c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f67900b1c20 tx=0x7f6778008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4af5b0 0x562b7d49acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d49b1f0 0x562b7d49b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562b7d2748a0 con 0x562b7d4aec90 2024-05-12T10:53:25.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562b7d2c22f0 con 0x562b7d4af5b0 2024-05-12T10:53:25.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562b7d25bef0 con 0x562b7d49b1f0 2024-05-12T10:53:25.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f678f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f678f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50860/0 (socket says 172.21.15.115:50860) 2024-05-12T10:53:25.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f678f400640 1 -- 172.21.15.115:0/4000499237 learned_addr learned my addr 172.21.15.115:0/4000499237 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f6786a00640 1 --2- 172.21.15.115:0/4000499237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4af5b0 0x562b7d49acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f678fe00640 1 --2- 172.21.15.115:0/4000499237 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d49b1f0 0x562b7d49b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f678f400640 1 -- 172.21.15.115:0/4000499237 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d49b1f0 msgr2=0x562b7d49b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f678f400640 1 --2- 172.21.15.115:0/4000499237 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d49b1f0 0x562b7d49b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f678f400640 1 -- 172.21.15.115:0/4000499237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4af5b0 msgr2=0x562b7d49acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f678f400640 1 --2- 172.21.15.115:0/4000499237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4af5b0 0x562b7d49acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f678f400640 1 -- 172.21.15.115:0/4000499237 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b7d307800 con 0x562b7d4aec90 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f678f400640 1 --2- 172.21.15.115:0/4000499237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4af070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f678000c700 tx=0x7f67800575c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd16ff44ad7ee32 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f677fe00640 1 -- 172.21.15.115:0/4000499237 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780063b60 con 0x562b7d4aec90 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f677fe00640 1 -- 172.21.15.115:0/4000499237 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6780074170 con 0x562b7d4aec90 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f677fe00640 1 -- 172.21.15.115:0/4000499237 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780085be0 con 0x562b7d4aec90 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- 172.21.15.115:0/4000499237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 msgr2=0x562b7d4af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 --2- 172.21.15.115:0/4000499237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4af070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f678000c700 tx=0x7f67800575c0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- 172.21.15.115:0/4000499237 shutdown_connections 2024-05-12T10:53:25.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 --2- 172.21.15.115:0/4000499237 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d49b1f0 0x562b7d49b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 --2- 172.21.15.115:0/4000499237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4af5b0 0x562b7d49acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 --2- 172.21.15.115:0/4000499237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4af070 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- 172.21.15.115:0/4000499237 >> 172.21.15.115:0/4000499237 conn(0x562b7d46a370 msgr2=0x562b7d4b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- 172.21.15.115:0/4000499237 shutdown_connections 2024-05-12T10:53:25.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- 172.21.15.115:0/4000499237 wait complete. 2024-05-12T10:53:25.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- start start 2024-05-12T10:53:25.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 Processor -- start 2024-05-12T10:53:25.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d49b1f0 0x562b7d498840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d498d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d4af5b0 0x562b7d4721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562b7d2cf6f0 con 0x562b7d4aec90 2024-05-12T10:53:25.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562b7d27eb80 con 0x562b7d49b1f0 2024-05-12T10:53:25.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.737+0000 7f67998c3000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562b7d28cd80 con 0x562b7d4af5b0 2024-05-12T10:53:25.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 10 client.0 _ll_register_callbacks cb 0x562b7d45ddd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:53:25.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f6786a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d498d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f6786a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d498d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50874/0 (socket says 172.21.15.115:50874) 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f6786a00640 1 -- 172.21.15.115:0/3489945122 learned_addr learned my addr 172.21.15.115:0/3489945122 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f678f400640 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d49b1f0 0x562b7d498840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f678fe00640 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d4af5b0 0x562b7d4721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f6786a00640 1 -- 172.21.15.115:0/3489945122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d4af5b0 msgr2=0x562b7d4721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f6786a00640 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d4af5b0 0x562b7d4721b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f6786a00640 1 -- 172.21.15.115:0/3489945122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d49b1f0 msgr2=0x562b7d498840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f6786a00640 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d49b1f0 0x562b7d498840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f6786a00640 1 -- 172.21.15.115:0/3489945122 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b7d29ef20 con 0x562b7d4aec90 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f6786a00640 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d498d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6778015710 tx=0x7f67780046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b160d2f7d2071d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f677cc00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f677cc00640 1 -- 172.21.15.115:0/3489945122 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67780146e0 con 0x562b7d4aec90 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f677cc00640 1 -- 172.21.15.115:0/3489945122 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f6778014880 con 0x562b7d4aec90 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 -- 172.21.15.115:0/3489945122 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6780074170 con 0x562b7d4aec90 2024-05-12T10:53:25.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f677cc00640 1 -- 172.21.15.115:0/3489945122 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f6778032050 con 0x562b7d4aec90 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 10 client.4977 fetch_fsmap learned FSMap version 14 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 -- 172.21.15.115:0/3489945122 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562b7d260b60 con 0x562b7d4aec90 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f677cc00640 1 -- 172.21.15.115:0/3489945122 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6780074170 con 0x562b7d4aec90 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f677cc00640 1 -- 172.21.15.115:0/3489945122 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f6778035020 con 0x562b7d4aec90 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 10 client.4977 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 10 client.4977 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.a 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 20 client.4977 populate_metadata read hostname 'smithi115' 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562b7d472f20 0x562b7d473330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 4 client.4977 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 -- 172.21.15.115:0/3489945122 --> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b7d25aec0 con 0x562b7d472f20 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f678f400640 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562b7d472f20 0x562b7d473330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f678f400640 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562b7d472f20 0x562b7d473330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f64a35dd2b1177f server_cookie=b29eda2d6b931e10 in_seq=0 out_seq=0 2024-05-12T10:53:25.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f677cc00640 10 client.4977 ms_handle_connect on v2:172.21.15.115:6836/3194167246 2024-05-12T10:53:25.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f677cc00640 1 -- 172.21.15.115:0/3489945122 <== mds.2 v2:172.21.15.115:6836/3194167246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562b7d25aec0 con 0x562b7d472f20 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f677cc00640 10 client.4977 handle_command_reply: tid=0 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 client.4977 shutdown 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 -- 172.21.15.115:0/3489945122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 msgr2=0x562b7d498d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d498d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6778015710 tx=0x7f67780046d0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 -- 172.21.15.115:0/3489945122 shutdown_connections 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562b7d472f20 0x562b7d473330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d4af5b0 0x562b7d4721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d498d80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 --2- 172.21.15.115:0/3489945122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d49b1f0 0x562b7d498840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f677cc00640 0 client.4977 ms_handle_reset on v2:172.21.15.115:6836/3194167246 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.741+0000 7f67998c3000 1 -- 172.21.15.115:0/3489945122 >> 172.21.15.115:0/3489945122 conn(0x562b7d46a370 msgr2=0x562b7d499880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.745+0000 7f67998c3000 1 -- 172.21.15.115:0/3489945122 shutdown_connections 2024-05-12T10:53:25.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.745+0000 7f67998c3000 1 -- 172.21.15.115:0/3489945122 wait complete. 2024-05-12T10:53:25.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.745+0000 7f67998c3000 20 client.4977 trim_cache size 0 max 16384 2024-05-12T10:53:25.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 Processor -- start 2024-05-12T10:53:25.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 -- start start 2024-05-12T10:53:25.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d49b1f0 0x562b7d4cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4af5b0 0x562b7d4c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f67901fe7b0 con 0x562b7d4aec90 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f67901fdab0 con 0x562b7d4af5b0 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f67901fe100 con 0x562b7d49b1f0 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f6786a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f6786a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50880/0 (socket says 172.21.15.115:50880) 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f6786a00640 1 -- 172.21.15.115:0/227371226 learned_addr learned my addr 172.21.15.115:0/227371226 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f678fe00640 1 --2- 172.21.15.115:0/227371226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4af5b0 0x562b7d4c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f678f400640 1 --2- 172.21.15.115:0/227371226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d49b1f0 0x562b7d4cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f6786a00640 1 -- 172.21.15.115:0/227371226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d49b1f0 msgr2=0x562b7d4cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f6786a00640 1 --2- 172.21.15.115:0/227371226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d49b1f0 0x562b7d4cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f6786a00640 1 -- 172.21.15.115:0/227371226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4af5b0 msgr2=0x562b7d4c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f6786a00640 1 --2- 172.21.15.115:0/227371226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4af5b0 0x562b7d4c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f6786a00640 1 -- 172.21.15.115:0/227371226 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b7d4af3e0 con 0x562b7d4aec90 2024-05-12T10:53:25.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f678f400640 1 --2- 172.21.15.115:0/227371226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d49b1f0 0x562b7d4cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:53:25.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f6786a00640 1 --2- 172.21.15.115:0/227371226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4c4d50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6778008010 tx=0x7f6778023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279880c97bfd02a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f677f400640 1 -- 172.21.15.115:0/227371226 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778015440 con 0x562b7d4aec90 2024-05-12T10:53:25.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f677f400640 1 -- 172.21.15.115:0/227371226 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677803a070 con 0x562b7d4aec90 2024-05-12T10:53:25.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f677f400640 1 -- 172.21.15.115:0/227371226 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778014920 con 0x562b7d4aec90 2024-05-12T10:53:25.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 -- 172.21.15.115:0/227371226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 msgr2=0x562b7d4c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 --2- 172.21.15.115:0/227371226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4c4d50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6778008010 tx=0x7f6778023000 comp rx=0 tx=0).stop 2024-05-12T10:53:25.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 -- 172.21.15.115:0/227371226 shutdown_connections 2024-05-12T10:53:25.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 --2- 172.21.15.115:0/227371226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4af5b0 0x562b7d4c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 --2- 172.21.15.115:0/227371226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d4aec90 0x562b7d4c4d50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 --2- 172.21.15.115:0/227371226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d49b1f0 0x562b7d4cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 -- 172.21.15.115:0/227371226 >> 172.21.15.115:0/227371226 conn(0x562b7d46a370 msgr2=0x562b7d49be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 -- 172.21.15.115:0/227371226 shutdown_connections 2024-05-12T10:53:25.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 -- 172.21.15.115:0/227371226 wait complete. 2024-05-12T10:53:25.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 -- start start 2024-05-12T10:53:25.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.761+0000 7f67998c3000 1 Processor -- start 2024-05-12T10:53:25.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d49b1f0 0x562b7d4cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4aec90 0x562b7d4cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d4af5b0 0x562b7d530030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562b7d257ab0 con 0x562b7d49b1f0 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562b7d279b90 con 0x562b7d4aec90 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562b7d2c1600 con 0x562b7d4af5b0 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 10 client.0 _ll_register_callbacks cb 0x7f6778011a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f678f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d49b1f0 0x562b7d4cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f678f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d49b1f0 0x562b7d4cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50890/0 (socket says 172.21.15.115:50890) 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f678f400640 1 -- 172.21.15.115:0/3654121896 learned_addr learned my addr 172.21.15.115:0/3654121896 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f6786a00640 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4aec90 0x562b7d4cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f678fe00640 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d4af5b0 0x562b7d530030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f678f400640 1 -- 172.21.15.115:0/3654121896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d4af5b0 msgr2=0x562b7d530030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f678f400640 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d4af5b0 0x562b7d530030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f678f400640 1 -- 172.21.15.115:0/3654121896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4aec90 msgr2=0x562b7d4cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f678f400640 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4aec90 0x562b7d4cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f678f400640 1 -- 172.21.15.115:0/3654121896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b7d25c140 con 0x562b7d49b1f0 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f678f400640 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d49b1f0 0x562b7d4cf720 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6780001ec0 tx=0x7f6780000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd9f1057b5640e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f677cc00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f677cc00640 1 -- 172.21.15.115:0/3654121896 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780074170 con 0x562b7d49b1f0 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f677cc00640 1 -- 172.21.15.115:0/3654121896 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f6780061370 con 0x562b7d49b1f0 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 -- 172.21.15.115:0/3654121896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f677803a070 con 0x562b7d49b1f0 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f677cc00640 1 -- 172.21.15.115:0/3654121896 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f6780061590 con 0x562b7d49b1f0 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 10 client.4983 fetch_fsmap learned FSMap version 14 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 -- 172.21.15.115:0/3654121896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562b7d25c8e0 con 0x562b7d49b1f0 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f677cc00640 1 -- 172.21.15.115:0/3654121896 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677803a070 con 0x562b7d49b1f0 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f677cc00640 1 -- 172.21.15.115:0/3654121896 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f678005a0a0 con 0x562b7d49b1f0 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 10 client.4983 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 10 client.4983 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.a 2024-05-12T10:53:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 20 client.4983 populate_metadata read hostname 'smithi115' 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562b7d5309f0 0x562b7d530dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 4 client.4983 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-5358179-1-mds.a.json"}] 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 -- 172.21.15.115:0/3654121896 --> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-5358179-1-mds.a.json"}) -- 0x562b7d4b2800 con 0x562b7d5309f0 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f6786a00640 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562b7d5309f0 0x562b7d530dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f6786a00640 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562b7d5309f0 0x562b7d530dd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=803b8a2f88ee8f4f server_cookie=4b47746f533e0a8c in_seq=0 out_seq=0 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f677cc00640 10 client.4983 ms_handle_connect on v2:172.21.15.115:6836/3194167246 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f677cc00640 1 -- 172.21.15.115:0/3654121896 <== mds.2 v2:172.21.15.115:6836/3194167246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+57 (crc 0 0 0) 0x562b7d4b2800 con 0x562b7d5309f0 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f677cc00640 10 client.4983 handle_command_reply: tid=0 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 client.4983 shutdown 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 -- 172.21.15.115:0/3654121896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d49b1f0 msgr2=0x562b7d4cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d49b1f0 0x562b7d4cf720 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6780001ec0 tx=0x7f6780000ee0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.765+0000 7f67998c3000 1 -- 172.21.15.115:0/3654121896 shutdown_connections 2024-05-12T10:53:25.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f67998c3000 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.115:6836/3194167246,v1:172.21.15.115:6839/3194167246] conn(0x562b7d5309f0 0x562b7d530dd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f67998c3000 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562b7d4af5b0 0x562b7d530030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f67998c3000 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b7d4aec90 0x562b7d4cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f67998c3000 1 --2- 172.21.15.115:0/3654121896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562b7d49b1f0 0x562b7d4cf720 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f67998c3000 1 -- 172.21.15.115:0/3654121896 >> 172.21.15.115:0/3654121896 conn(0x562b7d46a370 msgr2=0x562b7d49b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f677cc00640 0 client.4983 ms_handle_reset on v2:172.21.15.115:6836/3194167246 2024-05-12T10:53:25.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f67998c3000 1 -- 172.21.15.115:0/3654121896 shutdown_connections 2024-05-12T10:53:25.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f67998c3000 1 -- 172.21.15.115:0/3654121896 wait complete. 2024-05-12T10:53:25.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f67998c3000 20 client.4983 trim_cache size 0 max 16384 2024-05-12T10:53:25.767 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:53:25.768 INFO:teuthology.orchestra.run.smithi115.stdout: "path": "/var/run/ceph/ops-5358179-1-mds.a.json" 2024-05-12T10:53:25.768 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:53:25.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 -- 172.21.15.115:0/3255181063 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f676c06f400 msgr2=0x7f676c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f676c06f400 0x7f676c0718c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f67900b1c20 tx=0x7f6778008040 comp rx=0 tx=0).stop 2024-05-12T10:53:25.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 -- 172.21.15.115:0/3255181063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67900b1fc0 msgr2=0x7f67901e8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67900b1fc0 0x7f67901e8350 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f678000c730 tx=0x7f678000cbf0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 -- 172.21.15.115:0/3255181063 shutdown_connections 2024-05-12T10:53:25.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f676c06f400 0x7f676c0718c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6790155f80 0x7f679014e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6790155ba0 0x7f679014e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 --2- 172.21.15.115:0/3255181063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67900b1fc0 0x7f67901e8350 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 -- 172.21.15.115:0/3255181063 >> 172.21.15.115:0/3255181063 conn(0x7f6790071f30 msgr2=0x7f67900c4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 -- 172.21.15.115:0/3255181063 shutdown_connections 2024-05-12T10:53:25.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.769+0000 7f6794e00640 1 -- 172.21.15.115:0/3255181063 wait complete. 2024-05-12T10:53:25.782 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 1 (e) to a remote file /var/run/ceph/ops-5358179-1-mds.e.json 2024-05-12T10:53:25.782 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 ops --flags=locks --path=/var/run/ceph/ops-5358179-1-mds.e.json 2024-05-12T10:53:25.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.937+0000 7f21e5200640 1 Processor -- start 2024-05-12T10:53:25.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.937+0000 7f21e5200640 1 -- start start 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.937+0000 7f21e5200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21e0071a30 0x7f21e00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.937+0000 7f21e5200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f21e00cbba0 0x7f21e00cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.937+0000 7f21e5200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e00cb3e0 con 0x7f21e0153e90 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.937+0000 7f21e5200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f21e00caa40 con 0x7f21e00cbba0 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.937+0000 7f21e5200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f21e00c6570 con 0x7f21e0071a30 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.937+0000 7f21de800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f21e00cbba0 0x7f21e00cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.937+0000 7f21de800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f21e00cbba0 0x7f21e00cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50904/0 (socket says 172.21.15.115:50904) 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.937+0000 7f21de800640 1 -- 172.21.15.115:0/1632714278 learned_addr learned my addr 172.21.15.115:0/1632714278 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.941+0000 7f21dd400640 1 --2- 172.21.15.115:0/1632714278 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21e0071a30 0x7f21e00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.941+0000 7f21de800640 1 -- 172.21.15.115:0/1632714278 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21e0071a30 msgr2=0x7f21e00cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.941+0000 7f21de800640 1 --2- 172.21.15.115:0/1632714278 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21e0071a30 0x7f21e00cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.941+0000 7f21de800640 1 -- 172.21.15.115:0/1632714278 >> v1:172.21.15.134:6789/0 conn(0x7f21e0153e90 legacy=0x7f21e0159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.941+0000 7f21de800640 1 -- 172.21.15.115:0/1632714278 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e00ca170 con 0x7f21e00cbba0 2024-05-12T10:53:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.941+0000 7f21de800640 1 --2- 172.21.15.115:0/1632714278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e00cbba0 0x7f21e00cc5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009e50 tx=0x7f21d801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d66111cda49e48 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.941+0000 7f21dca00640 1 -- 172.21.15.115:0/1632714278 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d80a5810 con 0x7f21e00cbba0 2024-05-12T10:53:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.941+0000 7f21dca00640 1 -- 172.21.15.115:0/1632714278 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d80a59b0 con 0x7f21e00cbba0 2024-05-12T10:53:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.941+0000 7f21dca00640 1 -- 172.21.15.115:0/1632714278 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d80a5d80 con 0x7f21e00cbba0 2024-05-12T10:53:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 -- 172.21.15.115:0/1632714278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e00cbba0 msgr2=0x7f21e00cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 --2- 172.21.15.115:0/1632714278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e00cbba0 0x7f21e00cc5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009e50 tx=0x7f21d801ca30 comp rx=0 tx=0).stop 2024-05-12T10:53:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 -- 172.21.15.115:0/1632714278 shutdown_connections 2024-05-12T10:53:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 --2- 172.21.15.115:0/1632714278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e00cbba0 0x7f21e00cc5a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 --2- 172.21.15.115:0/1632714278 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21e0071a30 0x7f21e00cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 -- 172.21.15.115:0/1632714278 >> 172.21.15.115:0/1632714278 conn(0x7f21e0072050 msgr2=0x7f21e0072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 -- 172.21.15.115:0/1632714278 shutdown_connections 2024-05-12T10:53:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 -- 172.21.15.115:0/1632714278 wait complete. 2024-05-12T10:53:25.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 Processor -- start 2024-05-12T10:53:25.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 -- start start 2024-05-12T10:53:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21e0071a30 0x7f21e00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e00cbba0 0x7f21e00cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21e0153e90 0x7f21e00cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f21e0166f00 con 0x7f21e00cbba0 2024-05-12T10:53:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21e0166d80 con 0x7f21e0071a30 2024-05-12T10:53:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21e5200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f21e0167080 con 0x7f21e0153e90 2024-05-12T10:53:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21dd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e00cbba0 0x7f21e00cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21dd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e00cbba0 0x7f21e00cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50906/0 (socket says 172.21.15.115:50906) 2024-05-12T10:53:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21dd400640 1 -- 172.21.15.115:0/3225835140 learned_addr learned my addr 172.21.15.115:0/3225835140 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21dde00640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21e0071a30 0x7f21e00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21de800640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21e0153e90 0x7f21e00cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21dd400640 1 -- 172.21.15.115:0/3225835140 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21e0153e90 msgr2=0x7f21e00cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21dd400640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21e0153e90 0x7f21e00cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21dd400640 1 -- 172.21.15.115:0/3225835140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21e0071a30 msgr2=0x7f21e00c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21dd400640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21e0071a30 0x7f21e00c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.945+0000 7f21dd400640 1 -- 172.21.15.115:0/3225835140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e0164040 con 0x7f21e00cbba0 2024-05-12T10:53:25.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21dd400640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e00cbba0 0x7f21e00cc2c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00d830 tx=0x7f21cc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21d6000640 1 -- 172.21.15.115:0/3225835140 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00b6c0 con 0x7f21e00cbba0 2024-05-12T10:53:25.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21d6000640 1 -- 172.21.15.115:0/3225835140 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21cc019070 con 0x7f21e00cbba0 2024-05-12T10:53:25.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21e5200640 1 -- 172.21.15.115:0/3225835140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e01f5b90 con 0x7f21e00cbba0 2024-05-12T10:53:25.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21d6000640 1 -- 172.21.15.115:0/3225835140 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00ba60 con 0x7f21e00cbba0 2024-05-12T10:53:25.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21e5200640 1 -- 172.21.15.115:0/3225835140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e0155570 con 0x7f21e00cbba0 2024-05-12T10:53:25.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21d6000640 1 -- 172.21.15.115:0/3225835140 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f21cc01e460 con 0x7f21e00cbba0 2024-05-12T10:53:25.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21d6000640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f21c006f400 0x7f21c00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21d6000640 1 -- 172.21.15.115:0/3225835140 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f21cc08fc00 con 0x7f21e00cbba0 2024-05-12T10:53:25.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21dde00640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f21c006f400 0x7f21c00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21e86f7000 1 Processor -- start 2024-05-12T10:53:25.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.949+0000 7f21e86f7000 1 -- start start 2024-05-12T10:53:25.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21dde00640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f21c006f400 0x7f21c00718c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f21d0007fd0 tx=0x7f21d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038dc90 0x5620a038e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0379cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a037a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5620a01538a0 con 0x5620a038e5b0 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5620a01a12f0 con 0x5620a037a1f0 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5620a013aef0 con 0x5620a038dc90 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21dd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0379cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21dd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0379cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50922/0 (socket says 172.21.15.115:50922) 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21dd400640 1 -- 172.21.15.115:0/426114411 learned_addr learned my addr 172.21.15.115:0/426114411 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21dde00640 1 --2- 172.21.15.115:0/426114411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038dc90 0x5620a038e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21de800640 1 --2- 172.21.15.115:0/426114411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a037a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21dd400640 1 -- 172.21.15.115:0/426114411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038dc90 msgr2=0x5620a038e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21dd400640 1 --2- 172.21.15.115:0/426114411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038dc90 0x5620a038e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21dd400640 1 -- 172.21.15.115:0/426114411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 msgr2=0x5620a037a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21dd400640 1 --2- 172.21.15.115:0/426114411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a037a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21dd400640 1 -- 172.21.15.115:0/426114411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620a01e6800 con 0x5620a038e5b0 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21dd400640 1 --2- 172.21.15.115:0/426114411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0379cb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f21cc058710 tx=0x7f21cc05bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f18f063c06253e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21caa00640 1 -- 172.21.15.115:0/426114411 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc060420 con 0x5620a038e5b0 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21caa00640 1 -- 172.21.15.115:0/426114411 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21cc064e40 con 0x5620a038e5b0 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21caa00640 1 -- 172.21.15.115:0/426114411 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00be10 con 0x5620a038e5b0 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 -- 172.21.15.115:0/426114411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 msgr2=0x5620a0379cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 --2- 172.21.15.115:0/426114411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0379cb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f21cc058710 tx=0x7f21cc05bba0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 -- 172.21.15.115:0/426114411 shutdown_connections 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 --2- 172.21.15.115:0/426114411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a037a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 --2- 172.21.15.115:0/426114411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0379cb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 --2- 172.21.15.115:0/426114411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038dc90 0x5620a038e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 -- 172.21.15.115:0/426114411 >> 172.21.15.115:0/426114411 conn(0x5620a0349370 msgr2=0x5620a0390e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 -- 172.21.15.115:0/426114411 shutdown_connections 2024-05-12T10:53:25.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 -- 172.21.15.115:0/426114411 wait complete. 2024-05-12T10:53:25.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 -- start start 2024-05-12T10:53:25.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.953+0000 7f21e86f7000 1 Processor -- start 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a0377840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038dc90 0x5620a0377d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0351180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5620a01ae6f0 con 0x5620a038e5b0 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5620a015db80 con 0x5620a037a1f0 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5620a016bd80 con 0x5620a038dc90 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 10 client.0 _ll_register_callbacks cb 0x5620a033cdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21de800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0351180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21de800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0351180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50932/0 (socket says 172.21.15.115:50932) 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21de800640 1 -- 172.21.15.115:0/605525715 learned_addr learned my addr 172.21.15.115:0/605525715 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21dd400640 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038dc90 0x5620a0377d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21dde00640 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a0377840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21de800640 1 -- 172.21.15.115:0/605525715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038dc90 msgr2=0x5620a0377d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21de800640 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038dc90 0x5620a0377d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21de800640 1 -- 172.21.15.115:0/605525715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 msgr2=0x5620a0377840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21de800640 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a0377840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21de800640 1 -- 172.21.15.115:0/605525715 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620a017df20 con 0x5620a038e5b0 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21dd400640 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038dc90 0x5620a0377d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21de800640 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0351180 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009e50 tx=0x7f21d801b270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4100b9f8a961349b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21bf400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21bf400640 1 -- 172.21.15.115:0/605525715 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d80a5e10 con 0x5620a038e5b0 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21bf400640 1 -- 172.21.15.115:0/605525715 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f21d80c1450 con 0x5620a038e5b0 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 1 -- 172.21.15.115:0/605525715 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21cc064e40 con 0x5620a038e5b0 2024-05-12T10:53:25.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21bf400640 1 -- 172.21.15.115:0/605525715 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f21d80c9050 con 0x5620a038e5b0 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 10 client.4995 fetch_fsmap learned FSMap version 14 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 1 -- 172.21.15.115:0/605525715 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5620a013fb60 con 0x5620a038e5b0 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21bf400640 1 -- 172.21.15.115:0/605525715 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21cc064e40 con 0x5620a038e5b0 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21bf400640 1 -- 172.21.15.115:0/605525715 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f21d80cc020 con 0x5620a038e5b0 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 10 client.4995 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 10 client.4995 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 20 client.4995 populate_metadata read hostname 'smithi115' 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0351ef0 0x5620a03522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 4 client.4995 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21e86f7000 1 -- 172.21.15.115:0/605525715 --> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620a0139ec0 con 0x5620a0351ef0 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21dde00640 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0351ef0 0x5620a03522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21bf400640 10 client.4995 ms_handle_connect on v2:172.21.15.115:6835/4177777929 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.957+0000 7f21dde00640 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0351ef0 0x5620a03522d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81a13505f6bd7499 server_cookie=9614632150a131ac in_seq=0 out_seq=0 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21bf400640 1 -- 172.21.15.115:0/605525715 <== mds.1 v2:172.21.15.115:6835/4177777929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5620a0139ec0 con 0x5620a0351ef0 2024-05-12T10:53:25.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21bf400640 10 client.4995 handle_command_reply: tid=0 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 1 client.4995 shutdown 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 1 -- 172.21.15.115:0/605525715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 msgr2=0x5620a0351180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0351180 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009e50 tx=0x7f21d801b270 comp rx=0 tx=0).stop 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 1 -- 172.21.15.115:0/605525715 shutdown_connections 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0351ef0 0x5620a03522d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0351180 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038dc90 0x5620a0377d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 1 --2- 172.21.15.115:0/605525715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a0377840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21bf400640 0 client.4995 ms_handle_reset on v2:172.21.15.115:6835/4177777929 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 1 -- 172.21.15.115:0/605525715 >> 172.21.15.115:0/605525715 conn(0x5620a0349370 msgr2=0x5620a0378880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 1 -- 172.21.15.115:0/605525715 shutdown_connections 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 1 -- 172.21.15.115:0/605525715 wait complete. 2024-05-12T10:53:25.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.961+0000 7f21e86f7000 20 client.4995 trim_cache size 0 max 16384 2024-05-12T10:53:25.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 Processor -- start 2024-05-12T10:53:25.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 -- start start 2024-05-12T10:53:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a03a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038dc90 0x5620a03a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038e5b0 0x5620a03ae720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f21e0201e50 con 0x5620a038dc90 2024-05-12T10:53:25.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21e01f9350 con 0x5620a037a1f0 2024-05-12T10:53:25.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f21e0201780 con 0x5620a038e5b0 2024-05-12T10:53:25.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21dd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038dc90 0x5620a03a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21dd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038dc90 0x5620a03a49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50944/0 (socket says 172.21.15.115:50944) 2024-05-12T10:53:25.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21dd400640 1 -- 172.21.15.115:0/862168201 learned_addr learned my addr 172.21.15.115:0/862168201 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21de800640 1 --2- 172.21.15.115:0/862168201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038e5b0 0x5620a03ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21dde00640 1 --2- 172.21.15.115:0/862168201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a03a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21dd400640 1 -- 172.21.15.115:0/862168201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038e5b0 msgr2=0x5620a03ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21dd400640 1 --2- 172.21.15.115:0/862168201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038e5b0 0x5620a03ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21dd400640 1 -- 172.21.15.115:0/862168201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 msgr2=0x5620a03a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21dd400640 1 --2- 172.21.15.115:0/862168201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a03a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21dd400640 1 -- 172.21.15.115:0/862168201 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620a038e3e0 con 0x5620a038dc90 2024-05-12T10:53:25.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21dd400640 1 --2- 172.21.15.115:0/862168201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038dc90 0x5620a03a49a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f21cc059390 tx=0x7f21cc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df03a96ed6c63c55 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21ca000640 1 -- 172.21.15.115:0/862168201 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc064e40 con 0x5620a038dc90 2024-05-12T10:53:25.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21ca000640 1 -- 172.21.15.115:0/862168201 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21cc060420 con 0x5620a038dc90 2024-05-12T10:53:25.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21ca000640 1 -- 172.21.15.115:0/862168201 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00be10 con 0x5620a038dc90 2024-05-12T10:53:25.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 -- 172.21.15.115:0/862168201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038dc90 msgr2=0x5620a03a49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 --2- 172.21.15.115:0/862168201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038dc90 0x5620a03a49a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f21cc059390 tx=0x7f21cc020000 comp rx=0 tx=0).stop 2024-05-12T10:53:25.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 -- 172.21.15.115:0/862168201 shutdown_connections 2024-05-12T10:53:25.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 --2- 172.21.15.115:0/862168201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a038e5b0 0x5620a03ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 --2- 172.21.15.115:0/862168201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038dc90 0x5620a03a49a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 --2- 172.21.15.115:0/862168201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a037a1f0 0x5620a03a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 -- 172.21.15.115:0/862168201 >> 172.21.15.115:0/862168201 conn(0x5620a0349370 msgr2=0x5620a03a3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 -- 172.21.15.115:0/862168201 shutdown_connections 2024-05-12T10:53:25.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.977+0000 7f21e86f7000 1 -- 172.21.15.115:0/862168201 wait complete. 2024-05-12T10:53:25.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 -- start start 2024-05-12T10:53:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 Processor -- start 2024-05-12T10:53:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a037a1f0 0x5620a03ae720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a038dc90 0x5620a03aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0406a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5620a0136ab0 con 0x5620a038e5b0 2024-05-12T10:53:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5620a0158b90 con 0x5620a038dc90 2024-05-12T10:53:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5620a01a0600 con 0x5620a037a1f0 2024-05-12T10:53:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 10 client.0 _ll_register_callbacks cb 0x7f21d8009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:53:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21de800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0406a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21de800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0406a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50958/0 (socket says 172.21.15.115:50958) 2024-05-12T10:53:25.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21de800640 1 -- 172.21.15.115:0/1700176828 learned_addr learned my addr 172.21.15.115:0/1700176828 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:25.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21dde00640 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a037a1f0 0x5620a03ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21dd400640 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a038dc90 0x5620a03aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21de800640 1 -- 172.21.15.115:0/1700176828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a037a1f0 msgr2=0x5620a03ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21de800640 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a037a1f0 0x5620a03ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21de800640 1 -- 172.21.15.115:0/1700176828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a038dc90 msgr2=0x5620a03aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:25.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21de800640 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a038dc90 0x5620a03aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21de800640 1 -- 172.21.15.115:0/1700176828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620a013b140 con 0x5620a038e5b0 2024-05-12T10:53:25.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21de800640 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0406a30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f21d8019640 tx=0x7f21d8009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770b4082ab457139 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:25.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21bf400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21bf400640 1 -- 172.21.15.115:0/1700176828 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d80a5810 con 0x5620a038e5b0 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21bf400640 1 -- 172.21.15.115:0/1700176828 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f21d8002050 con 0x5620a038e5b0 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 -- 172.21.15.115:0/1700176828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21cc060420 con 0x5620a038e5b0 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21bf400640 1 -- 172.21.15.115:0/1700176828 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f21d80db050 con 0x5620a038e5b0 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 10 client.5001 fetch_fsmap learned FSMap version 14 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 -- 172.21.15.115:0/1700176828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5620a013b8e0 con 0x5620a038e5b0 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21bf400640 1 -- 172.21.15.115:0/1700176828 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21cc060420 con 0x5620a038e5b0 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21bf400640 1 -- 172.21.15.115:0/1700176828 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f21d80de020 con 0x5620a038e5b0 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 10 client.5001 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 10 client.5001 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 20 client.5001 populate_metadata read hostname 'smithi115' 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0406f70 0x5620a0407380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 4 client.5001 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-5358179-1-mds.e.json"}] 2024-05-12T10:53:25.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21e86f7000 1 -- 172.21.15.115:0/1700176828 --> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-5358179-1-mds.e.json"}) -- 0x5620a0391800 con 0x5620a0406f70 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21dde00640 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0406f70 0x5620a0407380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21dde00640 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0406f70 0x5620a0407380 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a3b34dbc929ea318 server_cookie=dabe8c823cfed617 in_seq=0 out_seq=0 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.981+0000 7f21bf400640 10 client.5001 ms_handle_connect on v2:172.21.15.115:6835/4177777929 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21dde00640 1 -- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0406f70 msgr2=0x5620a0407380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21dde00640 1 -- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0406f70 msgr2=0x5620a0407380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21dde00640 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0406f70 0x5620a0407380 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21dde00640 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0406f70 0x5620a0407380 unknown :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21dde00640 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0406f70 0x5620a0407380 unknown :-1 s=BANNER_CONNECTING pgs=22 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21bf400640 10 client.5001 ms_handle_connect on v2:172.21.15.115:6835/4177777929 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21dde00640 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0406f70 0x5620a0407380 crc :-1 s=READY pgs=22 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a3b34dbc929ea318 server_cookie=dabe8c823cfed617 in_seq=0 out_seq=1 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21bf400640 1 -- 172.21.15.115:0/1700176828 <== mds.1 v2:172.21.15.115:6835/4177777929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+57 (crc 0 0 0) 0x5620a0391800 con 0x5620a0406f70 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21bf400640 10 client.5001 handle_command_reply: tid=0 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 1 client.5001 shutdown 2024-05-12T10:53:25.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 1 -- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 msgr2=0x5620a0406a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0406a30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f21d8019640 tx=0x7f21d8009810 comp rx=0 tx=0).stop 2024-05-12T10:53:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 1 -- 172.21.15.115:0/1700176828 shutdown_connections 2024-05-12T10:53:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:6835/4177777929,v1:172.21.15.115:6837/4177777929] conn(0x5620a0406f70 0x5620a0407380 crc :-1 s=READY pgs=22 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5620a038e5b0 0x5620a0406a30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620a038dc90 0x5620a03aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21bf400640 0 client.5001 ms_handle_reset on v2:172.21.15.115:6835/4177777929 2024-05-12T10:53:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 1 --2- 172.21.15.115:0/1700176828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5620a037a1f0 0x5620a03ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 1 -- 172.21.15.115:0/1700176828 >> 172.21.15.115:0/1700176828 conn(0x5620a0349370 msgr2=0x5620a03a45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 1 -- 172.21.15.115:0/1700176828 shutdown_connections 2024-05-12T10:53:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 1 -- 172.21.15.115:0/1700176828 wait complete. 2024-05-12T10:53:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e86f7000 20 client.5001 trim_cache size 0 max 16384 2024-05-12T10:53:25.991 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:53:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: "path": "/var/run/ceph/ops-5358179-1-mds.e.json" 2024-05-12T10:53:25.991 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 -- 172.21.15.115:0/3225835140 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f21c006f400 msgr2=0x7f21c00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f21c006f400 0x7f21c00718c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f21d0007fd0 tx=0x7f21d0009040 comp rx=0 tx=0).stop 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 -- 172.21.15.115:0/3225835140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e00cbba0 msgr2=0x7f21e00cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e00cbba0 0x7f21e00cc2c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00d830 tx=0x7f21cc00dcf0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 -- 172.21.15.115:0/3225835140 shutdown_connections 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f21c006f400 0x7f21c00718c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21e0153e90 0x7f21e00cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21e00cbba0 0x7f21e00cc2c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 --2- 172.21.15.115:0/3225835140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21e0071a30 0x7f21e00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 -- 172.21.15.115:0/3225835140 >> 172.21.15.115:0/3225835140 conn(0x7f21e0072050 msgr2=0x7f21e0159160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 -- 172.21.15.115:0/3225835140 shutdown_connections 2024-05-12T10:53:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:25.985+0000 7f21e5200640 1 -- 172.21.15.115:0/3225835140 wait complete. 2024-05-12T10:53:26.000 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 0 (b) to a remote file /var/run/ceph/ops-5358179-1-mds.b.json 2024-05-12T10:53:26.000 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 ops --flags=locks --path=/var/run/ceph/ops-5358179-1-mds.b.json 2024-05-12T10:53:26.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.141+0000 7f1e4b200640 1 Processor -- start 2024-05-12T10:53:26.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.141+0000 7f1e4b200640 1 -- start start 2024-05-12T10:53:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e4b200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1e4c0c8c30 0x7f1e4c0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e4b200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4c0cb1b0 0x7f1e4c15f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e4b200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4c0737c0 con 0x7f1e4c159110 2024-05-12T10:53:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e4b200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f1e4c074390 con 0x7f1e4c0c8c30 2024-05-12T10:53:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e4b200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4c071b50 con 0x7f1e4c0cb1b0 2024-05-12T10:53:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e49400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1e4c0c8c30 0x7f1e4c0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e49400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1e4c0c8c30 0x7f1e4c0cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50972/0 (socket says 172.21.15.115:50972) 2024-05-12T10:53:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e49400640 1 -- 172.21.15.115:0/4102337608 learned_addr learned my addr 172.21.15.115:0/4102337608 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e49e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1e4c159110 0x7f1e4c0710a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50792/0 (socket says 172.21.15.115:50792) 2024-05-12T10:53:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e4a800640 1 --2- 172.21.15.115:0/4102337608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4c0cb1b0 0x7f1e4c15f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e49400640 1 -- 172.21.15.115:0/4102337608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4c0cb1b0 msgr2=0x7f1e4c15f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e49400640 1 --2- 172.21.15.115:0/4102337608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4c0cb1b0 0x7f1e4c15f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e49400640 1 -- 172.21.15.115:0/4102337608 >> v1:172.21.15.115:6789/0 conn(0x7f1e4c159110 legacy=0x7f1e4c0710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e49400640 1 -- 172.21.15.115:0/4102337608 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c073a60 con 0x7f1e4c0c8c30 2024-05-12T10:53:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.145+0000 7f1e48a00640 1 -- 172.21.15.115:0/4102337608 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2795096907 0 0) 0x7f1e4c0737c0 con 0x7f1e4c159110 2024-05-12T10:53:26.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e49400640 1 --2- 172.21.15.115:0/4102337608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c0c8c30 0x7f1e4c0cac70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009870 tx=0x7f1e3801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49390abbdafc5e67 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:26.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e48a00640 1 -- 172.21.15.115:0/4102337608 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380b2070 con 0x7f1e4c0c8c30 2024-05-12T10:53:26.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e48a00640 1 -- 172.21.15.115:0/4102337608 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e380a9070 con 0x7f1e4c0c8c30 2024-05-12T10:53:26.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e48a00640 1 -- 172.21.15.115:0/4102337608 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380ad880 con 0x7f1e4c0c8c30 2024-05-12T10:53:26.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 -- 172.21.15.115:0/4102337608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c0c8c30 msgr2=0x7f1e4c0cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:26.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 --2- 172.21.15.115:0/4102337608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c0c8c30 0x7f1e4c0cac70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009870 tx=0x7f1e3801c560 comp rx=0 tx=0).stop 2024-05-12T10:53:26.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 -- 172.21.15.115:0/4102337608 shutdown_connections 2024-05-12T10:53:26.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 --2- 172.21.15.115:0/4102337608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4c0cb1b0 0x7f1e4c15f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 --2- 172.21.15.115:0/4102337608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c0c8c30 0x7f1e4c0cac70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 -- 172.21.15.115:0/4102337608 >> 172.21.15.115:0/4102337608 conn(0x7f1e4c06f7c0 msgr2=0x7f1e4c06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:26.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 -- 172.21.15.115:0/4102337608 shutdown_connections 2024-05-12T10:53:26.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 -- 172.21.15.115:0/4102337608 wait complete. 2024-05-12T10:53:26.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 Processor -- start 2024-05-12T10:53:26.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 -- start start 2024-05-12T10:53:26.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4c0c8c30 0x7f1e4c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c0cb1b0 0x7f1e4c0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4c159110 0x7f1e4c147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c071930 con 0x7f1e4c0cb1b0 2024-05-12T10:53:26.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0717b0 con 0x7f1e4c0c8c30 2024-05-12T10:53:26.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e4b200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4c1594f0 con 0x7f1e4c159110 2024-05-12T10:53:26.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.149+0000 7f1e49400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c0cb1b0 0x7f1e4c0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e49400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c0cb1b0 0x7f1e4c0cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50986/0 (socket says 172.21.15.115:50986) 2024-05-12T10:53:26.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e49400640 1 -- 172.21.15.115:0/1716581 learned_addr learned my addr 172.21.15.115:0/1716581 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:26.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e49e00640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4c0c8c30 0x7f1e4c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e4a800640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4c159110 0x7f1e4c147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e49400640 1 -- 172.21.15.115:0/1716581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4c159110 msgr2=0x7f1e4c147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:26.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e49400640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4c159110 0x7f1e4c147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e49400640 1 -- 172.21.15.115:0/1716581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4c0c8c30 msgr2=0x7f1e4c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:26.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e49400640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4c0c8c30 0x7f1e4c0ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e49400640 1 -- 172.21.15.115:0/1716581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c14a600 con 0x7f1e4c0cb1b0 2024-05-12T10:53:26.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e49400640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c0cb1b0 0x7f1e4c0cdc60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1e380b0040 tx=0x7f1e3801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:26.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e42000640 1 -- 172.21.15.115:0/1716581 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380bc020 con 0x7f1e4c0cb1b0 2024-05-12T10:53:26.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e42000640 1 -- 172.21.15.115:0/1716581 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e380ade30 con 0x7f1e4c0cb1b0 2024-05-12T10:53:26.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e42000640 1 -- 172.21.15.115:0/1716581 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380b2040 con 0x7f1e4c0cb1b0 2024-05-12T10:53:26.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e4b200640 1 -- 172.21.15.115:0/1716581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c14a8a0 con 0x7f1e4c0cb1b0 2024-05-12T10:53:26.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e4b200640 1 -- 172.21.15.115:0/1716581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c1f51f0 con 0x7f1e4c0cb1b0 2024-05-12T10:53:26.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.153+0000 7f1e42000640 1 -- 172.21.15.115:0/1716581 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1e380bf020 con 0x7f1e4c0cb1b0 2024-05-12T10:53:26.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e42000640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f1e2c06f400 0x7f1e2c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e42000640 1 -- 172.21.15.115:0/1716581 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f1e381298b0 con 0x7f1e4c0cb1b0 2024-05-12T10:53:26.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 Processor -- start 2024-05-12T10:53:26.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e49e00640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f1e2c06f400 0x7f1e2c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 -- start start 2024-05-12T10:53:26.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e49e00640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f1e2c06f400 0x7f1e2c0718c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c000f70 tx=0x7f1e3c007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:26.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x557574792c90 0x557574793070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575747935b0 0x55757477ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5575745588a0 con 0x55757477f1f0 2024-05-12T10:53:26.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5575745a62f0 con 0x5575747935b0 2024-05-12T10:53:26.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55757453fef0 con 0x557574792c90 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e4a800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e4a800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51000/0 (socket says 172.21.15.115:51000) 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e4a800640 1 -- 172.21.15.115:0/466779491 learned_addr learned my addr 172.21.15.115:0/466779491 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e49400640 1 --2- 172.21.15.115:0/466779491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575747935b0 0x55757477ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e49e00640 1 --2- 172.21.15.115:0/466779491 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x557574792c90 0x557574793070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e4a800640 1 -- 172.21.15.115:0/466779491 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x557574792c90 msgr2=0x557574793070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e4a800640 1 --2- 172.21.15.115:0/466779491 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x557574792c90 0x557574793070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e4a800640 1 -- 172.21.15.115:0/466779491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575747935b0 msgr2=0x55757477ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e4a800640 1 --2- 172.21.15.115:0/466779491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575747935b0 0x55757477ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e4a800640 1 -- 172.21.15.115:0/466779491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575745eb800 con 0x55757477f1f0 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e4a800640 1 --2- 172.21.15.115:0/466779491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477f5d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1e44007400 tx=0x7f1e440078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654e94d87ee3803e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e36a00640 1 -- 172.21.15.115:0/466779491 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440147e0 con 0x55757477f1f0 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e36a00640 1 -- 172.21.15.115:0/466779491 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4401a070 con 0x55757477f1f0 2024-05-12T10:53:26.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e36a00640 1 -- 172.21.15.115:0/466779491 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44014ba0 con 0x55757477f1f0 2024-05-12T10:53:26.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 -- 172.21.15.115:0/466779491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 msgr2=0x55757477f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:26.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 --2- 172.21.15.115:0/466779491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477f5d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1e44007400 tx=0x7f1e440078c0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 -- 172.21.15.115:0/466779491 shutdown_connections 2024-05-12T10:53:26.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 --2- 172.21.15.115:0/466779491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477f5d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 --2- 172.21.15.115:0/466779491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575747935b0 0x55757477ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 --2- 172.21.15.115:0/466779491 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x557574792c90 0x557574793070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.157+0000 7f1e545a2000 1 -- 172.21.15.115:0/466779491 >> 172.21.15.115:0/466779491 conn(0x55757474e370 msgr2=0x557574795e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:26.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 -- 172.21.15.115:0/466779491 shutdown_connections 2024-05-12T10:53:26.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 -- 172.21.15.115:0/466779491 wait complete. 2024-05-12T10:53:26.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 -- start start 2024-05-12T10:53:26.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 Processor -- start 2024-05-12T10:53:26.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557574792c90 0x55757477cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5575747935b0 0x557574756180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5575745b36f0 con 0x55757477f1f0 2024-05-12T10:53:26.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557574562b80 con 0x557574792c90 2024-05-12T10:53:26.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x557574570d80 con 0x5575747935b0 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 10 client.0 _ll_register_callbacks cb 0x557574741dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51006/0 (socket says 172.21.15.115:51006) 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e49e00640 1 -- 172.21.15.115:0/3010452872 learned_addr learned my addr 172.21.15.115:0/3010452872 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e49400640 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557574792c90 0x55757477cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e4a800640 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5575747935b0 0x557574756180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e49e00640 1 -- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5575747935b0 msgr2=0x557574756180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e49e00640 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5575747935b0 0x557574756180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e49e00640 1 -- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557574792c90 msgr2=0x55757477cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e49e00640 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557574792c90 0x55757477cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e49e00640 1 -- 172.21.15.115:0/3010452872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557574582f20 con 0x55757477f1f0 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e49e00640 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477c840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c001cb0 tx=0x7f1e3c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b61accce5c00ac server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e2b400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:53:26.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e2b400640 1 -- 172.21.15.115:0/3010452872 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c027060 con 0x55757477f1f0 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 -- 172.21.15.115:0/3010452872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e4401a070 con 0x55757477f1f0 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e2b400640 1 -- 172.21.15.115:0/3010452872 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f1e3c010040 con 0x55757477f1f0 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e2b400640 1 -- 172.21.15.115:0/3010452872 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f1e3c005e20 con 0x55757477f1f0 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 10 client.5016 fetch_fsmap learned FSMap version 14 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 -- 172.21.15.115:0/3010452872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x557574544b60 con 0x55757477f1f0 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e2b400640 1 -- 172.21.15.115:0/3010452872 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4401a070 con 0x55757477f1f0 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e2b400640 1 -- 172.21.15.115:0/3010452872 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f1e3c015110 con 0x55757477f1f0 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 10 client.5016 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 10 client.5016 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 20 client.5016 populate_metadata read hostname 'smithi115' 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x557574756ec0 0x5575747572a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 4 client.5016 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:53:26.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.161+0000 7f1e545a2000 1 -- 172.21.15.115:0/3010452872 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55757453eec0 con 0x557574756ec0 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e49400640 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x557574756ec0 0x5575747572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e2b400640 10 client.5016 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e49400640 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x557574756ec0 0x5575747572a0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e322a7e66406b49 server_cookie=5d73d8a44b5a3382 in_seq=0 out_seq=0 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e2b400640 1 -- 172.21.15.115:0/3010452872 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55757453eec0 con 0x557574756ec0 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e2b400640 10 client.5016 handle_command_reply: tid=0 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 1 client.5016 shutdown 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 1 -- 172.21.15.115:0/3010452872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 msgr2=0x55757477c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477c840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c001cb0 tx=0x7f1e3c011000 comp rx=0 tx=0).stop 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 1 -- 172.21.15.115:0/3010452872 shutdown_connections 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5575747935b0 0x557574756180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x557574756ec0 0x5575747572a0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557574792c90 0x55757477cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3010452872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x55757477c840 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e2b400640 0 client.5016 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:53:26.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 1 -- 172.21.15.115:0/3010452872 >> 172.21.15.115:0/3010452872 conn(0x55757474e370 msgr2=0x55757477d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:26.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 1 -- 172.21.15.115:0/3010452872 shutdown_connections 2024-05-12T10:53:26.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 1 -- 172.21.15.115:0/3010452872 wait complete. 2024-05-12T10:53:26.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.165+0000 7f1e545a2000 20 client.5016 trim_cache size 0 max 16384 2024-05-12T10:53:26.178 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.181+0000 7f1e545a2000 1 Processor -- start 2024-05-12T10:53:26.178 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.181+0000 7f1e545a2000 1 -- start start 2024-05-12T10:53:26.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x5575747b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x557574792c90 0x5575747a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575747935b0 0x5575747a9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c201740 con 0x55757477f1f0 2024-05-12T10:53:26.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c149610 con 0x5575747935b0 2024-05-12T10:53:26.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4c201090 con 0x557574792c90 2024-05-12T10:53:26.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x5575747b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e4a800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575747935b0 0x5575747a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e49400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x557574792c90 0x5575747a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x5575747b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51008/0 (socket says 172.21.15.115:51008) 2024-05-12T10:53:26.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e49e00640 1 -- 172.21.15.115:0/24236222 learned_addr learned my addr 172.21.15.115:0/24236222 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:26.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e49e00640 1 -- 172.21.15.115:0/24236222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x557574792c90 msgr2=0x5575747a8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:26.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e49e00640 1 --2- 172.21.15.115:0/24236222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x557574792c90 0x5575747a8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e49e00640 1 -- 172.21.15.115:0/24236222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575747935b0 msgr2=0x5575747a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:26.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e49e00640 1 --2- 172.21.15.115:0/24236222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575747935b0 0x5575747a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e49e00640 1 -- 172.21.15.115:0/24236222 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575747933e0 con 0x55757477f1f0 2024-05-12T10:53:26.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e49e00640 1 --2- 172.21.15.115:0/24236222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x5575747b3930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c005df0 tx=0x7f1e3c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7643708eb21977e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:26.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e36000640 1 -- 172.21.15.115:0/24236222 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c001910 con 0x55757477f1f0 2024-05-12T10:53:26.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e36000640 1 -- 172.21.15.115:0/24236222 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c0150c0 con 0x55757477f1f0 2024-05-12T10:53:26.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e36000640 1 -- 172.21.15.115:0/24236222 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c022680 con 0x55757477f1f0 2024-05-12T10:53:26.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 -- 172.21.15.115:0/24236222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 msgr2=0x5575747b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:26.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 --2- 172.21.15.115:0/24236222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x5575747b3930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c005df0 tx=0x7f1e3c013000 comp rx=0 tx=0).stop 2024-05-12T10:53:26.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 -- 172.21.15.115:0/24236222 shutdown_connections 2024-05-12T10:53:26.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 --2- 172.21.15.115:0/24236222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5575747935b0 0x5575747a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 --2- 172.21.15.115:0/24236222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x557574792c90 0x5575747a8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 --2- 172.21.15.115:0/24236222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55757477f1f0 0x5575747b3930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 -- 172.21.15.115:0/24236222 >> 172.21.15.115:0/24236222 conn(0x55757474e370 msgr2=0x55757477fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:26.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 -- 172.21.15.115:0/24236222 shutdown_connections 2024-05-12T10:53:26.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 -- 172.21.15.115:0/24236222 wait complete. 2024-05-12T10:53:26.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 -- start start 2024-05-12T10:53:26.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.185+0000 7f1e545a2000 1 Processor -- start 2024-05-12T10:53:26.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557574792c90 0x557574753b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5575747935b0 0x557574754090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5575747af720 0x5575747afb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55757453bab0 con 0x5575747af720 2024-05-12T10:53:26.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55757455db90 con 0x557574792c90 2024-05-12T10:53:26.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5575745a5600 con 0x5575747935b0 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 10 client.0 _ll_register_callbacks cb 0x7f1e3c007e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e4a800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5575747af720 0x5575747afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e4a800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5575747af720 0x5575747afb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51022/0 (socket says 172.21.15.115:51022) 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e4a800640 1 -- 172.21.15.115:0/3864329012 learned_addr learned my addr 172.21.15.115:0/3864329012 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e49400640 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5575747935b0 0x557574754090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e49e00640 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557574792c90 0x557574753b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e4a800640 1 -- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5575747935b0 msgr2=0x557574754090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e4a800640 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5575747935b0 0x557574754090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e4a800640 1 -- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557574792c90 msgr2=0x557574753b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e4a800640 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557574792c90 0x557574753b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e4a800640 1 -- 172.21.15.115:0/3864329012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557574540140 con 0x5575747af720 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e49400640 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5575747935b0 0x557574754090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e4a800640 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5575747af720 0x5575747afb00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1e44008010 tx=0x7f1e44012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432e8acdbc7c9369 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:26.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e2b400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e2b400640 1 -- 172.21.15.115:0/3864329012 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4402d060 con 0x5575747af720 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 1 -- 172.21.15.115:0/3864329012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e3c0150c0 con 0x5575747af720 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e2b400640 1 -- 172.21.15.115:0/3864329012 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f1e44015470 con 0x5575747af720 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e2b400640 1 -- 172.21.15.115:0/3864329012 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f1e44033050 con 0x5575747af720 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 10 client.5022 fetch_fsmap learned FSMap version 14 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 1 -- 172.21.15.115:0/3864329012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5575745408e0 con 0x5575747af720 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e2b400640 1 -- 172.21.15.115:0/3864329012 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c0150c0 con 0x5575747af720 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e2b400640 1 -- 172.21.15.115:0/3864329012 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f1e44036020 con 0x5575747af720 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 10 client.5022 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 10 client.5022 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 20 client.5022 populate_metadata read hostname 'smithi115' 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5575747b0040 0x5575748194a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:26.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 4 client.5022 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-5358179-1-mds.b.json"}] 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.189+0000 7f1e545a2000 1 -- 172.21.15.115:0/3864329012 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-5358179-1-mds.b.json"}) -- 0x557574796800 con 0x5575747b0040 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e49e00640 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5575747b0040 0x5575748194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e2b400640 10 client.5022 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e49e00640 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5575747b0040 0x5575748194a0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b02af5dbe83d677d server_cookie=18149ed8033eccca in_seq=0 out_seq=0 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e2b400640 1 -- 172.21.15.115:0/3864329012 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+57 (crc 0 0 0) 0x557574796800 con 0x5575747b0040 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e2b400640 10 client.5022 handle_command_reply: tid=0 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 1 client.5022 shutdown 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 1 -- 172.21.15.115:0/3864329012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5575747af720 msgr2=0x5575747afb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5575747af720 0x5575747afb00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1e44008010 tx=0x7f1e44012000 comp rx=0 tx=0).stop 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 1 -- 172.21.15.115:0/3864329012 shutdown_connections 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5575747af720 0x5575747afb00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5575747935b0 0x557574754090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5575747b0040 0x5575748194a0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 1 --2- 172.21.15.115:0/3864329012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557574792c90 0x557574753b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 1 -- 172.21.15.115:0/3864329012 >> 172.21.15.115:0/3864329012 conn(0x55757474e370 msgr2=0x55757477f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:26.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e2b400640 0 client.5022 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:53:26.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 1 -- 172.21.15.115:0/3864329012 shutdown_connections 2024-05-12T10:53:26.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 1 -- 172.21.15.115:0/3864329012 wait complete. 2024-05-12T10:53:26.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e545a2000 20 client.5022 trim_cache size 0 max 16384 2024-05-12T10:53:26.196 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:53:26.196 INFO:teuthology.orchestra.run.smithi115.stdout: "path": "/var/run/ceph/ops-5358179-1-mds.b.json" 2024-05-12T10:53:26.196 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:53:26.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e4b200640 1 -- 172.21.15.115:0/1716581 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f1e2c06f400 msgr2=0x7f1e2c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:26.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e4b200640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f1e2c06f400 0x7f1e2c0718c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c000f70 tx=0x7f1e3c007c10 comp rx=0 tx=0).stop 2024-05-12T10:53:26.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.193+0000 7f1e4b200640 1 -- 172.21.15.115:0/1716581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c0cb1b0 msgr2=0x7f1e4c0cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:26.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.197+0000 7f1e4b200640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c0cb1b0 0x7f1e4c0cdc60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1e380b0040 tx=0x7f1e3801ada0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.197+0000 7f1e4b200640 1 -- 172.21.15.115:0/1716581 shutdown_connections 2024-05-12T10:53:26.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.197+0000 7f1e4b200640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f1e2c06f400 0x7f1e2c0718c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.197+0000 7f1e4b200640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4c159110 0x7f1e4c147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.197+0000 7f1e4b200640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4c0cb1b0 0x7f1e4c0cdc60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.197+0000 7f1e4b200640 1 --2- 172.21.15.115:0/1716581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e4c0c8c30 0x7f1e4c0ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:26.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.197+0000 7f1e4b200640 1 -- 172.21.15.115:0/1716581 >> 172.21.15.115:0/1716581 conn(0x7f1e4c06f7c0 msgr2=0x7f1e4c1534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:26.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.197+0000 7f1e4b200640 1 -- 172.21.15.115:0/1716581 shutdown_connections 2024-05-12T10:53:26.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:26.197+0000 7f1e4b200640 1 -- 172.21.15.115:0/1716581 wait complete. 2024-05-12T10:53:26.212 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-05-12T10:53:26.219 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.id5N9oX4oZ 2024-05-12T10:53:26.220 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /var/run/ceph/ops-5358179-1-mds.a.json /tmp/tmp.id5N9oX4oZ 2024-05-12T10:53:26.282 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.id5N9oX4oZ 2024-05-12T10:53:26.394 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.id5N9oX4oZ is 4KB 2024-05-12T10:53:26.409 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.id5N9oX4oZ 2024-05-12T10:53:26.417 DEBUG:tasks.quiescer.fs.[cephfs]:read 3595B of ops from '/var/run/ceph/ops-5358179-1-mds.a.json' on mds.2 (a) 2024-05-12T10:53:26.419 INFO:tasks.quiescer.fs.[cephfs]:Pulled 2 ops from rank 2 (a) into home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/ops-5358179-1-mds.a.json 2024-05-12T10:53:26.419 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -- /var/run/ceph/ops-5358179-1-mds.a.json 2024-05-12T10:53:26.477 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-05-12T10:53:26.526 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.ikPQcT97xu 2024-05-12T10:53:26.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /var/run/ceph/ops-5358179-1-mds.e.json /tmp/tmp.ikPQcT97xu 2024-05-12T10:53:26.585 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.ikPQcT97xu 2024-05-12T10:53:26.699 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.ikPQcT97xu is 3KB 2024-05-12T10:53:26.714 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.ikPQcT97xu 2024-05-12T10:53:26.725 DEBUG:tasks.quiescer.fs.[cephfs]:read 3337B of ops from '/var/run/ceph/ops-5358179-1-mds.e.json' on mds.1 (e) 2024-05-12T10:53:26.726 INFO:tasks.quiescer.fs.[cephfs]:Pulled 2 ops from rank 1 (e) into home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/ops-5358179-1-mds.e.json 2024-05-12T10:53:26.727 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -- /var/run/ceph/ops-5358179-1-mds.e.json 2024-05-12T10:53:26.789 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-05-12T10:53:26.795 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.uEfios9VOq 2024-05-12T10:53:26.795 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /var/run/ceph/ops-5358179-1-mds.b.json /tmp/tmp.uEfios9VOq 2024-05-12T10:53:26.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.uEfios9VOq 2024-05-12T10:53:26.959 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.uEfios9VOq is 4KB 2024-05-12T10:53:26.973 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.uEfios9VOq 2024-05-12T10:53:26.977 DEBUG:tasks.quiescer.fs.[cephfs]:read 3718B of ops from '/var/run/ceph/ops-5358179-1-mds.b.json' on mds.0 (b) 2024-05-12T10:53:26.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 5358179-1: 'internal op quiesce_path:mds.0:7 fp=#0x1 continuous want_bypass_freezing' 2024-05-12T10:53:26.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 5358179-1: 'internal op quiesce_inode:mds.0:8 fp=#0x1 continuous want_bypass_freezing' 2024-05-12T10:53:26.982 INFO:tasks.quiescer.fs.[cephfs]:Pulled 2 ops from rank 0 (b) into home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/ops-5358179-1-mds.b.json 2024-05-12T10:53:26.982 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -- /var/run/ceph/ops-5358179-1-mds.b.json 2024-05-12T10:53:27.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:53:27.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.169+0000 7ff8ca200640 1 Processor -- start 2024-05-12T10:53:27.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.169+0000 7ff8ca200640 1 -- start start 2024-05-12T10:53:27.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.169+0000 7ff8ca200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8c4153f60 0x7ff8c40c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.169+0000 7ff8ca200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff8c40ca660 0x7ff8c4159e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.169+0000 7ff8ca200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c415da10 con 0x7ff8c4153b80 2024-05-12T10:53:27.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.169+0000 7ff8ca200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7ff8c40b2160 con 0x7ff8c40ca660 2024-05-12T10:53:27.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.169+0000 7ff8ca200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c40c4510 con 0x7ff8c4153f60 2024-05-12T10:53:27.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.169+0000 7ff8c9800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff8c40ca660 0x7ff8c4159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.169+0000 7ff8c9800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff8c40ca660 0x7ff8c4159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51024/0 (socket says 172.21.15.115:51024) 2024-05-12T10:53:27.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.169+0000 7ff8c9800640 1 -- 172.21.15.115:0/753246103 learned_addr learned my addr 172.21.15.115:0/753246103 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:27.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8c3e00640 1 --2- 172.21.15.115:0/753246103 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8c4153f60 0x7ff8c40c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8c9800640 1 -- 172.21.15.115:0/753246103 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8c4153f60 msgr2=0x7ff8c40c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:27.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8c9800640 1 --2- 172.21.15.115:0/753246103 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8c4153f60 0x7ff8c40c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8c9800640 1 -- 172.21.15.115:0/753246103 >> v1:172.21.15.134:6789/0 conn(0x7ff8c4153b80 legacy=0x7ff8c4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8c9800640 1 -- 172.21.15.115:0/753246103 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c415dcf0 con 0x7ff8c40ca660 2024-05-12T10:53:27.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8c9800640 1 --2- 172.21.15.115:0/753246103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8c40ca660 0x7ff8c4159e40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009e50 tx=0x7ff8bc01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fc31b450598e3c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:27.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8c3400640 1 -- 172.21.15.115:0/753246103 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0b4070 con 0x7ff8c40ca660 2024-05-12T10:53:27.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8c3400640 1 -- 172.21.15.115:0/753246103 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8bc0af400 con 0x7ff8c40ca660 2024-05-12T10:53:27.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8c3400640 1 -- 172.21.15.115:0/753246103 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0af7d0 con 0x7ff8c40ca660 2024-05-12T10:53:27.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8ca200640 1 -- 172.21.15.115:0/753246103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8c40ca660 msgr2=0x7ff8c4159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8ca200640 1 --2- 172.21.15.115:0/753246103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8c40ca660 0x7ff8c4159e40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009e50 tx=0x7ff8bc01f210 comp rx=0 tx=0).stop 2024-05-12T10:53:27.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8ca200640 1 -- 172.21.15.115:0/753246103 shutdown_connections 2024-05-12T10:53:27.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8ca200640 1 --2- 172.21.15.115:0/753246103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8c40ca660 0x7ff8c4159e40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8ca200640 1 --2- 172.21.15.115:0/753246103 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8c4153f60 0x7ff8c40c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.173+0000 7ff8ca200640 1 -- 172.21.15.115:0/753246103 >> 172.21.15.115:0/753246103 conn(0x7ff8c4071780 msgr2=0x7ff8c4076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:27.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 -- 172.21.15.115:0/753246103 shutdown_connections 2024-05-12T10:53:27.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 -- 172.21.15.115:0/753246103 wait complete. 2024-05-12T10:53:27.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 Processor -- start 2024-05-12T10:53:27.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 -- start start 2024-05-12T10:53:27.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8c40ca660 0x7ff8c41f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8c4153b80 0x7ff8c41f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8c4153f60 0x7ff8c40ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4072530 con 0x7ff8c4153f60 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c40c4a40 con 0x7ff8c40ca660 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c40726b0 con 0x7ff8c4153b80 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8c4153f60 0x7ff8c40ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8c4153f60 0x7ff8c40ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51036/0 (socket says 172.21.15.115:51036) 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c9800640 1 -- 172.21.15.115:0/3899478666 learned_addr learned my addr 172.21.15.115:0/3899478666 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c8e00640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8c40ca660 0x7ff8c41f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c3e00640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8c4153b80 0x7ff8c41f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c9800640 1 -- 172.21.15.115:0/3899478666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8c4153b80 msgr2=0x7ff8c41f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c9800640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8c4153b80 0x7ff8c41f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c9800640 1 -- 172.21.15.115:0/3899478666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8c40ca660 msgr2=0x7ff8c41f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c9800640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8c40ca660 0x7ff8c41f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c9800640 1 -- 172.21.15.115:0/3899478666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c40ce900 con 0x7ff8c4153f60 2024-05-12T10:53:27.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c9800640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8c4153f60 0x7ff8c40ce3c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc01ce40 tx=0x7ff8bc01bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:27.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c0c00640 1 -- 172.21.15.115:0/3899478666 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0be020 con 0x7ff8c4153f60 2024-05-12T10:53:27.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c0c00640 1 -- 172.21.15.115:0/3899478666 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8bc0090d0 con 0x7ff8c4153f60 2024-05-12T10:53:27.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8c0c00640 1 -- 172.21.15.115:0/3899478666 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0b4040 con 0x7ff8c4153f60 2024-05-12T10:53:27.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 -- 172.21.15.115:0/3899478666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c41f1770 con 0x7ff8c4153f60 2024-05-12T10:53:27.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.177+0000 7ff8ca200640 1 -- 172.21.15.115:0/3899478666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c40cd820 con 0x7ff8c4153f60 2024-05-12T10:53:27.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.181+0000 7ff8ca200640 1 -- 172.21.15.115:0/3899478666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c4050750 con 0x7ff8c4153f60 2024-05-12T10:53:27.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.181+0000 7ff8c0c00640 1 -- 172.21.15.115:0/3899478666 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff8bc0a8d10 con 0x7ff8c4153f60 2024-05-12T10:53:27.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.181+0000 7ff8c0c00640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8a406f400 0x7ff8a40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.181+0000 7ff8c0c00640 1 -- 172.21.15.115:0/3899478666 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff8bc12d080 con 0x7ff8c4153f60 2024-05-12T10:53:27.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.181+0000 7ff8c8e00640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8a406f400 0x7ff8a40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.178 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.181+0000 7ff8c8e00640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8a406f400 0x7ff8a40718c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80016f0 tx=0x7ff8b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:27.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.185+0000 7ff8c0c00640 1 -- 172.21.15.115:0/3899478666 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff8bc0c8060 con 0x7ff8c4153f60 2024-05-12T10:53:27.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.385+0000 7ff8ca200640 1 -- 172.21.15.115:0/3899478666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8c4072310 con 0x7ff8c4153f60 2024-05-12T10:53:27.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.385+0000 7ff8c0c00640 1 -- 172.21.15.115:0/3899478666 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7ff8c41f1770 con 0x7ff8c4153f60 2024-05-12T10:53:27.382 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:53:27.382 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:53:27.383 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:53:27.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 -- 172.21.15.115:0/3899478666 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8a406f400 msgr2=0x7ff8a40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8a406f400 0x7ff8a40718c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80016f0 tx=0x7ff8b8009040 comp rx=0 tx=0).stop 2024-05-12T10:53:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 -- 172.21.15.115:0/3899478666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8c4153f60 msgr2=0x7ff8c40ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8c4153f60 0x7ff8c40ce3c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc01ce40 tx=0x7ff8bc01bfb0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 -- 172.21.15.115:0/3899478666 shutdown_connections 2024-05-12T10:53:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff8a406f400 0x7ff8a40718c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8c4153f60 0x7ff8c40ce3c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8c4153b80 0x7ff8c41f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 --2- 172.21.15.115:0/3899478666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8c40ca660 0x7ff8c41f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 -- 172.21.15.115:0/3899478666 >> 172.21.15.115:0/3899478666 conn(0x7ff8c4071780 msgr2=0x7ff8c4158300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 -- 172.21.15.115:0/3899478666 shutdown_connections 2024-05-12T10:53:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.389+0000 7ff8ca200640 1 -- 172.21.15.115:0/3899478666 wait complete. 2024-05-12T10:53:27.404 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db --set-id 5358179 --await-for 42.0' 2024-05-12T10:53:27.405 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db --set-id 5358179 --await-for 42.0 2024-05-12T10:53:27.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.553+0000 7f21b1a00640 1 Processor -- start 2024-05-12T10:53:27.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.553+0000 7f21b1a00640 1 -- start start 2024-05-12T10:53:27.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21b1a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f21ac155d50 0x7f21ac0ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21b1a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21ac06e0e0 0x7f21ac0cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21b1a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac0ca100 con 0x7f21ac0c4300 2024-05-12T10:53:27.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21b1a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f21ac070a40 con 0x7f21ac155d50 2024-05-12T10:53:27.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21b1a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f21ac071000 con 0x7f21ac06e0e0 2024-05-12T10:53:27.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21abe00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f21ac155d50 0x7f21ac0ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21abe00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f21ac155d50 0x7f21ac0ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51042/0 (socket says 172.21.15.115:51042) 2024-05-12T10:53:27.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21abe00640 1 -- 172.21.15.115:0/2758508769 learned_addr learned my addr 172.21.15.115:0/2758508769 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:27.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21b1000640 1 --2- 172.21.15.115:0/2758508769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21ac06e0e0 0x7f21ac0cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21abe00640 1 -- 172.21.15.115:0/2758508769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21ac06e0e0 msgr2=0x7f21ac0cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:27.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21abe00640 1 --2- 172.21.15.115:0/2758508769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21ac06e0e0 0x7f21ac0cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21abe00640 1 -- 172.21.15.115:0/2758508769 >> v1:172.21.15.134:6789/0 conn(0x7f21ac0c4300 legacy=0x7f21ac06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:27.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.557+0000 7f21abe00640 1 -- 172.21.15.115:0/2758508769 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac0716c0 con 0x7f21ac155d50 2024-05-12T10:53:27.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21abe00640 1 --2- 172.21.15.115:0/2758508769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ac155d50 0x7f21ac0ca350 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f219c009870 tx=0x7f219c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5bf943d7274e3b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:27.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21aaa00640 1 -- 172.21.15.115:0/2758508769 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0ab5f0 con 0x7f21ac155d50 2024-05-12T10:53:27.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21aaa00640 1 -- 172.21.15.115:0/2758508769 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c0b0070 con 0x7f21ac155d50 2024-05-12T10:53:27.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21aaa00640 1 -- 172.21.15.115:0/2758508769 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0ab9b0 con 0x7f21ac155d50 2024-05-12T10:53:27.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 -- 172.21.15.115:0/2758508769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ac155d50 msgr2=0x7f21ac0ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 --2- 172.21.15.115:0/2758508769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ac155d50 0x7f21ac0ca350 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f219c009870 tx=0x7f219c01c560 comp rx=0 tx=0).stop 2024-05-12T10:53:27.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 -- 172.21.15.115:0/2758508769 shutdown_connections 2024-05-12T10:53:27.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 --2- 172.21.15.115:0/2758508769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21ac06e0e0 0x7f21ac0cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 --2- 172.21.15.115:0/2758508769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ac155d50 0x7f21ac0ca350 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 -- 172.21.15.115:0/2758508769 >> 172.21.15.115:0/2758508769 conn(0x7f21ac076830 msgr2=0x7f21ac0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:27.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 -- 172.21.15.115:0/2758508769 shutdown_connections 2024-05-12T10:53:27.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 -- 172.21.15.115:0/2758508769 wait complete. 2024-05-12T10:53:27.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 Processor -- start 2024-05-12T10:53:27.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 -- start start 2024-05-12T10:53:27.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21ac06e0e0 0x7f21ac0cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21ac0c4300 0x7f21ac1f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ac155d50 0x7f21ac143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac0c9ce0 con 0x7f21ac155d50 2024-05-12T10:53:27.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac156130 con 0x7f21ac0c4300 2024-05-12T10:53:27.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f21ac0c9e60 con 0x7f21ac06e0e0 2024-05-12T10:53:27.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ac155d50 0x7f21ac143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ac155d50 0x7f21ac143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51048/0 (socket says 172.21.15.115:51048) 2024-05-12T10:53:27.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21b1000640 1 -- 172.21.15.115:0/3483253413 learned_addr learned my addr 172.21.15.115:0/3483253413 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:27.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21abe00640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21ac06e0e0 0x7f21ac0cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.561+0000 7f21ab400640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21ac0c4300 0x7f21ac1f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21b1000640 1 -- 172.21.15.115:0/3483253413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21ac06e0e0 msgr2=0x7f21ac0cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21b1000640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21ac06e0e0 0x7f21ac0cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21b1000640 1 -- 172.21.15.115:0/3483253413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21ac0c4300 msgr2=0x7f21ac1f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21b1000640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21ac0c4300 0x7f21ac1f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21b1000640 1 -- 172.21.15.115:0/3483253413 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac145d90 con 0x7f21ac155d50 2024-05-12T10:53:27.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21b1000640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ac155d50 0x7f21ac143ff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f21a400cc30 tx=0x7f21a400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:27.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21a3e00640 1 -- 172.21.15.115:0/3483253413 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a400ce40 con 0x7f21ac155d50 2024-05-12T10:53:27.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21a3e00640 1 -- 172.21.15.115:0/3483253413 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a40039a0 con 0x7f21ac155d50 2024-05-12T10:53:27.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21b1a00640 1 -- 172.21.15.115:0/3483253413 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ac146070 con 0x7f21ac155d50 2024-05-12T10:53:27.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21a3e00640 1 -- 172.21.15.115:0/3483253413 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4003d50 con 0x7f21ac155d50 2024-05-12T10:53:27.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21b1a00640 1 -- 172.21.15.115:0/3483253413 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ac15b640 con 0x7f21ac155d50 2024-05-12T10:53:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21a3e00640 1 -- 172.21.15.115:0/3483253413 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f21a4003f30 con 0x7f21ac155d50 2024-05-12T10:53:27.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.565+0000 7f21a3e00640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f218c06f400 0x7f218c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 Processor -- start 2024-05-12T10:53:27.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21a3e00640 1 -- 172.21.15.115:0/3483253413 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f21a408fae0 con 0x7f21ac155d50 2024-05-12T10:53:27.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21abe00640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f218c06f400 0x7f218c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 -- start start 2024-05-12T10:53:27.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21abe00640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f218c06f400 0x7f218c0718c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f219c0af000 tx=0x7f219c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:27.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddadbe40 0x5571ddb11fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb12510 0x5571ddb128f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb16670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5571dd8d7c80 con 0x5571ddb16290 2024-05-12T10:53:27.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5571dd925030 con 0x5571ddb12510 2024-05-12T10:53:27.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5571dd8de460 con 0x5571ddadbe40 2024-05-12T10:53:27.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b1000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb16670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b1000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb16670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51060/0 (socket says 172.21.15.115:51060) 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b1000640 1 -- 172.21.15.115:0/1716751093 learned_addr learned my addr 172.21.15.115:0/1716751093 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21ab400640 1 --2- 172.21.15.115:0/1716751093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb12510 0x5571ddb128f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21abe00640 1 --2- 172.21.15.115:0/1716751093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddadbe40 0x5571ddb11fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b1000640 1 -- 172.21.15.115:0/1716751093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddadbe40 msgr2=0x5571ddb11fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b1000640 1 --2- 172.21.15.115:0/1716751093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddadbe40 0x5571ddb11fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b1000640 1 -- 172.21.15.115:0/1716751093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb12510 msgr2=0x5571ddb128f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b1000640 1 --2- 172.21.15.115:0/1716751093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb12510 0x5571ddb128f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b1000640 1 -- 172.21.15.115:0/1716751093 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571dd96a310 con 0x5571ddb16290 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21ab400640 1 --2- 172.21.15.115:0/1716751093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb12510 0x5571ddb128f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b1000640 1 --2- 172.21.15.115:0/1716751093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb16670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f21a4058560 tx=0x7f21a405b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2270d2e8b08a9755 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:27.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21a0c00640 1 -- 172.21.15.115:0/1716751093 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a401d040 con 0x5571ddb16290 2024-05-12T10:53:27.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21a0c00640 1 -- 172.21.15.115:0/1716751093 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a4060270 con 0x5571ddb16290 2024-05-12T10:53:27.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21a0c00640 1 -- 172.21.15.115:0/1716751093 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a405b3d0 con 0x5571ddb16290 2024-05-12T10:53:27.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 -- 172.21.15.115:0/1716751093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 msgr2=0x5571ddb16670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 --2- 172.21.15.115:0/1716751093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb16670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f21a4058560 tx=0x7f21a405b6e0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 -- 172.21.15.115:0/1716751093 shutdown_connections 2024-05-12T10:53:27.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 --2- 172.21.15.115:0/1716751093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb16670 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 --2- 172.21.15.115:0/1716751093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb12510 0x5571ddb128f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 --2- 172.21.15.115:0/1716751093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddadbe40 0x5571ddb11fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 -- 172.21.15.115:0/1716751093 >> 172.21.15.115:0/1716751093 conn(0x5571dd9bcec0 msgr2=0x5571ddb15060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:27.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 -- 172.21.15.115:0/1716751093 shutdown_connections 2024-05-12T10:53:27.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 -- 172.21.15.115:0/1716751093 wait complete. 2024-05-12T10:53:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.569+0000 7f21b63bb000 1 -- start start 2024-05-12T10:53:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 1 Processor -- start 2024-05-12T10:53:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddadbe40 0x5571ddafbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddb12510 0x5571ddafc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb1c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5571dd930150 con 0x5571ddb16290 2024-05-12T10:53:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5571dd8e3960 con 0x5571ddadbe40 2024-05-12T10:53:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5571dd8c5b00 con 0x5571ddb12510 2024-05-12T10:53:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 10 client.0 _ll_register_callbacks cb 0x5571ddac13e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:53:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b1000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb1c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b1000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb1c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51064/0 (socket says 172.21.15.115:51064) 2024-05-12T10:53:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b1000640 1 -- 172.21.15.115:0/2049757162 learned_addr learned my addr 172.21.15.115:0/2049757162 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21abe00640 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddadbe40 0x5571ddafbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21ab400640 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddb12510 0x5571ddafc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b1000640 1 -- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddb12510 msgr2=0x5571ddafc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b1000640 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddb12510 0x5571ddafc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b1000640 1 -- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddadbe40 msgr2=0x5571ddafbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b1000640 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddadbe40 0x5571ddafbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b1000640 1 -- 172.21.15.115:0/2049757162 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571dd8f0850 con 0x5571ddb16290 2024-05-12T10:53:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21ab400640 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddb12510 0x5571ddafc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:53:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b1000640 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb1c8e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f21a40591e0 tx=0x7f21a4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec323b17faef6ac server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f2195600640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f2195600640 1 -- 172.21.15.115:0/2049757162 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a401d040 con 0x5571ddb16290 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f2195600640 1 -- 172.21.15.115:0/2049757162 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f21a405b3e0 con 0x5571ddb16290 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 1 -- 172.21.15.115:0/2049757162 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21a4060270 con 0x5571ddb16290 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f2195600640 1 -- 172.21.15.115:0/2049757162 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f21a4083050 con 0x5571ddb16290 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 10 client.5040 fetch_fsmap learned FSMap version 14 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 1 -- 172.21.15.115:0/2049757162 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5571dd8e9b70 con 0x5571ddb16290 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f2195600640 1 -- 172.21.15.115:0/2049757162 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a4060270 con 0x5571ddb16290 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f2195600640 1 -- 172.21.15.115:0/2049757162 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f21a40578e0 con 0x5571ddb16290 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 10 client.5040 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 10 client.5040 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 20 client.5040 populate_metadata read hostname 'smithi115' 2024-05-12T10:53:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5571ddb1d650 0x5571ddb1da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 4 client.5040 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21b63bb000 1 -- 172.21.15.115:0/2049757162 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571dd8be1b0 con 0x5571ddb1d650 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21abe00640 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5571ddb1d650 0x5571ddb1da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f21abe00640 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5571ddb1d650 0x5571ddb1da30 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43298e062db16b39 server_cookie=2264ff709fe90e99 in_seq=0 out_seq=0 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.573+0000 7f2195600640 10 client.5040 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f2195600640 1 -- 172.21.15.115:0/2049757162 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5571dd8be1b0 con 0x5571ddb1d650 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f2195600640 10 client.5040 handle_command_reply: tid=0 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 1 client.5040 shutdown 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 1 -- 172.21.15.115:0/2049757162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 msgr2=0x5571ddb1c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb1c8e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f21a40591e0 tx=0x7f21a4004a50 comp rx=0 tx=0).stop 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 1 -- 172.21.15.115:0/2049757162 shutdown_connections 2024-05-12T10:53:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb1c8e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddb12510 0x5571ddafc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5571ddb1d650 0x5571ddb1da30 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 1 --2- 172.21.15.115:0/2049757162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddadbe40 0x5571ddafbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 1 -- 172.21.15.115:0/2049757162 >> 172.21.15.115:0/2049757162 conn(0x5571dd9bcec0 msgr2=0x5571ddb13ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:27.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f2195600640 0 client.5040 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:53:27.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 1 -- 172.21.15.115:0/2049757162 shutdown_connections 2024-05-12T10:53:27.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 1 -- 172.21.15.115:0/2049757162 wait complete. 2024-05-12T10:53:27.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.577+0000 7f21b63bb000 20 client.5040 trim_cache size 0 max 16384 2024-05-12T10:53:27.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.593+0000 7f21b63bb000 1 Processor -- start 2024-05-12T10:53:27.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.593+0000 7f21b63bb000 1 -- start start 2024-05-12T10:53:27.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.593+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddadbe40 0x5571ddadb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.593+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddb12510 0x5571ddb11680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.593+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb16290 0x5571ddb11bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.593+0000 7f21b63bb000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac2018f0 con 0x5571ddadbe40 2024-05-12T10:53:27.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.593+0000 7f21b63bb000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac1f8e20 con 0x5571ddb16290 2024-05-12T10:53:27.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.593+0000 7f21b63bb000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f21ac201280 con 0x5571ddb12510 2024-05-12T10:53:27.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.593+0000 7f21abe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddadbe40 0x5571ddadb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21abe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddadbe40 0x5571ddadb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51078/0 (socket says 172.21.15.115:51078) 2024-05-12T10:53:27.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21abe00640 1 -- 172.21.15.115:0/1031881110 learned_addr learned my addr 172.21.15.115:0/1031881110 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:27.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b1000640 1 --2- 172.21.15.115:0/1031881110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb16290 0x5571ddb11bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21ab400640 1 --2- 172.21.15.115:0/1031881110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddb12510 0x5571ddb11680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21abe00640 1 -- 172.21.15.115:0/1031881110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddb12510 msgr2=0x5571ddb11680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:27.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21abe00640 1 --2- 172.21.15.115:0/1031881110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddb12510 0x5571ddb11680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21abe00640 1 -- 172.21.15.115:0/1031881110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb16290 msgr2=0x5571ddb11bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:27.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21abe00640 1 --2- 172.21.15.115:0/1031881110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb16290 0x5571ddb11bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21abe00640 1 -- 172.21.15.115:0/1031881110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571dd9f1680 con 0x5571ddadbe40 2024-05-12T10:53:27.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21abe00640 1 --2- 172.21.15.115:0/1031881110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddadbe40 0x5571ddadb570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f219c009870 tx=0x7f219c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4e760f69186fb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:27.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f2197e00640 1 -- 172.21.15.115:0/1031881110 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0d1070 con 0x5571ddadbe40 2024-05-12T10:53:27.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f2197e00640 1 -- 172.21.15.115:0/1031881110 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c0b0040 con 0x5571ddadbe40 2024-05-12T10:53:27.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f2197e00640 1 -- 172.21.15.115:0/1031881110 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0b5ad0 con 0x5571ddadbe40 2024-05-12T10:53:27.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 -- 172.21.15.115:0/1031881110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddadbe40 msgr2=0x5571ddadb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:27.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 --2- 172.21.15.115:0/1031881110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddadbe40 0x5571ddadb570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f219c009870 tx=0x7f219c009240 comp rx=0 tx=0).stop 2024-05-12T10:53:27.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 -- 172.21.15.115:0/1031881110 shutdown_connections 2024-05-12T10:53:27.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 --2- 172.21.15.115:0/1031881110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb16290 0x5571ddb11bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 --2- 172.21.15.115:0/1031881110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddb12510 0x5571ddb11680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 --2- 172.21.15.115:0/1031881110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddadbe40 0x5571ddadb570 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 -- 172.21.15.115:0/1031881110 >> 172.21.15.115:0/1031881110 conn(0x5571dd9bcec0 msgr2=0x5571ddb28500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:27.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 -- 172.21.15.115:0/1031881110 shutdown_connections 2024-05-12T10:53:27.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 -- 172.21.15.115:0/1031881110 wait complete. 2024-05-12T10:53:27.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 -- start start 2024-05-12T10:53:27.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 Processor -- start 2024-05-12T10:53:27.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddadbe40 0x5571ddb18680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb12510 0x5571ddb18bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb19100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5571dd924340 con 0x5571ddb16290 2024-05-12T10:53:27.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5571dd8bb050 con 0x5571ddb12510 2024-05-12T10:53:27.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x5571dd929660 con 0x5571ddadbe40 2024-05-12T10:53:27.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b63bb000 10 client.0 _ll_register_callbacks cb 0x7f21a405be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:53:27.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b1000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb19100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b1000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb19100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51090/0 (socket says 172.21.15.115:51090) 2024-05-12T10:53:27.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b1000640 1 -- 172.21.15.115:0/166017414 learned_addr learned my addr 172.21.15.115:0/166017414 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21ab400640 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb12510 0x5571ddb18bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21abe00640 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddadbe40 0x5571ddb18680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b1000640 1 -- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddadbe40 msgr2=0x5571ddb18680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.597+0000 7f21b1000640 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddadbe40 0x5571ddb18680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b1000640 1 -- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb12510 msgr2=0x5571ddb18bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b1000640 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb12510 0x5571ddb18bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b1000640 1 -- 172.21.15.115:0/166017414 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571dd8deef0 con 0x5571ddb16290 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21abe00640 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddadbe40 0x5571ddb18680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b1000640 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb19100 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f21a405c130 tx=0x7f21a4058640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee25bcda26a096a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f2195600640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f2195600640 1 -- 172.21.15.115:0/166017414 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a401d040 con 0x5571ddb16290 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f2195600640 1 -- 172.21.15.115:0/166017414 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f21a4066b20 con 0x5571ddb16290 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b63bb000 1 -- 172.21.15.115:0/166017414 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f219c0b0040 con 0x5571ddb16290 2024-05-12T10:53:27.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f2195600640 1 -- 172.21.15.115:0/166017414 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f21a4060270 con 0x5571ddb16290 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b63bb000 10 client.5046 fetch_fsmap learned FSMap version 14 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b63bb000 1 -- 172.21.15.115:0/166017414 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5571dd8c99a0 con 0x5571ddb16290 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f2195600640 1 -- 172.21.15.115:0/166017414 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c0b0040 con 0x5571ddb16290 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f2195600640 1 -- 172.21.15.115:0/166017414 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f21a4066d20 con 0x5571ddb16290 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b63bb000 10 client.5046 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b63bb000 10 client.5046 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b63bb000 20 client.5046 populate_metadata read hostname 'smithi115' 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b63bb000 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5571ddb19640 0x5571ddb19a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b63bb000 4 client.5046 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5358179", "await_for": 42.0}] 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21b63bb000 1 -- 172.21.15.115:0/166017414 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5358179", "await_for": 42.0}) -- 0x5571dd932c40 con 0x5571ddb19640 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21abe00640 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5571ddb19640 0x5571ddb19a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f2195600640 10 client.5046 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:53:27.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:27.601+0000 7f21abe00640 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5571ddb19640 0x5571ddb19a50 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=242b29348a906f13 server_cookie=c75c639b67b0ba6f in_seq=0 out_seq=0 2024-05-12T10:53:37.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f2195600640 1 -- 172.21.15.115:0/166017414 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5571dd932c40 con 0x5571ddb19640 2024-05-12T10:53:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f2195600640 10 client.5046 handle_command_reply: tid=0 2024-05-12T10:53:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 1 client.5046 shutdown 2024-05-12T10:53:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 1 -- 172.21.15.115:0/166017414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 msgr2=0x5571ddb19100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb19100 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f21a405c130 tx=0x7f21a4058640 comp rx=0 tx=0).stop 2024-05-12T10:53:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 1 -- 172.21.15.115:0/166017414 shutdown_connections 2024-05-12T10:53:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571ddb16290 0x5571ddb19100 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x5571ddb19640 0x5571ddb19a50 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5571ddb12510 0x5571ddb18bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 1 --2- 172.21.15.115:0/166017414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5571ddadbe40 0x5571ddb18680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f2195600640 0 client.5046 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:53:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 1 -- 172.21.15.115:0/166017414 >> 172.21.15.115:0/166017414 conn(0x5571dd9bcec0 msgr2=0x5571ddb31b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:37.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 1 -- 172.21.15.115:0/166017414 shutdown_connections 2024-05-12T10:53:37.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 1 -- 172.21.15.115:0/166017414 wait complete. 2024-05-12T10:53:37.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b63bb000 20 client.5046 trim_cache size 0 max 16384 2024-05-12T10:53:37.303 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:53:37.303 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:53:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:53:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 10, 2024-05-12T10:53:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:53:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "5358179": { 2024-05-12T10:53:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 10, 2024-05-12T10:53:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:53:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:53:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:53:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:53:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:53:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:53:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 90.0, 2024-05-12T10:53:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:53:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:53:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:53:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:53:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:53:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:53:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:53:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:53:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:53:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:53:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:53:37.306 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:53:37.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 -- 172.21.15.115:0/3483253413 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f218c06f400 msgr2=0x7f218c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:37.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f218c06f400 0x7f218c0718c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f219c0af000 tx=0x7f219c0a7000 comp rx=0 tx=0).stop 2024-05-12T10:53:37.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 -- 172.21.15.115:0/3483253413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ac155d50 msgr2=0x7f21ac143ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:53:37.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ac155d50 0x7f21ac143ff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f21a400cc30 tx=0x7f21a400a5c0 comp rx=0 tx=0).stop 2024-05-12T10:53:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 -- 172.21.15.115:0/3483253413 shutdown_connections 2024-05-12T10:53:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f218c06f400 0x7f218c0718c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ac155d50 0x7f21ac143ff0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21ac0c4300 0x7f21ac1f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 --2- 172.21.15.115:0/3483253413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21ac06e0e0 0x7f21ac0cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:53:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 -- 172.21.15.115:0/3483253413 >> 172.21.15.115:0/3483253413 conn(0x7f21ac076830 msgr2=0x7f21ac1519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:53:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 -- 172.21.15.115:0/3483253413 shutdown_connections 2024-05-12T10:53:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:53:37.305+0000 7f21b1a00640 1 -- 172.21.15.115:0/3483253413 wait complete. 2024-05-12T10:53:37.321 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5358179', quiesce took 54.7 seconds. Will release after: 30.0 2024-05-12T10:53:39.594 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:53:39.594 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:53:39.595 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:53:39.595 INFO:tasks.workunit.client.0.smithi115.stdout:iozone test complete. 2024-05-12T10:53:39.596 INFO:tasks.workunit.client.0.smithi115.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-12T10:53:39.664 INFO:tasks.workunit.client.0.smithi115.stdout: Iozone: Performance Test of File I/O 2024-05-12T10:53:39.664 INFO:tasks.workunit.client.0.smithi115.stdout: Version $Revision: 3.489 $ 2024-05-12T10:53:39.664 INFO:tasks.workunit.client.0.smithi115.stdout: Compiled for 64 bit mode. 2024-05-12T10:53:39.664 INFO:tasks.workunit.client.0.smithi115.stdout: Build: linux-AMD64 2024-05-12T10:53:39.664 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:53:39.664 INFO:tasks.workunit.client.0.smithi115.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-12T10:53:39.664 INFO:tasks.workunit.client.0.smithi115.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-12T10:53:39.664 INFO:tasks.workunit.client.0.smithi115.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-12T10:53:39.664 INFO:tasks.workunit.client.0.smithi115.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: Run began: Sun May 12 10:53:39 2024 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: Include close in write timing 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: Include fsync in write timing 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: File size set to 1048576 kB 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: Record Size 1024 kB 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-12T10:53:39.665 INFO:tasks.workunit.client.0.smithi115.stdout: Output is in kBytes/sec 2024-05-12T10:53:39.666 INFO:tasks.workunit.client.0.smithi115.stdout: Time Resolution = 0.000001 seconds. 2024-05-12T10:53:39.666 INFO:tasks.workunit.client.0.smithi115.stdout: Processor cache size set to 1024 kBytes. 2024-05-12T10:53:39.666 INFO:tasks.workunit.client.0.smithi115.stdout: Processor cache line size set to 32 bytes. 2024-05-12T10:53:39.666 INFO:tasks.workunit.client.0.smithi115.stdout: File stride size set to 17 * record size. 2024-05-12T10:53:39.666 INFO:tasks.workunit.client.0.smithi115.stdout: Throughput test with 1 process 2024-05-12T10:53:39.666 INFO:tasks.workunit.client.0.smithi115.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-05-12T10:53:50.344 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:53:50.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:54:07.322 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:54:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34ab400640 1 Processor -- start 2024-05-12T10:54:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34ab400640 1 -- start start 2024-05-12T10:54:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34ab400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f34a4160040 0x7f34a40c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34ab400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f34a40ca040 0x7f34a40cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34ab400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34a40cc430 con 0x7f34a406f3a0 2024-05-12T10:54:07.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34ab400640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f34a4160420 con 0x7f34a40ca040 2024-05-12T10:54:07.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34ab400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f34a40cb700 con 0x7f34a4160040 2024-05-12T10:54:07.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34a3e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f34a40ca040 0x7f34a40cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34a3e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f34a40ca040 0x7f34a40cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37968/0 (socket says 172.21.15.115:37968) 2024-05-12T10:54:07.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34a3e00640 1 -- 172.21.15.115:0/2890068366 learned_addr learned my addr 172.21.15.115:0/2890068366 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:07.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34a3e00640 1 -- 172.21.15.115:0/2890068366 >> v2:172.21.15.134:3300/0 conn(0x7f34a4160040 msgr2=0x7f34a40c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34a3e00640 1 --2- 172.21.15.115:0/2890068366 >> v2:172.21.15.134:3300/0 conn(0x7f34a4160040 0x7f34a40c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34a3e00640 1 -- 172.21.15.115:0/2890068366 >> v1:172.21.15.134:6789/0 conn(0x7f34a406f3a0 legacy=0x7f34a406c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.465+0000 7f34a3e00640 1 -- 172.21.15.115:0/2890068366 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a40cb9e0 con 0x7f34a40ca040 2024-05-12T10:54:07.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34a3e00640 1 --2- 172.21.15.115:0/2890068366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a40ca040 0x7f34a40cab00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f34a40cf7a0 tx=0x7f349001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a8ce03a23a11b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:07.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34a3400640 1 -- 172.21.15.115:0/2890068366 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34900b5070 con 0x7f34a40ca040 2024-05-12T10:54:07.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34a3400640 1 -- 172.21.15.115:0/2890068366 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34900a89d0 con 0x7f34a40ca040 2024-05-12T10:54:07.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34a3400640 1 -- 172.21.15.115:0/2890068366 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34900a8da0 con 0x7f34a40ca040 2024-05-12T10:54:07.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34ab400640 1 -- 172.21.15.115:0/2890068366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a40ca040 msgr2=0x7f34a40cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34ab400640 1 --2- 172.21.15.115:0/2890068366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a40ca040 0x7f34a40cab00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f34a40cf7a0 tx=0x7f349001ed10 comp rx=0 tx=0).stop 2024-05-12T10:54:07.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34ab400640 1 -- 172.21.15.115:0/2890068366 shutdown_connections 2024-05-12T10:54:07.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34ab400640 1 --2- 172.21.15.115:0/2890068366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a40ca040 0x7f34a40cab00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34ab400640 1 --2- 172.21.15.115:0/2890068366 >> v2:172.21.15.134:3300/0 conn(0x7f34a4160040 0x7f34a40c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34ab400640 1 -- 172.21.15.115:0/2890068366 >> 172.21.15.115:0/2890068366 conn(0x7f34a4071200 msgr2=0x7f34a4071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:07.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34ab400640 1 -- 172.21.15.115:0/2890068366 shutdown_connections 2024-05-12T10:54:07.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34ab400640 1 -- 172.21.15.115:0/2890068366 wait complete. 2024-05-12T10:54:07.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34ab400640 1 Processor -- start 2024-05-12T10:54:07.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.469+0000 7f34ab400640 1 -- start start 2024-05-12T10:54:07.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34ab400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a406f3a0 0x7f34a41571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34ab400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34a40ca040 0x7f34a40c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34ab400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a4160040 0x7f34a40b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34ab400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f34a40cb040 con 0x7f34a406f3a0 2024-05-12T10:54:07.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34ab400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34a40cc710 con 0x7f34a4160040 2024-05-12T10:54:07.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34ab400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f34a40cc0d0 con 0x7f34a40ca040 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a8a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a406f3a0 0x7f34a41571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a8a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a406f3a0 0x7f34a41571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37982/0 (socket says 172.21.15.115:37982) 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a8a00640 1 -- 172.21.15.115:0/2890282295 learned_addr learned my addr 172.21.15.115:0/2890282295 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a9400640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a4160040 0x7f34a40b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a3e00640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34a40ca040 0x7f34a40c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a8a00640 1 -- 172.21.15.115:0/2890282295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34a40ca040 msgr2=0x7f34a40c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a8a00640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34a40ca040 0x7f34a40c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a8a00640 1 -- 172.21.15.115:0/2890282295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a4160040 msgr2=0x7f34a40b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a8a00640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a4160040 0x7f34a40b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a8a00640 1 -- 172.21.15.115:0/2890282295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a40c6800 con 0x7f34a406f3a0 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a9400640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a4160040 0x7f34a40b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a8a00640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a406f3a0 0x7f34a41571a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f349800b410 tx=0x7f349800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a0c00640 1 -- 172.21.15.115:0/2890282295 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498015020 con 0x7f34a406f3a0 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a0c00640 1 -- 172.21.15.115:0/2890282295 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3498011830 con 0x7f34a406f3a0 2024-05-12T10:54:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34ab400640 1 -- 172.21.15.115:0/2890282295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a41f17a0 con 0x7f34a406f3a0 2024-05-12T10:54:07.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a0c00640 1 -- 172.21.15.115:0/2890282295 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498011c20 con 0x7f34a406f3a0 2024-05-12T10:54:07.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34ab400640 1 -- 172.21.15.115:0/2890282295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a41f1d60 con 0x7f34a406f3a0 2024-05-12T10:54:07.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34ab400640 1 -- 172.21.15.115:0/2890282295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34a4069730 con 0x7f34a406f3a0 2024-05-12T10:54:07.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.473+0000 7f34a0c00640 1 -- 172.21.15.115:0/2890282295 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3498018020 con 0x7f34a406f3a0 2024-05-12T10:54:07.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.477+0000 7f34a0c00640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f348406f430 0x7f34840718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.477+0000 7f34a0c00640 1 -- 172.21.15.115:0/2890282295 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f349808f6a0 con 0x7f34a406f3a0 2024-05-12T10:54:07.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.477+0000 7f34a3e00640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f348406f430 0x7f34840718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.477+0000 7f34a3e00640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f348406f430 0x7f34840718f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f34900b2000 tx=0x7f3490008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:07.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.481+0000 7f34a0c00640 1 -- 172.21.15.115:0/2890282295 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f349801f020 con 0x7f34a406f3a0 2024-05-12T10:54:07.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.681+0000 7f34ab400640 1 -- 172.21.15.115:0/2890282295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34a40c9260 con 0x7f34a406f3a0 2024-05-12T10:54:07.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.681+0000 7f34a0c00640 1 -- 172.21.15.115:0/2890282295 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f349805c180 con 0x7f34a406f3a0 2024-05-12T10:54:07.677 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:54:07.678 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:54:07.678 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 -- 172.21.15.115:0/2890282295 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f348406f430 msgr2=0x7f34840718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f348406f430 0x7f34840718f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f34900b2000 tx=0x7f3490008040 comp rx=0 tx=0).stop 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 -- 172.21.15.115:0/2890282295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a406f3a0 msgr2=0x7f34a41571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a406f3a0 0x7f34a41571a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f349800b410 tx=0x7f349800b8d0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 -- 172.21.15.115:0/2890282295 shutdown_connections 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f348406f430 0x7f34840718f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a4160040 0x7f34a40b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34a40ca040 0x7f34a40c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 --2- 172.21.15.115:0/2890282295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a406f3a0 0x7f34a41571a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 -- 172.21.15.115:0/2890282295 >> 172.21.15.115:0/2890282295 conn(0x7f34a4071200 msgr2=0x7f34a40c4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 -- 172.21.15.115:0/2890282295 shutdown_connections 2024-05-12T10:54:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.685+0000 7f34ab400640 1 -- 172.21.15.115:0/2890282295 wait complete. 2024-05-12T10:54:07.699 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db --set-id 5358179 --release --await' 2024-05-12T10:54:07.699 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db --set-id 5358179 --release --await 2024-05-12T10:54:07.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.849+0000 7fc64ce00640 1 Processor -- start 2024-05-12T10:54:07.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.849+0000 7fc64ce00640 1 -- start start 2024-05-12T10:54:07.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.849+0000 7fc64ce00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc648151e90 0x7fc648158a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.849+0000 7fc64ce00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6480c5990 0x7fc6480c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.849+0000 7fc64ce00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6480ca500 con 0x7fc6480c9a00 2024-05-12T10:54:07.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.849+0000 7fc64ce00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fc64815c3d0 con 0x7fc648151e90 2024-05-12T10:54:07.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.849+0000 7fc64ce00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc64815b610 con 0x7fc6480c5990 2024-05-12T10:54:07.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.849+0000 7fc647400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc648151e90 0x7fc648158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.849+0000 7fc647400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc648151e90 0x7fc648158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37994/0 (socket says 172.21.15.115:37994) 2024-05-12T10:54:07.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.849+0000 7fc647400640 1 -- 172.21.15.115:0/4166956315 learned_addr learned my addr 172.21.15.115:0/4166956315 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:07.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.849+0000 7fc646a00640 1 --2- 172.21.15.115:0/4166956315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6480c5990 0x7fc6480c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc647400640 1 -- 172.21.15.115:0/4166956315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6480c5990 msgr2=0x7fc6480c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc647400640 1 --2- 172.21.15.115:0/4166956315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6480c5990 0x7fc6480c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc647400640 1 -- 172.21.15.115:0/4166956315 >> v1:172.21.15.134:6789/0 conn(0x7fc6480c9a00 legacy=0x7fc6480c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc647400640 1 -- 172.21.15.115:0/4166956315 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64815b8f0 con 0x7fc648151e90 2024-05-12T10:54:07.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc647400640 1 --2- 172.21.15.115:0/4166956315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc648151e90 0x7fc648158a80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc638009870 tx=0x7fc63801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811752403fd6d675 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:07.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc646000640 1 -- 172.21.15.115:0/4166956315 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6380b0070 con 0x7fc648151e90 2024-05-12T10:54:07.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc646000640 1 -- 172.21.15.115:0/4166956315 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6380ab600 con 0x7fc648151e90 2024-05-12T10:54:07.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc646000640 1 -- 172.21.15.115:0/4166956315 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6380ab9d0 con 0x7fc648151e90 2024-05-12T10:54:07.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc64ce00640 1 -- 172.21.15.115:0/4166956315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc648151e90 msgr2=0x7fc648158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc64ce00640 1 --2- 172.21.15.115:0/4166956315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc648151e90 0x7fc648158a80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc638009870 tx=0x7fc63801c560 comp rx=0 tx=0).stop 2024-05-12T10:54:07.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc64ce00640 1 -- 172.21.15.115:0/4166956315 shutdown_connections 2024-05-12T10:54:07.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc64ce00640 1 --2- 172.21.15.115:0/4166956315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6480c5990 0x7fc6480c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc64ce00640 1 --2- 172.21.15.115:0/4166956315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc648151e90 0x7fc648158a80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc64ce00640 1 -- 172.21.15.115:0/4166956315 >> 172.21.15.115:0/4166956315 conn(0x7fc64806e610 msgr2=0x7fc6480681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:07.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc64ce00640 1 -- 172.21.15.115:0/4166956315 shutdown_connections 2024-05-12T10:54:07.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.853+0000 7fc64ce00640 1 -- 172.21.15.115:0/4166956315 wait complete. 2024-05-12T10:54:07.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc64ce00640 1 Processor -- start 2024-05-12T10:54:07.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc64ce00640 1 -- start start 2024-05-12T10:54:07.853 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc64ce00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6480c5990 0x7fc6480cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.853 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc64ce00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6480c9a00 0x7fc6481f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.853 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc64ce00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc648151e90 0x7fc6481f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc64ce00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480c8e20 con 0x7fc6480c5990 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc64ce00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480c8ca0 con 0x7fc648151e90 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc64ce00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc648164fe0 con 0x7fc6480c9a00 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc647400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6480c5990 0x7fc6480cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc647400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6480c5990 0x7fc6480cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37996/0 (socket says 172.21.15.115:37996) 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc647400640 1 -- 172.21.15.115:0/1982902204 learned_addr learned my addr 172.21.15.115:0/1982902204 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc646a00640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6480c9a00 0x7fc6481f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc647e00640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc648151e90 0x7fc6481f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc647400640 1 -- 172.21.15.115:0/1982902204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6480c9a00 msgr2=0x7fc6481f5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc647400640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6480c9a00 0x7fc6481f5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc647400640 1 -- 172.21.15.115:0/1982902204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc648151e90 msgr2=0x7fc6481f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc647400640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc648151e90 0x7fc6481f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc647400640 1 -- 172.21.15.115:0/1982902204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc648156f40 con 0x7fc6480c5990 2024-05-12T10:54:07.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc647400640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6480c5990 0x7fc6480cd4f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6380ae040 tx=0x7fc63801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:07.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc63f400640 1 -- 172.21.15.115:0/1982902204 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6380b0040 con 0x7fc6480c5990 2024-05-12T10:54:07.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc63f400640 1 -- 172.21.15.115:0/1982902204 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6380bc070 con 0x7fc6480c5990 2024-05-12T10:54:07.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc63f400640 1 -- 172.21.15.115:0/1982902204 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6380b6660 con 0x7fc6480c5990 2024-05-12T10:54:07.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc64ce00640 1 -- 172.21.15.115:0/1982902204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6481f5600 con 0x7fc6480c5990 2024-05-12T10:54:07.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.857+0000 7fc64ce00640 1 -- 172.21.15.115:0/1982902204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc648157490 con 0x7fc6480c5990 2024-05-12T10:54:07.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.861+0000 7fc63f400640 1 -- 172.21.15.115:0/1982902204 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc6380b6800 con 0x7fc6480c5990 2024-05-12T10:54:07.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.861+0000 7fc63f400640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc62806f430 0x7fc6280718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.861+0000 7fc63f400640 1 -- 172.21.15.115:0/1982902204 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc6381298b0 con 0x7fc6480c5990 2024-05-12T10:54:07.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.861+0000 7fc65198e000 1 Processor -- start 2024-05-12T10:54:07.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.861+0000 7fc646a00640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc62806f430 0x7fc6280718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.861+0000 7fc65198e000 1 -- start start 2024-05-12T10:54:07.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.861+0000 7fc646a00640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc62806f430 0x7fc6280718f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc64815b400 tx=0x7fc634008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:07.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bb600 0x55dce78bb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bdb90 0x55dce78bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55dce777ca60 con 0x55dce78bd270 2024-05-12T10:54:07.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dce76e5250 con 0x55dce78bdb90 2024-05-12T10:54:07.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55dce76894d0 con 0x55dce78bb600 2024-05-12T10:54:07.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc646a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc646a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38000/0 (socket says 172.21.15.115:38000) 2024-05-12T10:54:07.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc646a00640 1 -- 172.21.15.115:0/1533943540 learned_addr learned my addr 172.21.15.115:0/1533943540 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:07.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc647e00640 1 --2- 172.21.15.115:0/1533943540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bdb90 0x55dce78bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc647400640 1 --2- 172.21.15.115:0/1533943540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bb600 0x55dce78bb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc646a00640 1 -- 172.21.15.115:0/1533943540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bb600 msgr2=0x55dce78bb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc646a00640 1 --2- 172.21.15.115:0/1533943540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bb600 0x55dce78bb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc646a00640 1 -- 172.21.15.115:0/1533943540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bdb90 msgr2=0x55dce78bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc646a00640 1 --2- 172.21.15.115:0/1533943540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bdb90 0x55dce78bdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc646a00640 1 -- 172.21.15.115:0/1533943540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dce76bc970 con 0x55dce78bd270 2024-05-12T10:54:07.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc646a00640 1 --2- 172.21.15.115:0/1533943540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bd650 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc634010b20 tx=0x7fc634013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b261a19485ea7697 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:07.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc633e00640 1 -- 172.21.15.115:0/1533943540 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63401c050 con 0x55dce78bd270 2024-05-12T10:54:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc633e00640 1 -- 172.21.15.115:0/1533943540 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63401d040 con 0x55dce78bd270 2024-05-12T10:54:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc633e00640 1 -- 172.21.15.115:0/1533943540 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634016cd0 con 0x55dce78bd270 2024-05-12T10:54:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- 172.21.15.115:0/1533943540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 msgr2=0x55dce78bd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 --2- 172.21.15.115:0/1533943540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bd650 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc634010b20 tx=0x7fc634013000 comp rx=0 tx=0).stop 2024-05-12T10:54:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- 172.21.15.115:0/1533943540 shutdown_connections 2024-05-12T10:54:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 --2- 172.21.15.115:0/1533943540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bdb90 0x55dce78bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 --2- 172.21.15.115:0/1533943540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bd650 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 --2- 172.21.15.115:0/1533943540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bb600 0x55dce78bb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- 172.21.15.115:0/1533943540 >> 172.21.15.115:0/1533943540 conn(0x55dce78d2430 msgr2=0x55dce78d4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- 172.21.15.115:0/1533943540 shutdown_connections 2024-05-12T10:54:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- 172.21.15.115:0/1533943540 wait complete. 2024-05-12T10:54:07.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- start start 2024-05-12T10:54:07.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 Processor -- start 2024-05-12T10:54:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bb600 0x55dce78ba9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bdb90 0x55dce78dcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55dce76e1210 con 0x55dce78bd270 2024-05-12T10:54:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dce76f2650 con 0x55dce78bb600 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.865+0000 7fc65198e000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55dce77235b0 con 0x55dce78bdb90 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc65198e000 10 client.0 _ll_register_callbacks cb 0x55dce787ff70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc646a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc647400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bb600 0x55dce78ba9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc646a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78baf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38002/0 (socket says 172.21.15.115:38002) 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc646a00640 1 -- 172.21.15.115:0/460928639 learned_addr learned my addr 172.21.15.115:0/460928639 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc647e00640 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bdb90 0x55dce78dcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc646a00640 1 -- 172.21.15.115:0/460928639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bdb90 msgr2=0x55dce78dcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc646a00640 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bdb90 0x55dce78dcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc646a00640 1 -- 172.21.15.115:0/460928639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bb600 msgr2=0x55dce78ba9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc646a00640 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bb600 0x55dce78ba9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc646a00640 1 -- 172.21.15.115:0/460928639 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dce77290e0 con 0x55dce78bd270 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc646a00640 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78baf20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55dce7792250 tx=0x7fc634004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8404ef60b37077 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc630c00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc630c00640 1 -- 172.21.15.115:0/460928639 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634005bb0 con 0x55dce78bd270 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc630c00640 1 -- 172.21.15.115:0/460928639 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc634005d50 con 0x55dce78bd270 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc65198e000 1 -- 172.21.15.115:0/460928639 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc63401d040 con 0x55dce78bd270 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc630c00640 1 -- 172.21.15.115:0/460928639 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fc634038050 con 0x55dce78bd270 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc65198e000 10 client.5064 fetch_fsmap learned FSMap version 14 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc65198e000 1 -- 172.21.15.115:0/460928639 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55dce76979e0 con 0x55dce78bd270 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc630c00640 1 -- 172.21.15.115:0/460928639 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63401d040 con 0x55dce78bd270 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc630c00640 1 -- 172.21.15.115:0/460928639 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fc63403b020 con 0x55dce78bd270 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc65198e000 10 client.5064 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc65198e000 10 client.5064 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc65198e000 20 client.5064 populate_metadata read hostname 'smithi115' 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc65198e000 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55dce78dd8a0 0x55dce78ddc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc65198e000 4 client.5064 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:54:07.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc65198e000 1 -- 172.21.15.115:0/460928639 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dce767e060 con 0x55dce78dd8a0 2024-05-12T10:54:07.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc647400640 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55dce78dd8a0 0x55dce78ddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc647400640 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55dce78dd8a0 0x55dce78ddc80 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bf8595fcb866481 server_cookie=d329a09fd73db757 in_seq=0 out_seq=0 2024-05-12T10:54:07.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.869+0000 7fc630c00640 10 client.5064 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc630c00640 1 -- 172.21.15.115:0/460928639 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dce767e060 con 0x55dce78dd8a0 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc630c00640 10 client.5064 handle_command_reply: tid=0 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 1 client.5064 shutdown 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 1 -- 172.21.15.115:0/460928639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 msgr2=0x55dce78baf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78baf20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55dce7792250 tx=0x7fc634004740 comp rx=0 tx=0).stop 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 1 -- 172.21.15.115:0/460928639 shutdown_connections 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bdb90 0x55dce78dcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78baf20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55dce78dd8a0 0x55dce78ddc80 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 1 --2- 172.21.15.115:0/460928639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bb600 0x55dce78ba9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc630c00640 0 client.5064 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 1 -- 172.21.15.115:0/460928639 >> 172.21.15.115:0/460928639 conn(0x55dce78d2430 msgr2=0x55dce78d4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 1 -- 172.21.15.115:0/460928639 shutdown_connections 2024-05-12T10:54:07.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 1 -- 172.21.15.115:0/460928639 wait complete. 2024-05-12T10:54:07.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.873+0000 7fc65198e000 20 client.5064 trim_cache size 0 max 16384 2024-05-12T10:54:07.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc65198e000 1 Processor -- start 2024-05-12T10:54:07.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc65198e000 1 -- start start 2024-05-12T10:54:07.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc65198e000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bb600 0x55dce78bb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc65198e000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc65198e000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bdb90 0x55dce78dc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc65198e000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc648201840 con 0x55dce78bd270 2024-05-12T10:54:07.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc65198e000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6481f9640 con 0x55dce78bb600 2024-05-12T10:54:07.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc65198e000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc6482011a0 con 0x55dce78bdb90 2024-05-12T10:54:07.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc646a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc646a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38014/0 (socket says 172.21.15.115:38014) 2024-05-12T10:54:07.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc646a00640 1 -- 172.21.15.115:0/2581358349 learned_addr learned my addr 172.21.15.115:0/2581358349 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:07.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc647400640 1 --2- 172.21.15.115:0/2581358349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bb600 0x55dce78bb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc647e00640 1 --2- 172.21.15.115:0/2581358349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bdb90 0x55dce78dc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.889+0000 7fc646a00640 1 -- 172.21.15.115:0/2581358349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bdb90 msgr2=0x55dce78dc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc646a00640 1 --2- 172.21.15.115:0/2581358349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bdb90 0x55dce78dc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc646a00640 1 -- 172.21.15.115:0/2581358349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bb600 msgr2=0x55dce78bb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc646a00640 1 --2- 172.21.15.115:0/2581358349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bb600 0x55dce78bb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc646a00640 1 -- 172.21.15.115:0/2581358349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dce76896e0 con 0x55dce78bd270 2024-05-12T10:54:07.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc646a00640 1 --2- 172.21.15.115:0/2581358349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bbf20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc634036040 tx=0x7fc634028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53eedff97faac750 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:07.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc633400640 1 -- 172.21.15.115:0/2581358349 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63401c040 con 0x55dce78bd270 2024-05-12T10:54:07.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc633400640 1 -- 172.21.15.115:0/2581358349 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634030070 con 0x55dce78bd270 2024-05-12T10:54:07.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc633400640 1 -- 172.21.15.115:0/2581358349 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634005bb0 con 0x55dce78bd270 2024-05-12T10:54:07.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 -- 172.21.15.115:0/2581358349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 msgr2=0x55dce78bbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 --2- 172.21.15.115:0/2581358349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bbf20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc634036040 tx=0x7fc634028000 comp rx=0 tx=0).stop 2024-05-12T10:54:07.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 -- 172.21.15.115:0/2581358349 shutdown_connections 2024-05-12T10:54:07.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 --2- 172.21.15.115:0/2581358349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bdb90 0x55dce78dc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 --2- 172.21.15.115:0/2581358349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bd270 0x55dce78bbf20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 --2- 172.21.15.115:0/2581358349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bb600 0x55dce78bb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 -- 172.21.15.115:0/2581358349 >> 172.21.15.115:0/2581358349 conn(0x55dce78d2430 msgr2=0x55dce78d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:07.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 -- 172.21.15.115:0/2581358349 shutdown_connections 2024-05-12T10:54:07.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 -- 172.21.15.115:0/2581358349 wait complete. 2024-05-12T10:54:07.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 -- start start 2024-05-12T10:54:07.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 Processor -- start 2024-05-12T10:54:07.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bb600 0x55dce78df0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bd270 0x55dce78d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bdb90 0x55dce78d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55dce767ac50 con 0x55dce78bb600 2024-05-12T10:54:07.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dce76ddd70 con 0x55dce78bdb90 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55dce76e4560 con 0x55dce78bd270 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc65198e000 10 client.0 _ll_register_callbacks cb 0x7fc6340109f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc647400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bb600 0x55dce78df0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc647400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bb600 0x55dce78df0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38022/0 (socket says 172.21.15.115:38022) 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc647400640 1 -- 172.21.15.115:0/3619208930 learned_addr learned my addr 172.21.15.115:0/3619208930 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc646a00640 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bd270 0x55dce78d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc647e00640 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bdb90 0x55dce78d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc647400640 1 -- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bd270 msgr2=0x55dce78d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc647400640 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bd270 0x55dce78d0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc647400640 1 -- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bdb90 msgr2=0x55dce78d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc647400640 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bdb90 0x55dce78d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc647400640 1 -- 172.21.15.115:0/3619208930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dce773c2a0 con 0x55dce78bb600 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc646a00640 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bd270 0x55dce78d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc647400640 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bb600 0x55dce78df0c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc6380f5990 tx=0x7fc638129040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c605aeb6a60f3fdd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc630c00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:54:07.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.893+0000 7fc630c00640 1 -- 172.21.15.115:0/3619208930 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6380fe3a0 con 0x55dce78bb600 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc630c00640 1 -- 172.21.15.115:0/3619208930 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc6380fe5d0 con 0x55dce78bb600 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc65198e000 1 -- 172.21.15.115:0/3619208930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc634030070 con 0x55dce78bb600 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc630c00640 1 -- 172.21.15.115:0/3619208930 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fc6380f57a0 con 0x55dce78bb600 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc65198e000 10 client.5070 fetch_fsmap learned FSMap version 14 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc65198e000 1 -- 172.21.15.115:0/3619208930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55dce76799c0 con 0x55dce78bb600 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc630c00640 1 -- 172.21.15.115:0/3619208930 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634030070 con 0x55dce78bb600 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc630c00640 1 -- 172.21.15.115:0/3619208930 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fc6380b3030 con 0x55dce78bb600 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc65198e000 10 client.5070 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc65198e000 10 client.5070 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc65198e000 20 client.5070 populate_metadata read hostname 'smithi115' 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc65198e000 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55dce794f040 0x55dce794f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc65198e000 4 client.5070 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5358179", "release": true, "await": true}] 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc65198e000 1 -- 172.21.15.115:0/3619208930 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5358179", "release": true, "await": true}) -- 0x55dce76f2e60 con 0x55dce794f040 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc646a00640 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55dce794f040 0x55dce794f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:07.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc646a00640 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55dce794f040 0x55dce794f450 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=902cef03ab4e40f1 server_cookie=cbb942fd30d83597 in_seq=0 out_seq=0 2024-05-12T10:54:07.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.897+0000 7fc630c00640 10 client.5070 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:07.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc630c00640 1 -- 172.21.15.115:0/3619208930 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55dce76f2e60 con 0x55dce794f040 2024-05-12T10:54:07.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc630c00640 10 client.5070 handle_command_reply: tid=0 2024-05-12T10:54:07.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 1 client.5070 shutdown 2024-05-12T10:54:07.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 1 -- 172.21.15.115:0/3619208930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bb600 msgr2=0x55dce78df0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bb600 0x55dce78df0c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc6380f5990 tx=0x7fc638129040 comp rx=0 tx=0).stop 2024-05-12T10:54:07.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 1 -- 172.21.15.115:0/3619208930 shutdown_connections 2024-05-12T10:54:07.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55dce794f040 0x55dce794f450 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dce78bdb90 0x55dce78d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dce78bd270 0x55dce78d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 1 --2- 172.21.15.115:0/3619208930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dce78bb600 0x55dce78df0c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 1 -- 172.21.15.115:0/3619208930 >> 172.21.15.115:0/3619208930 conn(0x55dce78d2430 msgr2=0x55dce78f2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:07.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc630c00640 0 client.5070 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:07.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 1 -- 172.21.15.115:0/3619208930 shutdown_connections 2024-05-12T10:54:07.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 1 -- 172.21.15.115:0/3619208930 wait complete. 2024-05-12T10:54:07.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc65198e000 20 client.5070 trim_cache size 0 max 16384 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 12, 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: "5358179": { 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 12, 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:54:07.898 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 90.0, 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:07.899 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:54:07.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 -- 172.21.15.115:0/1982902204 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc62806f430 msgr2=0x7fc6280718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc62806f430 0x7fc6280718f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc64815b400 tx=0x7fc634008040 comp rx=0 tx=0).stop 2024-05-12T10:54:07.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 -- 172.21.15.115:0/1982902204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6480c5990 msgr2=0x7fc6480cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:07.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6480c5990 0x7fc6480cd4f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6380ae040 tx=0x7fc63801ada0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 -- 172.21.15.115:0/1982902204 shutdown_connections 2024-05-12T10:54:07.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc62806f430 0x7fc6280718f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc648151e90 0x7fc6481f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc6480c9a00 0x7fc6481f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 --2- 172.21.15.115:0/1982902204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6480c5990 0x7fc6480cd4f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:07.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 -- 172.21.15.115:0/1982902204 >> 172.21.15.115:0/1982902204 conn(0x7fc64806e610 msgr2=0x7fc64814e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:07.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 -- 172.21.15.115:0/1982902204 shutdown_connections 2024-05-12T10:54:07.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:07.901+0000 7fc64ce00640 1 -- 172.21.15.115:0/1982902204 wait complete. 2024-05-12T10:54:07.917 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5358179', seconds elapsed: 85.3 2024-05-12T10:54:07.917 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-12T10:54:07.918 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:54:08.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.065+0000 7ff4e4e00640 1 Processor -- start 2024-05-12T10:54:08.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.065+0000 7ff4e4e00640 1 -- start start 2024-05-12T10:54:08.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4e4e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4e00ca040 0x7ff4e00cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4e4e00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4e015ab40 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4e4e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4e0159ce0 con 0x7ff4e0153de0 2024-05-12T10:54:08.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4e4e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e00c4d00 con 0x7ff4e00ca040 2024-05-12T10:54:08.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4de800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff4e00cfaa0 0x7ff4e00cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34160/0 (socket says 172.21.15.115:34160) 2024-05-12T10:54:08.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4de800640 1 -- 172.21.15.115:0/3491849651 learned_addr learned my addr 172.21.15.115:0/3491849651 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:54:08.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4d5400640 1 --2- 172.21.15.115:0/3491849651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4e00ca040 0x7ff4e00cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4dd400640 1 -- 172.21.15.115:0/3491849651 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096523237 0 0) 0x7ff4e015ab40 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4dd400640 1 -- 172.21.15.115:0/3491849651 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4c4003530 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4dd400640 1 -- 172.21.15.115:0/3491849651 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441872714 0 0) 0x7ff4e0159ce0 con 0x7ff4e0153de0 2024-05-12T10:54:08.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4dd400640 1 -- 172.21.15.115:0/3491849651 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4e015ab40 con 0x7ff4e0153de0 2024-05-12T10:54:08.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4d5400640 1 -- 172.21.15.115:0/3491849651 >> v1:172.21.15.134:6789/0 conn(0x7ff4e0153de0 legacy=0x7ff4e00c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4d5400640 1 -- 172.21.15.115:0/3491849651 >> v1:172.21.15.115:6789/0 conn(0x7ff4e00cfaa0 legacy=0x7ff4e00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.069+0000 7ff4d5400640 1 -- 172.21.15.115:0/3491849651 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e0159fc0 con 0x7ff4e00ca040 2024-05-12T10:54:08.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4d5400640 1 --2- 172.21.15.115:0/3491849651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4e00ca040 0x7ff4e00cf560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80097f0 tx=0x7ff4c801ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f7ff26f340b951b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:08.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4dd400640 1 -- 172.21.15.115:0/3491849651 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80b5070 con 0x7ff4e00ca040 2024-05-12T10:54:08.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4dd400640 1 -- 172.21.15.115:0/3491849651 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c80a89d0 con 0x7ff4e00ca040 2024-05-12T10:54:08.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4dd400640 1 -- 172.21.15.115:0/3491849651 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80a8d80 con 0x7ff4e00ca040 2024-05-12T10:54:08.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4e4e00640 1 -- 172.21.15.115:0/3491849651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4e00ca040 msgr2=0x7ff4e00cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4e4e00640 1 --2- 172.21.15.115:0/3491849651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4e00ca040 0x7ff4e00cf560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80097f0 tx=0x7ff4c801ecd0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4e4e00640 1 -- 172.21.15.115:0/3491849651 shutdown_connections 2024-05-12T10:54:08.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4e4e00640 1 --2- 172.21.15.115:0/3491849651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4e00ca040 0x7ff4e00cf560 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4e4e00640 1 -- 172.21.15.115:0/3491849651 >> 172.21.15.115:0/3491849651 conn(0x7ff4e006c440 msgr2=0x7ff4e006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:08.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4e4e00640 1 -- 172.21.15.115:0/3491849651 shutdown_connections 2024-05-12T10:54:08.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4e4e00640 1 -- 172.21.15.115:0/3491849651 wait complete. 2024-05-12T10:54:08.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4e4e00640 1 Processor -- start 2024-05-12T10:54:08.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.073+0000 7ff4e4e00640 1 -- start start 2024-05-12T10:54:08.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4e4e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4e00ca040 0x7ff4e006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4e4e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cfaa0 0x7ff4e00b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4e4e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4e0153de0 0x7ff4e0157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4e4e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e015a860 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4e4e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e015a580 con 0x7ff4e00ca040 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4e4e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e006d0b0 con 0x7ff4e0153de0 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d5400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cfaa0 0x7ff4e00b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d5400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cfaa0 0x7ff4e00b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38024/0 (socket says 172.21.15.115:38024) 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d5400640 1 -- 172.21.15.115:0/1145050024 learned_addr learned my addr 172.21.15.115:0/1145050024 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4dde00640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4e00ca040 0x7ff4e006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4de800640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4e0153de0 0x7ff4e0157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d5400640 1 -- 172.21.15.115:0/1145050024 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4e0153de0 msgr2=0x7ff4e0157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d5400640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4e0153de0 0x7ff4e0157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d5400640 1 -- 172.21.15.115:0/1145050024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4e00ca040 msgr2=0x7ff4e006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d5400640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4e00ca040 0x7ff4e006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d5400640 1 -- 172.21.15.115:0/1145050024 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e00cf540 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d5400640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cfaa0 0x7ff4e00b4360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff4c801b8e0 tx=0x7ff4c801ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d6a00640 1 -- 172.21.15.115:0/1145050024 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80b5040 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d6a00640 1 -- 172.21.15.115:0/1145050024 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c8004040 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4e4e00640 1 -- 172.21.15.115:0/1145050024 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e01f1d70 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4d6a00640 1 -- 172.21.15.115:0/1145050024 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80043f0 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4e4e00640 1 -- 172.21.15.115:0/1145050024 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e01f2330 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.077+0000 7ff4e4e00640 1 -- 172.21.15.115:0/1145050024 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e0069730 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.081+0000 7ff4d6a00640 1 -- 172.21.15.115:0/1145050024 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff4c80c1020 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.081+0000 7ff4d6a00640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff4bc06f430 0x7ff4bc0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.081+0000 7ff4d6a00640 1 -- 172.21.15.115:0/1145050024 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff4c812c290 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.081+0000 7ff4dde00640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff4bc06f430 0x7ff4bc0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.081+0000 7ff4dde00640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff4bc06f430 0x7ff4bc0718f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0001130 tx=0x7ff4d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:08.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.085+0000 7ff4d6a00640 1 -- 172.21.15.115:0/1145050024 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff4c80c8020 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 -- 172.21.15.115:0/1145050024 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4e00c5d50 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4d6a00640 1 -- 172.21.15.115:0/1145050024 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7ff4e00cf540 con 0x7ff4e00cfaa0 2024-05-12T10:54:08.275 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:54:08.275 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:54:08.276 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:54:08.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 -- 172.21.15.115:0/1145050024 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff4bc06f430 msgr2=0x7ff4bc0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff4bc06f430 0x7ff4bc0718f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0001130 tx=0x7ff4d0009040 comp rx=0 tx=0).stop 2024-05-12T10:54:08.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 -- 172.21.15.115:0/1145050024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cfaa0 msgr2=0x7ff4e00b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cfaa0 0x7ff4e00b4360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff4c801b8e0 tx=0x7ff4c801ba70 comp rx=0 tx=0).stop 2024-05-12T10:54:08.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 -- 172.21.15.115:0/1145050024 shutdown_connections 2024-05-12T10:54:08.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff4bc06f430 0x7ff4bc0718f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4e0153de0 0x7ff4e0157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cfaa0 0x7ff4e00b4360 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 --2- 172.21.15.115:0/1145050024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4e00ca040 0x7ff4e006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 -- 172.21.15.115:0/1145050024 >> 172.21.15.115:0/1145050024 conn(0x7ff4e006c440 msgr2=0x7ff4e01e4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:08.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 -- 172.21.15.115:0/1145050024 shutdown_connections 2024-05-12T10:54:08.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.281+0000 7ff4e4e00640 1 -- 172.21.15.115:0/1145050024 wait complete. 2024-05-12T10:54:08.297 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-12T10:54:08.297 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-12T10:54:08.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.453+0000 7f12d5000640 1 Processor -- start 2024-05-12T10:54:08.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.453+0000 7f12d5000640 1 -- start start 2024-05-12T10:54:08.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12d5000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12d015ff40 0x7f12d00cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12d5000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12d0071a40 0x7f12d0166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12d5000640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d00cb6e0 con 0x7f12d00cff80 2024-05-12T10:54:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12d5000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f12d0160320 con 0x7f12d0071a40 2024-05-12T10:54:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12d5000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f12d00cb020 con 0x7f12d015ff40 2024-05-12T10:54:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12cd400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f12d00cff80 0x7f12d0070c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34162/0 (socket says 172.21.15.115:34162) 2024-05-12T10:54:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12cd400640 1 -- 172.21.15.115:0/4150656798 learned_addr learned my addr 172.21.15.115:0/4150656798 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:54:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12ce800640 1 --2- 172.21.15.115:0/4150656798 >> v2:172.21.15.134:3300/0 conn(0x7f12d0071a40 0x7f12d0166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12cde00640 1 --2- 172.21.15.115:0/4150656798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12d015ff40 0x7f12d00cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12cca00640 1 -- 172.21.15.115:0/4150656798 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2512369076 0 0) 0x7f12d00cb6e0 con 0x7f12d00cff80 2024-05-12T10:54:08.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12cca00640 1 -- 172.21.15.115:0/4150656798 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12b4003530 con 0x7f12d00cff80 2024-05-12T10:54:08.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12cca00640 1 -- 172.21.15.115:0/4150656798 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4265004051 0 0) 0x7f12b4003530 con 0x7f12d00cff80 2024-05-12T10:54:08.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12cde00640 1 -- 172.21.15.115:0/4150656798 >> v2:172.21.15.134:3300/0 conn(0x7f12d0071a40 msgr2=0x7f12d0166710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:08.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12cde00640 1 --2- 172.21.15.115:0/4150656798 >> v2:172.21.15.134:3300/0 conn(0x7f12d0071a40 0x7f12d0166710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12cde00640 1 -- 172.21.15.115:0/4150656798 >> v1:172.21.15.115:6789/0 conn(0x7f12d00cff80 legacy=0x7f12d0070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12cde00640 1 -- 172.21.15.115:0/4150656798 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d00cb9a0 con 0x7f12d015ff40 2024-05-12T10:54:08.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.457+0000 7f12ce800640 1 --2- 172.21.15.115:0/4150656798 >> v2:172.21.15.134:3300/0 conn(0x7f12d0071a40 0x7f12d0166710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:54:08.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12cde00640 1 --2- 172.21.15.115:0/4150656798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12d015ff40 0x7f12d00cfa40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f12c00097c0 tx=0x7f12c001ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8afd3a17c1f1bbf server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:08.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12cca00640 1 -- 172.21.15.115:0/4150656798 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c00b5070 con 0x7f12d015ff40 2024-05-12T10:54:08.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12cca00640 1 -- 172.21.15.115:0/4150656798 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c00a85f0 con 0x7f12d015ff40 2024-05-12T10:54:08.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12cca00640 1 -- 172.21.15.115:0/4150656798 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc001700 con 0x7f12d015ff40 2024-05-12T10:54:08.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12d5000640 1 -- 172.21.15.115:0/4150656798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12d015ff40 msgr2=0x7f12d00cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12d5000640 1 --2- 172.21.15.115:0/4150656798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12d015ff40 0x7f12d00cfa40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f12c00097c0 tx=0x7f12c001ebb0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12d5000640 1 -- 172.21.15.115:0/4150656798 shutdown_connections 2024-05-12T10:54:08.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12d5000640 1 --2- 172.21.15.115:0/4150656798 >> v2:172.21.15.134:3300/0 conn(0x7f12d0071a40 0x7f12d0166710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12d5000640 1 --2- 172.21.15.115:0/4150656798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12d015ff40 0x7f12d00cfa40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12d5000640 1 -- 172.21.15.115:0/4150656798 >> 172.21.15.115:0/4150656798 conn(0x7f12d006c610 msgr2=0x7f12d006ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:08.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12d5000640 1 -- 172.21.15.115:0/4150656798 shutdown_connections 2024-05-12T10:54:08.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.461+0000 7f12d5000640 1 -- 172.21.15.115:0/4150656798 wait complete. 2024-05-12T10:54:08.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12d5000640 1 Processor -- start 2024-05-12T10:54:08.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12d5000640 1 -- start start 2024-05-12T10:54:08.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12d5000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00cff80 0x7f12d00c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12d5000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d015ff40 0x7f12d01545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12d5000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12d00b4520 0x7f12d01f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12d5000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f12d00cacb0 con 0x7f12d00cff80 2024-05-12T10:54:08.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12d5000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12d00ca9d0 con 0x7f12d015ff40 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12d5000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f12d015f3e0 con 0x7f12d00b4520 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12cde00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00cff80 0x7f12d00c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12cde00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00cff80 0x7f12d00c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38040/0 (socket says 172.21.15.115:38040) 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12cde00640 1 -- 172.21.15.115:0/4095206177 learned_addr learned my addr 172.21.15.115:0/4095206177 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12ce800640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12d00b4520 0x7f12d01f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12cd400640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d015ff40 0x7f12d01545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12cde00640 1 -- 172.21.15.115:0/4095206177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12d00b4520 msgr2=0x7f12d01f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12cde00640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12d00b4520 0x7f12d01f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12cde00640 1 -- 172.21.15.115:0/4095206177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d015ff40 msgr2=0x7f12d01545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12cde00640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d015ff40 0x7f12d01545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12cde00640 1 -- 172.21.15.115:0/4095206177 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d00b1720 con 0x7f12d00cff80 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12cd400640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d015ff40 0x7f12d01545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:54:08.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12cde00640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00cff80 0x7f12d00c9440 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f12c00b3040 tx=0x7f12c001b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:08.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12c6000640 1 -- 172.21.15.115:0/4095206177 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c00bf070 con 0x7f12d00cff80 2024-05-12T10:54:08.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12c6000640 1 -- 172.21.15.115:0/4095206177 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c00a9a30 con 0x7f12d00cff80 2024-05-12T10:54:08.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12c6000640 1 -- 172.21.15.115:0/4095206177 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c00b5040 con 0x7f12d00cff80 2024-05-12T10:54:08.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12d5000640 1 -- 172.21.15.115:0/4095206177 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d00b2450 con 0x7f12d00cff80 2024-05-12T10:54:08.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.465+0000 7f12d5000640 1 -- 172.21.15.115:0/4095206177 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d00b2a10 con 0x7f12d00cff80 2024-05-12T10:54:08.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12c6000640 1 -- 172.21.15.115:0/4095206177 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f12c00c2070 con 0x7f12d00cff80 2024-05-12T10:54:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12c6000640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f12b006f400 0x7f12b00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12c6000640 1 -- 172.21.15.115:0/4095206177 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f12c012bde0 con 0x7f12d00cff80 2024-05-12T10:54:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12cd400640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f12b006f400 0x7f12b00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12d842b000 1 Processor -- start 2024-05-12T10:54:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12d842b000 1 -- start start 2024-05-12T10:54:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12cd400640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f12b006f400 0x7f12b00718c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f12bc001ec0 tx=0x7f12bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12d842b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720cacdf0 0x556720ce2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12d842b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12d842b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720ce7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12d842b000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556720af60f0 con 0x556720ce2c80 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12d842b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556720aaf670 con 0x556720cacdf0 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12d842b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x556720af20b0 con 0x556720ce7a10 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12cd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12cd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38042/0 (socket says 172.21.15.115:38042) 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12cd400640 1 -- 172.21.15.115:0/647524606 learned_addr learned my addr 172.21.15.115:0/647524606 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12ce800640 1 --2- 172.21.15.115:0/647524606 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720ce7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.469+0000 7f12cde00640 1 --2- 172.21.15.115:0/647524606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720cacdf0 0x556720ce2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12cd400640 1 -- 172.21.15.115:0/647524606 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 msgr2=0x556720ce7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12cd400640 1 --2- 172.21.15.115:0/647524606 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720ce7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12cd400640 1 -- 172.21.15.115:0/647524606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720cacdf0 msgr2=0x556720ce2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12cd400640 1 --2- 172.21.15.115:0/647524606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720cacdf0 0x556720ce2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12cd400640 1 -- 172.21.15.115:0/647524606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556720ab8010 con 0x556720ce2c80 2024-05-12T10:54:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12cd400640 1 --2- 172.21.15.115:0/647524606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce3060 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f12d0155820 tx=0x7f12bc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828be48952647c0d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12baa00640 1 -- 172.21.15.115:0/647524606 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00e960 con 0x556720ce2c80 2024-05-12T10:54:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12baa00640 1 -- 172.21.15.115:0/647524606 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12bc00eb00 con 0x556720ce2c80 2024-05-12T10:54:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12baa00640 1 -- 172.21.15.115:0/647524606 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc021450 con 0x556720ce2c80 2024-05-12T10:54:08.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 -- 172.21.15.115:0/647524606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 msgr2=0x556720ce3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 --2- 172.21.15.115:0/647524606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce3060 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f12d0155820 tx=0x7f12bc011000 comp rx=0 tx=0).stop 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 -- 172.21.15.115:0/647524606 shutdown_connections 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 --2- 172.21.15.115:0/647524606 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720ce7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 --2- 172.21.15.115:0/647524606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce3060 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 --2- 172.21.15.115:0/647524606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720cacdf0 0x556720ce2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 -- 172.21.15.115:0/647524606 >> 172.21.15.115:0/647524606 conn(0x556720b8ef90 msgr2=0x556720ce57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 -- 172.21.15.115:0/647524606 shutdown_connections 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 -- 172.21.15.115:0/647524606 wait complete. 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 -- start start 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 Processor -- start 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720cacdf0 0x556720ce1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720ca8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556720b034f0 con 0x556720ce2c80 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556720a96900 con 0x556720cacdf0 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x556720cad1d0 con 0x556720ce7a10 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12d842b000 10 client.0 _ll_register_callbacks cb 0x556720c92180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12cd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12cd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38048/0 (socket says 172.21.15.115:38048) 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12cd400640 1 -- 172.21.15.115:0/4273038748 learned_addr learned my addr 172.21.15.115:0/4273038748 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12cde00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720cacdf0 0x556720ce1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.473+0000 7f12ce800640 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720ca8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12cd400640 1 -- 172.21.15.115:0/4273038748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 msgr2=0x556720ca8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12cd400640 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720ca8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12cd400640 1 -- 172.21.15.115:0/4273038748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720cacdf0 msgr2=0x556720ce1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12cd400640 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720cacdf0 0x556720ce1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12cd400640 1 -- 172.21.15.115:0/4273038748 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556720aa8e40 con 0x556720ce2c80 2024-05-12T10:54:08.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12cd400640 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce2270 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0074a0 tx=0x7f12bc007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f23c9ec70ad1784 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:08.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12af400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:54:08.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12af400640 1 -- 172.21.15.115:0/4273038748 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00e960 con 0x556720ce2c80 2024-05-12T10:54:08.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12d842b000 1 -- 172.21.15.115:0/4273038748 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12bc00eb00 con 0x556720ce2c80 2024-05-12T10:54:08.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12af400640 1 -- 172.21.15.115:0/4273038748 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f12bc021660 con 0x556720ce2c80 2024-05-12T10:54:08.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12af400640 1 -- 172.21.15.115:0/4273038748 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f12bc034050 con 0x556720ce2c80 2024-05-12T10:54:08.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12d842b000 10 client.5088 fetch_fsmap learned FSMap version 14 2024-05-12T10:54:08.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12d842b000 1 -- 172.21.15.115:0/4273038748 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x556720bc0ab0 con 0x556720ce2c80 2024-05-12T10:54:08.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12af400640 1 -- 172.21.15.115:0/4273038748 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12bc00eb00 con 0x556720ce2c80 2024-05-12T10:54:08.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12af400640 1 -- 172.21.15.115:0/4273038748 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f12bc037020 con 0x556720ce2c80 2024-05-12T10:54:08.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12d842b000 10 client.5088 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:54:08.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12d842b000 10 client.5088 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:54:08.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12d842b000 20 client.5088 populate_metadata read hostname 'smithi115' 2024-05-12T10:54:08.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12d842b000 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x556720ca8f20 0x556720ca9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12d842b000 4 client.5088 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:54:08.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12d842b000 1 -- 172.21.15.115:0/4273038748 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556720a8f7f0 con 0x556720ca8f20 2024-05-12T10:54:08.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12cde00640 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x556720ca8f20 0x556720ca9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12cde00640 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x556720ca8f20 0x556720ca9300 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22f65455a85cc860 server_cookie=296c6ceb7514ac5d in_seq=0 out_seq=0 2024-05-12T10:54:08.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.477+0000 7f12af400640 10 client.5088 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:08.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12af400640 1 -- 172.21.15.115:0/4273038748 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556720a8f7f0 con 0x556720ca8f20 2024-05-12T10:54:08.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12af400640 10 client.5088 handle_command_reply: tid=0 2024-05-12T10:54:08.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 1 client.5088 shutdown 2024-05-12T10:54:08.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 1 -- 172.21.15.115:0/4273038748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 msgr2=0x556720ce2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce2270 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0074a0 tx=0x7f12bc007000 comp rx=0 tx=0).stop 2024-05-12T10:54:08.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 1 -- 172.21.15.115:0/4273038748 shutdown_connections 2024-05-12T10:54:08.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720ca8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720ce2c80 0x556720ce2270 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x556720ca8f20 0x556720ca9300 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 1 --2- 172.21.15.115:0/4273038748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720cacdf0 0x556720ce1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12af400640 0 client.5088 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:08.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 1 -- 172.21.15.115:0/4273038748 >> 172.21.15.115:0/4273038748 conn(0x556720b8ef90 msgr2=0x556720ce5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:08.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 1 -- 172.21.15.115:0/4273038748 shutdown_connections 2024-05-12T10:54:08.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 1 -- 172.21.15.115:0/4273038748 wait complete. 2024-05-12T10:54:08.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.481+0000 7f12d842b000 20 client.5088 trim_cache size 0 max 16384 2024-05-12T10:54:08.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.497+0000 7f12d842b000 1 Processor -- start 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.497+0000 7f12d842b000 1 -- start start 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.497+0000 7f12d842b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720cfe400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.497+0000 7f12d842b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720ce2c80 0x556720cfe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.497+0000 7f12d842b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720cfee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.497+0000 7f12d842b000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01fff00 con 0x556720cacdf0 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.497+0000 7f12d842b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01fe670 con 0x556720ce2c80 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.497+0000 7f12d842b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f12d00b0580 con 0x556720ce7a10 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.497+0000 7f12cde00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720cfe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.497+0000 7f12cde00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720cfe400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38054/0 (socket says 172.21.15.115:38054) 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.497+0000 7f12cde00640 1 -- 172.21.15.115:0/1433628792 learned_addr learned my addr 172.21.15.115:0/1433628792 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12cd400640 1 --2- 172.21.15.115:0/1433628792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720ce2c80 0x556720cfe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12ce800640 1 --2- 172.21.15.115:0/1433628792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720cfee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12cde00640 1 -- 172.21.15.115:0/1433628792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 msgr2=0x556720cfee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:08.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12cde00640 1 --2- 172.21.15.115:0/1433628792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720cfee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12cde00640 1 -- 172.21.15.115:0/1433628792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720ce2c80 msgr2=0x556720cfe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:08.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12cde00640 1 --2- 172.21.15.115:0/1433628792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720ce2c80 0x556720cfe940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12cde00640 1 -- 172.21.15.115:0/1433628792 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556720ce5f80 con 0x556720cacdf0 2024-05-12T10:54:08.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12cde00640 1 --2- 172.21.15.115:0/1433628792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720cfe400 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f12c00f4390 tx=0x7f12c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf24e5472202fd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:08.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12ba000640 1 -- 172.21.15.115:0/1433628792 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c00fc610 con 0x556720cacdf0 2024-05-12T10:54:08.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12ba000640 1 -- 172.21.15.115:0/1433628792 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c0101030 con 0x556720cacdf0 2024-05-12T10:54:08.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12ba000640 1 -- 172.21.15.115:0/1433628792 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c00f45a0 con 0x556720cacdf0 2024-05-12T10:54:08.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 -- 172.21.15.115:0/1433628792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 msgr2=0x556720cfe400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 --2- 172.21.15.115:0/1433628792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720cfe400 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f12c00f4390 tx=0x7f12c0008040 comp rx=0 tx=0).stop 2024-05-12T10:54:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 -- 172.21.15.115:0/1433628792 shutdown_connections 2024-05-12T10:54:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 --2- 172.21.15.115:0/1433628792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720cfee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 --2- 172.21.15.115:0/1433628792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720ce2c80 0x556720cfe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 --2- 172.21.15.115:0/1433628792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720cfe400 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 -- 172.21.15.115:0/1433628792 >> 172.21.15.115:0/1433628792 conn(0x556720b8ef90 msgr2=0x556720cab310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 -- 172.21.15.115:0/1433628792 shutdown_connections 2024-05-12T10:54:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 -- 172.21.15.115:0/1433628792 wait complete. 2024-05-12T10:54:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 -- start start 2024-05-12T10:54:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 Processor -- start 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720d01640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720ce2c80 0x556720d01b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720d020c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556720a8c3e0 con 0x556720cacdf0 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01fdfc0 con 0x556720ce2c80 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x556720af5400 con 0x556720ce7a10 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12d842b000 10 client.0 _ll_register_callbacks cb 0x7f12c0009420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12cde00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720d01640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12cde00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720d01640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38056/0 (socket says 172.21.15.115:38056) 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12cde00640 1 -- 172.21.15.115:0/1700338777 learned_addr learned my addr 172.21.15.115:0/1700338777 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12ce800640 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720d020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.501+0000 7f12cd400640 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720ce2c80 0x556720d01b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12cde00640 1 -- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 msgr2=0x556720d020c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12cde00640 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720d020c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12cde00640 1 -- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720ce2c80 msgr2=0x556720d01b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12cde00640 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720ce2c80 0x556720d01b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12cde00640 1 -- 172.21.15.115:0/1700338777 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556720b76e30 con 0x556720cacdf0 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12cde00640 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720d01640 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f12c009b390 tx=0x7f12c0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909d394cc1c75724 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12af400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12af400640 1 -- 172.21.15.115:0/1700338777 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c0100ba0 con 0x556720cacdf0 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12af400640 1 -- 172.21.15.115:0/1700338777 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f12c0100d40 con 0x556720cacdf0 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12d842b000 1 -- 172.21.15.115:0/1700338777 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12c0101030 con 0x556720cacdf0 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12af400640 1 -- 172.21.15.115:0/1700338777 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f12c00fc120 con 0x556720cacdf0 2024-05-12T10:54:08.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12d842b000 10 client.5094 fetch_fsmap learned FSMap version 14 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12d842b000 1 -- 172.21.15.115:0/1700338777 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x556720a87d80 con 0x556720cacdf0 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12af400640 1 -- 172.21.15.115:0/1700338777 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c0101030 con 0x556720cacdf0 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12af400640 1 -- 172.21.15.115:0/1700338777 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f12c00b8070 con 0x556720cacdf0 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12d842b000 10 client.5094 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12d842b000 10 client.5094 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12d842b000 20 client.5094 populate_metadata read hostname 'smithi115' 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12d842b000 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x556720d02600 0x556720d029e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12d842b000 4 client.5094 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12d842b000 1 -- 172.21.15.115:0/1700338777 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x556720b03d00 con 0x556720d02600 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12cd400640 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x556720d02600 0x556720d029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12cd400640 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x556720d02600 0x556720d029e0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7de68ea9dfa80487 server_cookie=e2737d168e68666c in_seq=0 out_seq=0 2024-05-12T10:54:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.505+0000 7f12af400640 10 client.5094 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:08.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12af400640 1 -- 172.21.15.115:0/1700338777 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556720b03d00 con 0x556720d02600 2024-05-12T10:54:08.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12af400640 10 client.5094 handle_command_reply: tid=0 2024-05-12T10:54:08.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 1 client.5094 shutdown 2024-05-12T10:54:08.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 1 -- 172.21.15.115:0/1700338777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 msgr2=0x556720d01640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720d01640 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f12c009b390 tx=0x7f12c0009190 comp rx=0 tx=0).stop 2024-05-12T10:54:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 1 -- 172.21.15.115:0/1700338777 shutdown_connections 2024-05-12T10:54:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556720ce7a10 0x556720d020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x556720d02600 0x556720d029e0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556720ce2c80 0x556720d01b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 1 --2- 172.21.15.115:0/1700338777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556720cacdf0 0x556720d01640 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12af400640 0 client.5094 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 1 -- 172.21.15.115:0/1700338777 >> 172.21.15.115:0/1700338777 conn(0x556720b8ef90 msgr2=0x556720ca7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 1 -- 172.21.15.115:0/1700338777 shutdown_connections 2024-05-12T10:54:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 1 -- 172.21.15.115:0/1700338777 wait complete. 2024-05-12T10:54:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d842b000 20 client.5094 trim_cache size 0 max 16384 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 14, 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout: "59ebe002": { 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 14, 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:54:08.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 90.0, 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:08.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:08.520 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:08.520 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:54:08.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 -- 172.21.15.115:0/4095206177 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f12b006f400 msgr2=0x7f12b00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f12b006f400 0x7f12b00718c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f12bc001ec0 tx=0x7f12bc009040 comp rx=0 tx=0).stop 2024-05-12T10:54:08.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 -- 172.21.15.115:0/4095206177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00cff80 msgr2=0x7f12d00c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:08.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00cff80 0x7f12d00c9440 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f12c00b3040 tx=0x7f12c001b950 comp rx=0 tx=0).stop 2024-05-12T10:54:08.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 -- 172.21.15.115:0/4095206177 shutdown_connections 2024-05-12T10:54:08.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f12b006f400 0x7f12b00718c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12d00b4520 0x7f12d01f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d015ff40 0x7f12d01545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 --2- 172.21.15.115:0/4095206177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12d00cff80 0x7f12d00c9440 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:08.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 -- 172.21.15.115:0/4095206177 >> 172.21.15.115:0/4095206177 conn(0x7f12d006c610 msgr2=0x7f12d0070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:08.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 -- 172.21.15.115:0/4095206177 shutdown_connections 2024-05-12T10:54:08.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:08.521+0000 7f12d5000640 1 -- 172.21.15.115:0/4095206177 wait complete. 2024-05-12T10:54:08.535 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '59ebe002', quiesce took 0.6 seconds. Will release after: 30.0 2024-05-12T10:54:20.475 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:54:20.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:54:38.537 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:54:38.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.689+0000 7fc2b9e00640 1 Processor -- start 2024-05-12T10:54:38.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.689+0000 7fc2b9e00640 1 -- start start 2024-05-12T10:54:38.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.689+0000 7fc2b9e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 0x7fc2b40c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:38.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc2b40cb100 0x7fc2b40c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9e00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2b40cb9a0 con 0x7fc2b40c62a0 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9e00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b40ca4f0 con 0x7fc2b40cb100 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b40cbc40 con 0x7fc2b4153bf0 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc2b40cb100 0x7fc2b40c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc2b40cb100 0x7fc2b40c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54226/0 (socket says 172.21.15.115:54226) 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9400640 1 -- 172.21.15.115:0/4020066329 learned_addr learned my addr 172.21.15.115:0/4020066329 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b8a00640 1 --2- 172.21.15.115:0/4020066329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 0x7fc2b40c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9400640 1 -- 172.21.15.115:0/4020066329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 msgr2=0x7fc2b40c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9400640 1 --2- 172.21.15.115:0/4020066329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 0x7fc2b40c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9400640 1 -- 172.21.15.115:0/4020066329 >> v1:172.21.15.115:6789/0 conn(0x7fc2b40c62a0 legacy=0x7fc2b40ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9400640 1 -- 172.21.15.115:0/4020066329 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b4071e60 con 0x7fc2b40cb100 2024-05-12T10:54:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b8a00640 1 --2- 172.21.15.115:0/4020066329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 0x7fc2b40c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:54:38.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b9400640 1 --2- 172.21.15.115:0/4020066329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b40cb100 0x7fc2b40c48b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009870 tx=0x7fc2ac01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11c1ea475d179da server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:38.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b3e00640 1 -- 172.21.15.115:0/4020066329 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac0b5070 con 0x7fc2b40cb100 2024-05-12T10:54:38.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b3e00640 1 -- 172.21.15.115:0/4020066329 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ac0a8a50 con 0x7fc2b40cb100 2024-05-12T10:54:38.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.693+0000 7fc2b3e00640 1 -- 172.21.15.115:0/4020066329 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac0a8e20 con 0x7fc2b40cb100 2024-05-12T10:54:38.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 -- 172.21.15.115:0/4020066329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b40cb100 msgr2=0x7fc2b40c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:38.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 --2- 172.21.15.115:0/4020066329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b40cb100 0x7fc2b40c48b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009870 tx=0x7fc2ac01ed50 comp rx=0 tx=0).stop 2024-05-12T10:54:38.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 -- 172.21.15.115:0/4020066329 shutdown_connections 2024-05-12T10:54:38.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 --2- 172.21.15.115:0/4020066329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b40cb100 0x7fc2b40c48b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:38.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 --2- 172.21.15.115:0/4020066329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 0x7fc2b40c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:38.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 -- 172.21.15.115:0/4020066329 >> 172.21.15.115:0/4020066329 conn(0x7fc2b4076230 msgr2=0x7fc2b4070230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:38.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 -- 172.21.15.115:0/4020066329 shutdown_connections 2024-05-12T10:54:38.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 -- 172.21.15.115:0/4020066329 wait complete. 2024-05-12T10:54:38.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 Processor -- start 2024-05-12T10:54:38.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 -- start start 2024-05-12T10:54:38.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2b40c62a0 0x7fc2b4150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b40cb100 0x7fc2b4150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 0x7fc2b4146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b4072700 con 0x7fc2b40cb100 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b4072420 con 0x7fc2b40c62a0 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b40cb5b0 con 0x7fc2b4153bf0 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2abe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b40cb100 0x7fc2b4150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2abe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b40cb100 0x7fc2b4150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54236/0 (socket says 172.21.15.115:54236) 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2abe00640 1 -- 172.21.15.115:0/1979558446 learned_addr learned my addr 172.21.15.115:0/1979558446 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9400640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 0x7fc2b4146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b8a00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2b40c62a0 0x7fc2b4150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2abe00640 1 -- 172.21.15.115:0/1979558446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 msgr2=0x7fc2b4146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2abe00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 0x7fc2b4146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2abe00640 1 -- 172.21.15.115:0/1979558446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2b40c62a0 msgr2=0x7fc2b4150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:38.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2abe00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2b40c62a0 0x7fc2b4150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:38.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2abe00640 1 -- 172.21.15.115:0/1979558446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b41f1ad0 con 0x7fc2b40cb100 2024-05-12T10:54:38.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.697+0000 7fc2b9400640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 0x7fc2b4146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:54:38.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.701+0000 7fc2abe00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b40cb100 0x7fc2b4150b80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00c400 tx=0x7fc29c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:38.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.701+0000 7fc2b1600640 1 -- 172.21.15.115:0/1979558446 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c017070 con 0x7fc2b40cb100 2024-05-12T10:54:38.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.701+0000 7fc2b1600640 1 -- 172.21.15.115:0/1979558446 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc29c0052d0 con 0x7fc2b40cb100 2024-05-12T10:54:38.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.701+0000 7fc2b1600640 1 -- 172.21.15.115:0/1979558446 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c003840 con 0x7fc2b40cb100 2024-05-12T10:54:38.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.701+0000 7fc2b9e00640 1 -- 172.21.15.115:0/1979558446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b41f1db0 con 0x7fc2b40cb100 2024-05-12T10:54:38.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.701+0000 7fc2b9e00640 1 -- 172.21.15.115:0/1979558446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b41f2370 con 0x7fc2b40cb100 2024-05-12T10:54:38.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.701+0000 7fc2b9e00640 1 -- 172.21.15.115:0/1979558446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b4050750 con 0x7fc2b40cb100 2024-05-12T10:54:38.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.701+0000 7fc2b1600640 1 -- 172.21.15.115:0/1979558446 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc29c01a070 con 0x7fc2b40cb100 2024-05-12T10:54:38.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.701+0000 7fc2b1600640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc29006f400 0x7fc2900718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:38.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.701+0000 7fc2b1600640 1 -- 172.21.15.115:0/1979558446 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc29c08eb50 con 0x7fc2b40cb100 2024-05-12T10:54:38.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.701+0000 7fc2b8a00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc29006f400 0x7fc2900718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:38.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.705+0000 7fc2b8a00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc29006f400 0x7fc2900718c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4004430 tx=0x7fc2a4003a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:38.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.709+0000 7fc2b1600640 1 -- 172.21.15.115:0/1979558446 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc29c005480 con 0x7fc2b40cb100 2024-05-12T10:54:38.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.897+0000 7fc2b9e00640 1 -- 172.21.15.115:0/1979558446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2b414ff80 con 0x7fc2b40cb100 2024-05-12T10:54:38.912 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.897+0000 7fc2b1600640 1 -- 172.21.15.115:0/1979558446 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7fc29c05b5a0 con 0x7fc2b40cb100 2024-05-12T10:54:38.912 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:54:38.912 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 -- 172.21.15.115:0/1979558446 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc29006f400 msgr2=0x7fc2900718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc29006f400 0x7fc2900718c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4004430 tx=0x7fc2a4003a00 comp rx=0 tx=0).stop 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 -- 172.21.15.115:0/1979558446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b40cb100 msgr2=0x7fc2b4150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b40cb100 0x7fc2b4150b80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00c400 tx=0x7fc29c00c8c0 comp rx=0 tx=0).stop 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 -- 172.21.15.115:0/1979558446 shutdown_connections 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc29006f400 0x7fc2900718c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2b4153bf0 0x7fc2b4146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2b40cb100 0x7fc2b4150b80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 --2- 172.21.15.115:0/1979558446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2b40c62a0 0x7fc2b4150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 -- 172.21.15.115:0/1979558446 >> 172.21.15.115:0/1979558446 conn(0x7fc2b4076230 msgr2=0x7fc2b4152310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:38.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 -- 172.21.15.115:0/1979558446 shutdown_connections 2024-05-12T10:54:38.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:38.901+0000 7fc2b9e00640 1 -- 172.21.15.115:0/1979558446 wait complete. 2024-05-12T10:54:38.915 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db --set-id 59ebe002 --release --await' 2024-05-12T10:54:38.915 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db --set-id 59ebe002 --release --await 2024-05-12T10:54:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.061+0000 7f5e8ee00640 1 Processor -- start 2024-05-12T10:54:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e8ee00640 1 -- start start 2024-05-12T10:54:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e8ee00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e88152ef0 0x7f5e88072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e8ee00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5e880c7700 0x7f5e880c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e8ee00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e88159980 con 0x7f5e88159490 2024-05-12T10:54:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e8ee00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f5e880c4ac0 con 0x7f5e88152ef0 2024-05-12T10:54:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e8ee00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5e880c4d60 con 0x7f5e880c7700 2024-05-12T10:54:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e87e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e88152ef0 0x7f5e88072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e8ce00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5e88159490 0x7f5e8815bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51086/0 (socket says 172.21.15.115:51086) 2024-05-12T10:54:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e8ce00640 1 -- 172.21.15.115:0/2987870824 learned_addr learned my addr 172.21.15.115:0/2987870824 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:54:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e7f400640 1 --2- 172.21.15.115:0/2987870824 >> v2:172.21.15.134:3300/0 conn(0x7f5e880c7700 0x7f5e880c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e87e00640 1 -- 172.21.15.115:0/2987870824 >> v2:172.21.15.134:3300/0 conn(0x7f5e880c7700 msgr2=0x7f5e880c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e87e00640 1 --2- 172.21.15.115:0/2987870824 >> v2:172.21.15.134:3300/0 conn(0x7f5e880c7700 0x7f5e880c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e87e00640 1 -- 172.21.15.115:0/2987870824 >> v1:172.21.15.115:6789/0 conn(0x7f5e88159490 legacy=0x7f5e8815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:39.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e87e00640 1 -- 172.21.15.115:0/2987870824 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e88072510 con 0x7f5e88152ef0 2024-05-12T10:54:39.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e7f400640 1 --2- 172.21.15.115:0/2987870824 >> v2:172.21.15.134:3300/0 conn(0x7f5e880c7700 0x7f5e880c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:54:39.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.065+0000 7f5e87400640 1 -- 172.21.15.115:0/2987870824 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186364476 0 0) 0x7f5e88159980 con 0x7f5e88159490 2024-05-12T10:54:39.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e87e00640 1 --2- 172.21.15.115:0/2987870824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e88152ef0 0x7f5e88072d10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5e88071ad0 tx=0x7f5e7801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebba9dc4a2c4699 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:39.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e87400640 1 -- 172.21.15.115:0/2987870824 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780b2070 con 0x7f5e88152ef0 2024-05-12T10:54:39.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e87400640 1 -- 172.21.15.115:0/2987870824 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e780a57f0 con 0x7f5e88152ef0 2024-05-12T10:54:39.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e87400640 1 -- 172.21.15.115:0/2987870824 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780a5bc0 con 0x7f5e88152ef0 2024-05-12T10:54:39.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2987870824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e88152ef0 msgr2=0x7f5e88072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:39.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e8ee00640 1 --2- 172.21.15.115:0/2987870824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e88152ef0 0x7f5e88072d10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5e88071ad0 tx=0x7f5e7801c930 comp rx=0 tx=0).stop 2024-05-12T10:54:39.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2987870824 shutdown_connections 2024-05-12T10:54:39.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e8ee00640 1 --2- 172.21.15.115:0/2987870824 >> v2:172.21.15.134:3300/0 conn(0x7f5e880c7700 0x7f5e880c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e8ee00640 1 --2- 172.21.15.115:0/2987870824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e88152ef0 0x7f5e88072d10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2987870824 >> 172.21.15.115:0/2987870824 conn(0x7f5e880681c0 msgr2=0x7f5e880685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:39.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2987870824 shutdown_connections 2024-05-12T10:54:39.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2987870824 wait complete. 2024-05-12T10:54:39.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e8ee00640 1 Processor -- start 2024-05-12T10:54:39.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.069+0000 7f5e8ee00640 1 -- start start 2024-05-12T10:54:39.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ee00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e880c7700 0x7f5e88149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ee00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e88152ef0 0x7f5e8814c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ee00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e88159490 0x7f5e88146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ee00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5e880c6cd0 con 0x7f5e88159490 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ee00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5e880c6b50 con 0x7f5e88152ef0 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ee00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5e880c6e50 con 0x7f5e880c7700 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ce00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e88159490 0x7f5e88146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ce00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e88159490 0x7f5e88146860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54258/0 (socket says 172.21.15.115:54258) 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ce00640 1 -- 172.21.15.115:0/2961043777 learned_addr learned my addr 172.21.15.115:0/2961043777 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e87e00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e880c7700 0x7f5e88149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e7f400640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e88152ef0 0x7f5e8814c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ce00640 1 -- 172.21.15.115:0/2961043777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e880c7700 msgr2=0x7f5e88149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ce00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e880c7700 0x7f5e88149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ce00640 1 -- 172.21.15.115:0/2961043777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e88152ef0 msgr2=0x7f5e8814c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ce00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e88152ef0 0x7f5e8814c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ce00640 1 -- 172.21.15.115:0/2961043777 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e88163660 con 0x7f5e88159490 2024-05-12T10:54:39.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e87e00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e880c7700 0x7f5e88149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:54:39.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ce00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e88159490 0x7f5e88146860 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c410 tx=0x7f5e8000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:39.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e84c00640 1 -- 172.21.15.115:0/2961043777 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e800074e0 con 0x7f5e88159490 2024-05-12T10:54:39.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e84c00640 1 -- 172.21.15.115:0/2961043777 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e800047f0 con 0x7f5e88159490 2024-05-12T10:54:39.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e84c00640 1 -- 172.21.15.115:0/2961043777 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80007680 con 0x7f5e88159490 2024-05-12T10:54:39.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2961043777 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e88163900 con 0x7f5e88159490 2024-05-12T10:54:39.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2961043777 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e881559b0 con 0x7f5e88159490 2024-05-12T10:54:39.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.073+0000 7f5e84c00640 1 -- 172.21.15.115:0/2961043777 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5e80011070 con 0x7f5e88159490 2024-05-12T10:54:39.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e84c00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f5e6406f430 0x7f5e640718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e92308000 1 Processor -- start 2024-05-12T10:54:39.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e84c00640 1 -- 172.21.15.115:0/2961043777 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5e8008f300 con 0x7f5e88159490 2024-05-12T10:54:39.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e87e00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f5e6406f430 0x7f5e640718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e92308000 1 -- start start 2024-05-12T10:54:39.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e87e00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f5e6406f430 0x7f5e640718f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e780af000 tx=0x7f5e780a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:39.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e92308000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417044600 0x55d4170449e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e92308000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046270 0x55d417046650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e92308000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d417046f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e92308000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d416f05a60 con 0x55d417046270 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e92308000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d416e6e250 con 0x55d417046b90 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e92308000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55d416e124d0 con 0x55d417044600 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046270 0x55d417046650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046270 0x55d417046650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54266/0 (socket says 172.21.15.115:54266) 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7f400640 1 -- 172.21.15.115:0/3827063797 learned_addr learned my addr 172.21.15.115:0/3827063797 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e87e00640 1 --2- 172.21.15.115:0/3827063797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417044600 0x55d4170449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e8ce00640 1 --2- 172.21.15.115:0/3827063797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d417046f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7f400640 1 -- 172.21.15.115:0/3827063797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417044600 msgr2=0x55d4170449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7f400640 1 --2- 172.21.15.115:0/3827063797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417044600 0x55d4170449e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7f400640 1 -- 172.21.15.115:0/3827063797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 msgr2=0x55d417046f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7f400640 1 --2- 172.21.15.115:0/3827063797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d417046f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7f400640 1 -- 172.21.15.115:0/3827063797 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d416e45970 con 0x55d417046270 2024-05-12T10:54:39.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7f400640 1 --2- 172.21.15.115:0/3827063797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046270 0x55d417046650 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000b940 tx=0x7f5e7000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c995aff1de72679 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:39.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7cc00640 1 -- 172.21.15.115:0/3827063797 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70018030 con 0x55d417046270 2024-05-12T10:54:39.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7cc00640 1 -- 172.21.15.115:0/3827063797 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e70004020 con 0x55d417046270 2024-05-12T10:54:39.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.077+0000 7f5e7cc00640 1 -- 172.21.15.115:0/3827063797 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70004410 con 0x55d417046270 2024-05-12T10:54:39.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 -- 172.21.15.115:0/3827063797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046270 msgr2=0x55d417046650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:39.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 --2- 172.21.15.115:0/3827063797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046270 0x55d417046650 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000b940 tx=0x7f5e7000be00 comp rx=0 tx=0).stop 2024-05-12T10:54:39.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 -- 172.21.15.115:0/3827063797 shutdown_connections 2024-05-12T10:54:39.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 --2- 172.21.15.115:0/3827063797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d417046f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 --2- 172.21.15.115:0/3827063797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046270 0x55d417046650 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 --2- 172.21.15.115:0/3827063797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417044600 0x55d4170449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 -- 172.21.15.115:0/3827063797 >> 172.21.15.115:0/3827063797 conn(0x55d41705b430 msgr2=0x55d41705d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 -- 172.21.15.115:0/3827063797 shutdown_connections 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 -- 172.21.15.115:0/3827063797 wait complete. 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 -- start start 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 Processor -- start 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d4170439e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d417043f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d417065b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d416e6a210 con 0x55d417044600 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d416e7b650 con 0x55d417046b90 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55d416eac5b0 con 0x55d417046270 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 10 client.0 _ll_register_callbacks cb 0x55d417008f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e87e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d4170439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e87e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d4170439e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54272/0 (socket says 172.21.15.115:54272) 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e87e00640 1 -- 172.21.15.115:0/2895430009 learned_addr learned my addr 172.21.15.115:0/2895430009 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e8ce00640 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d417065b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e7f400640 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d417043f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e87e00640 1 -- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 msgr2=0x55d417043f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e87e00640 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d417043f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e87e00640 1 -- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 msgr2=0x55d417065b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e87e00640 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d417065b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e87e00640 1 -- 172.21.15.115:0/2895430009 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d416eb20e0 con 0x55d417044600 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e8ce00640 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d417065b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e7f400640 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d417043f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e87e00640 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d4170439e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e78000f90 tx=0x7f5e7801b170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b87353d6591e6a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e75600640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e75600640 1 -- 172.21.15.115:0/2895430009 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780b2040 con 0x55d417044600 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 -- 172.21.15.115:0/2895430009 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e70004020 con 0x55d417044600 2024-05-12T10:54:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e75600640 1 -- 172.21.15.115:0/2895430009 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5e780b8910 con 0x55d417044600 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e75600640 1 -- 172.21.15.115:0/2895430009 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f5e780b8b10 con 0x55d417044600 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 10 client.5118 fetch_fsmap learned FSMap version 14 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.081+0000 7f5e92308000 1 -- 172.21.15.115:0/2895430009 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55d416e209e0 con 0x55d417044600 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e75600640 1 -- 172.21.15.115:0/2895430009 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e70004020 con 0x55d417044600 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e75600640 1 -- 172.21.15.115:0/2895430009 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f5e780b8cb0 con 0x55d417044600 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 10 client.5118 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 10 client.5118 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 20 client.5118 populate_metadata read hostname 'smithi115' 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55d417066840 0x55d417066c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 4 client.5118 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 -- 172.21.15.115:0/2895430009 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d416e07060 con 0x55d417066840 2024-05-12T10:54:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e7f400640 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55d417066840 0x55d417066c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e7f400640 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55d417066840 0x55d417066c50 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e02a1876d6b36dd3 server_cookie=26136d78f2a33a55 in_seq=0 out_seq=0 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e75600640 10 client.5118 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e75600640 1 -- 172.21.15.115:0/2895430009 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d416e07060 con 0x55d417066840 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e75600640 10 client.5118 handle_command_reply: tid=0 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 client.5118 shutdown 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 -- 172.21.15.115:0/2895430009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 msgr2=0x55d4170439e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d4170439e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e78000f90 tx=0x7f5e7801b170 comp rx=0 tx=0).stop 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 -- 172.21.15.115:0/2895430009 shutdown_connections 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55d417066840 0x55d417066c50 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d417065b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d417043f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 --2- 172.21.15.115:0/2895430009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d4170439e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e75600640 0 client.5118 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 -- 172.21.15.115:0/2895430009 >> 172.21.15.115:0/2895430009 conn(0x55d41705b430 msgr2=0x55d41705d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 -- 172.21.15.115:0/2895430009 shutdown_connections 2024-05-12T10:54:39.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.085+0000 7f5e92308000 1 -- 172.21.15.115:0/2895430009 wait complete. 2024-05-12T10:54:39.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.089+0000 7f5e92308000 20 client.5118 trim_cache size 0 max 16384 2024-05-12T10:54:39.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 Processor -- start 2024-05-12T10:54:39.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 -- start start 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d417064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d4170650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d41707b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5e88201df0 con 0x55d417044600 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5e88201200 con 0x55d417046b90 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5e88201790 con 0x55d417046270 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e87e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d417064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e87e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d417064ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54284/0 (socket says 172.21.15.115:54284) 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e87e00640 1 -- 172.21.15.115:0/569380486 learned_addr learned my addr 172.21.15.115:0/569380486 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e8ce00640 1 --2- 172.21.15.115:0/569380486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d41707b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e7f400640 1 --2- 172.21.15.115:0/569380486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d4170650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e87e00640 1 -- 172.21.15.115:0/569380486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 msgr2=0x55d4170650e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:39.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e87e00640 1 --2- 172.21.15.115:0/569380486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d4170650e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e87e00640 1 -- 172.21.15.115:0/569380486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 msgr2=0x55d41707b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:39.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e87e00640 1 --2- 172.21.15.115:0/569380486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d41707b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e87e00640 1 -- 172.21.15.115:0/569380486 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d416e126e0 con 0x55d417044600 2024-05-12T10:54:39.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e87e00640 1 --2- 172.21.15.115:0/569380486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d417064ba0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5e78019540 tx=0x7f5e780c2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729420cfeb9da9e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:39.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e77e00640 1 -- 172.21.15.115:0/569380486 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780b2040 con 0x55d417044600 2024-05-12T10:54:39.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e77e00640 1 -- 172.21.15.115:0/569380486 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e780ca070 con 0x55d417044600 2024-05-12T10:54:39.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e77e00640 1 -- 172.21.15.115:0/569380486 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780cd7c0 con 0x55d417044600 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 -- 172.21.15.115:0/569380486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 msgr2=0x55d417064ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 --2- 172.21.15.115:0/569380486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d417064ba0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5e78019540 tx=0x7f5e780c2000 comp rx=0 tx=0).stop 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 -- 172.21.15.115:0/569380486 shutdown_connections 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 --2- 172.21.15.115:0/569380486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417046b90 0x55d41707b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 --2- 172.21.15.115:0/569380486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d4170650e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 --2- 172.21.15.115:0/569380486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417044600 0x55d417064ba0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 -- 172.21.15.115:0/569380486 >> 172.21.15.115:0/569380486 conn(0x55d41705b430 msgr2=0x55d417064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 -- 172.21.15.115:0/569380486 shutdown_connections 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.105+0000 7f5e92308000 1 -- 172.21.15.115:0/569380486 wait complete. 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 -- start start 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 Processor -- start 2024-05-12T10:54:39.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417044600 0x55d417066c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d417067190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046b90 0x55d4170676d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d416e03c50 con 0x55d417046b90 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d416e66d70 con 0x55d417044600 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55d416e6d560 con 0x55d417046270 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 10 client.0 _ll_register_callbacks cb 0x7f5e780b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e8ce00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046b90 0x55d4170676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e8ce00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046b90 0x55d4170676d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54286/0 (socket says 172.21.15.115:54286) 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e8ce00640 1 -- 172.21.15.115:0/3812098538 learned_addr learned my addr 172.21.15.115:0/3812098538 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e7f400640 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d417067190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e87e00640 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417044600 0x55d417066c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e8ce00640 1 -- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 msgr2=0x55d417067190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e8ce00640 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d417067190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e8ce00640 1 -- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417044600 msgr2=0x55d417066c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e8ce00640 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417044600 0x55d417066c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e8ce00640 1 -- 172.21.15.115:0/3812098538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d416ec52a0 con 0x55d417046b90 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e8ce00640 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046b90 0x55d4170676d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c3e0 tx=0x7f5e8005b160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5477c821b60a9d12 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e75600640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e75600640 1 -- 172.21.15.115:0/3812098538 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80064220 con 0x55d417046b90 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e75600640 1 -- 172.21.15.115:0/3812098538 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5e8005a8b0 con 0x55d417046b90 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 -- 172.21.15.115:0/3812098538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e780ca070 con 0x55d417046b90 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e75600640 1 -- 172.21.15.115:0/3812098538 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f5e8005fa00 con 0x55d417046b90 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 10 client.5124 fetch_fsmap learned FSMap version 14 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 -- 172.21.15.115:0/3812098538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55d416e029c0 con 0x55d417046b90 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e75600640 1 -- 172.21.15.115:0/3812098538 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e780ca070 con 0x55d417046b90 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e75600640 1 -- 172.21.15.115:0/3812098538 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f5e80056fc0 con 0x55d417046b90 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 10 client.5124 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 10 client.5124 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:54:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 20 client.5124 populate_metadata read hostname 'smithi115' 2024-05-12T10:54:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55d417067c10 0x55d417068020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:54:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 4 client.5124 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "59ebe002", "release": true, "await": true}] 2024-05-12T10:54:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e92308000 1 -- 172.21.15.115:0/3812098538 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "set_id": "59ebe002", "release": true, "await": true}) -- 0x55d416e7be60 con 0x55d417067c10 2024-05-12T10:54:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.109+0000 7f5e87e00640 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55d417067c10 0x55d417068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:54:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e87e00640 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55d417067c10 0x55d417068020 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62aa438a25c8d157 server_cookie=f300f9af3e10c6a1 in_seq=0 out_seq=0 2024-05-12T10:54:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e75600640 10 client.5124 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e75600640 1 -- 172.21.15.115:0/3812098538 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d416e7be60 con 0x55d417067c10 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e75600640 10 client.5124 handle_command_reply: tid=0 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 1 client.5124 shutdown 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 1 -- 172.21.15.115:0/3812098538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046b90 msgr2=0x55d4170676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046b90 0x55d4170676d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c3e0 tx=0x7f5e8005b160 comp rx=0 tx=0).stop 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 1 -- 172.21.15.115:0/3812098538 shutdown_connections 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d417046b90 0x55d4170676d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d417046270 0x55d417067190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55d417067c10 0x55d417068020 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 1 --2- 172.21.15.115:0/3812098538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d417044600 0x55d417066c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 1 -- 172.21.15.115:0/3812098538 >> 172.21.15.115:0/3812098538 conn(0x55d41705b430 msgr2=0x55d41705a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e75600640 0 client.5124 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 1 -- 172.21.15.115:0/3812098538 shutdown_connections 2024-05-12T10:54:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 1 -- 172.21.15.115:0/3812098538 wait complete. 2024-05-12T10:54:39.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e92308000 20 client.5124 trim_cache size 0 max 16384 2024-05-12T10:54:39.111 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:54:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:54:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:54:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 16, 2024-05-12T10:54:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:54:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "59ebe002": { 2024-05-12T10:54:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 16, 2024-05-12T10:54:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:54:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:54:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 90.0, 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:54:39.112 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:54:39.113 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2961043777 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f5e6406f430 msgr2=0x7f5e640718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:39.113 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e8ee00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f5e6406f430 0x7f5e640718f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e780af000 tx=0x7f5e780a7070 comp rx=0 tx=0).stop 2024-05-12T10:54:39.113 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2961043777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e88159490 msgr2=0x7f5e88146860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:54:39.113 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e8ee00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e88159490 0x7f5e88146860 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c410 tx=0x7f5e8000c8d0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.113 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2961043777 shutdown_connections 2024-05-12T10:54:39.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e8ee00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f5e6406f430 0x7f5e640718f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e8ee00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e88159490 0x7f5e88146860 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e8ee00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e88152ef0 0x7f5e8814c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e8ee00640 1 --2- 172.21.15.115:0/2961043777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e880c7700 0x7f5e88149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:54:39.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.113+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2961043777 >> 172.21.15.115:0/2961043777 conn(0x7f5e880681c0 msgr2=0x7f5e880c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:54:39.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.117+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2961043777 shutdown_connections 2024-05-12T10:54:39.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:54:39.117+0000 7f5e8ee00640 1 -- 172.21.15.115:0/2961043777 wait complete. 2024-05-12T10:54:39.130 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '59ebe002', seconds elapsed: 31.2 2024-05-12T10:54:42.151 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:54:42.151 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 initial writers = 30612.50 kB/sec 2024-05-12T10:54:42.151 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 initial writers = 30611.82 kB/sec 2024-05-12T10:54:42.152 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 30612.50 kB/sec 2024-05-12T10:54:42.152 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 30612.50 kB/sec 2024-05-12T10:54:42.152 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 30612.50 kB/sec 2024-05-12T10:54:42.152 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 1048576.00 kB 2024-05-12T10:54:50.522 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:54:50.526 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:54:51.662 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:54:51.663 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 rewriters = 147077.89 kB/sec 2024-05-12T10:54:51.663 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 rewriters = 147067.07 kB/sec 2024-05-12T10:54:51.663 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 147077.89 kB/sec 2024-05-12T10:54:51.663 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 147077.89 kB/sec 2024-05-12T10:54:51.663 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 147077.89 kB/sec 2024-05-12T10:54:51.663 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 1048576.00 kB 2024-05-12T10:54:55.095 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:54:55.095 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 readers = 5258891.00 kB/sec 2024-05-12T10:54:55.095 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 readers = 5245162.21 kB/sec 2024-05-12T10:54:55.095 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 5258891.00 kB/sec 2024-05-12T10:54:55.095 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 5258891.00 kB/sec 2024-05-12T10:54:55.095 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 5258891.00 kB/sec 2024-05-12T10:54:55.096 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 1048576.00 kB 2024-05-12T10:54:57.457 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:54:57.457 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 re-readers = 3737557.50 kB/sec 2024-05-12T10:54:57.458 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 re-readers = 3730978.18 kB/sec 2024-05-12T10:54:57.458 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 3737557.50 kB/sec 2024-05-12T10:54:57.458 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 3737557.50 kB/sec 2024-05-12T10:54:57.458 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 3737557.50 kB/sec 2024-05-12T10:54:57.458 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 1048576.00 kB 2024-05-12T10:55:03.942 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:55:03.943 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:55:03.943 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:55:03.943 INFO:tasks.workunit.client.0.smithi115.stdout:iozone test complete. 2024-05-12T10:55:03.944 INFO:tasks.workunit.client.0.smithi115.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-12T10:55:04.010 INFO:tasks.workunit.client.0.smithi115.stdout: Iozone: Performance Test of File I/O 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Version $Revision: 3.489 $ 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Compiled for 64 bit mode. 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Build: linux-AMD64 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: Run began: Sun May 12 10:55:03 2024 2024-05-12T10:55:04.011 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: Include close in write timing 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: Include fsync in write timing 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: File size set to 10485760 kB 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: Record Size 1024 kB 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: Output is in kBytes/sec 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: Time Resolution = 0.000001 seconds. 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: Processor cache size set to 1024 kBytes. 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: Processor cache line size set to 32 bytes. 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: File stride size set to 17 * record size. 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: Throughput test with 1 process 2024-05-12T10:55:04.012 INFO:tasks.workunit.client.0.smithi115.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-05-12T10:55:20.670 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:55:20.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:55:50.752 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:55:50.755 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:55:55.409 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:55:55.409 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 initial writers = 204166.66 kB/sec 2024-05-12T10:55:55.410 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 initial writers = 204164.58 kB/sec 2024-05-12T10:55:55.410 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 204166.66 kB/sec 2024-05-12T10:55:55.410 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 204166.66 kB/sec 2024-05-12T10:55:55.410 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 204166.66 kB/sec 2024-05-12T10:55:55.410 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 10485760.00 kB 2024-05-12T10:56:20.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:56:20.827 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:56:30.559 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-05-12T10:56:30.560 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:56:30.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.839+0000 7ff698e00640 1 Processor -- start 2024-05-12T10:56:30.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.839+0000 7ff698e00640 1 -- start start 2024-05-12T10:56:30.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff698e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff694151fe0 0x7ff6940cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:30.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff698e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff694158ae0 0x7ff6940cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:30.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff698e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff6940c8500 0x7ff6940c8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:30.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff698e00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7ff6940c8e70 con 0x7ff6940c8500 2024-05-12T10:56:30.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff698e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff69415b510 con 0x7ff694151fe0 2024-05-12T10:56:30.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff698e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff69415b7d0 con 0x7ff694158ae0 2024-05-12T10:56:30.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff692800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff6940c8500 0x7ff6940c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:30.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff692800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff6940c8500 0x7ff6940c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48676/0 (socket says 172.21.15.115:48676) 2024-05-12T10:56:30.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff692800640 1 -- 172.21.15.115:0/1461413815 learned_addr learned my addr 172.21.15.115:0/1461413815 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:30.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff692800640 1 -- 172.21.15.115:0/1461413815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff694158ae0 msgr2=0x7ff6940cd8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-12T10:56:30.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff692800640 1 --2- 172.21.15.115:0/1461413815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff694158ae0 0x7ff6940cd8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:30.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff692800640 1 -- 172.21.15.115:0/1461413815 >> v2:172.21.15.134:3300/0 conn(0x7ff694151fe0 msgr2=0x7ff6940cd390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-12T10:56:30.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff692800640 1 --2- 172.21.15.115:0/1461413815 >> v2:172.21.15.134:3300/0 conn(0x7ff694151fe0 0x7ff6940cd390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:30.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.847+0000 7ff692800640 1 -- 172.21.15.115:0/1461413815 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69415bab0 con 0x7ff6940c8500 2024-05-12T10:56:30.853 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.859+0000 7ff692800640 1 --2- 172.21.15.115:0/1461413815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6940c8500 0x7ff6940c8930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff69406c230 tx=0x7ff68001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c7d7593cf76fa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:30.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.859+0000 7ff690a00640 1 -- 172.21.15.115:0/1461413815 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6800ab610 con 0x7ff6940c8500 2024-05-12T10:56:30.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.859+0000 7ff690a00640 1 -- 172.21.15.115:0/1461413815 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6800b0070 con 0x7ff6940c8500 2024-05-12T10:56:30.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.859+0000 7ff690a00640 1 -- 172.21.15.115:0/1461413815 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6800ab9d0 con 0x7ff6940c8500 2024-05-12T10:56:30.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.859+0000 7ff698e00640 1 -- 172.21.15.115:0/1461413815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6940c8500 msgr2=0x7ff6940c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:30.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.859+0000 7ff698e00640 1 --2- 172.21.15.115:0/1461413815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6940c8500 0x7ff6940c8930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff69406c230 tx=0x7ff68001c560 comp rx=0 tx=0).stop 2024-05-12T10:56:30.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.863+0000 7ff698e00640 1 -- 172.21.15.115:0/1461413815 shutdown_connections 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.863+0000 7ff698e00640 1 --2- 172.21.15.115:0/1461413815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6940c8500 0x7ff6940c8930 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.863+0000 7ff698e00640 1 --2- 172.21.15.115:0/1461413815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff694158ae0 0x7ff6940cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.863+0000 7ff698e00640 1 --2- 172.21.15.115:0/1461413815 >> v2:172.21.15.134:3300/0 conn(0x7ff694151fe0 0x7ff6940cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.863+0000 7ff698e00640 1 -- 172.21.15.115:0/1461413815 >> 172.21.15.115:0/1461413815 conn(0x7ff6940681c0 msgr2=0x7ff6940685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.867+0000 7ff698e00640 1 -- 172.21.15.115:0/1461413815 shutdown_connections 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.867+0000 7ff698e00640 1 -- 172.21.15.115:0/1461413815 wait complete. 2024-05-12T10:56:30.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.907+0000 7ff698e00640 1 Processor -- start 2024-05-12T10:56:30.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.915+0000 7ff698e00640 1 -- start start 2024-05-12T10:56:30.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.927+0000 7ff698e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6940c8500 0x7ff6940cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:30.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.927+0000 7ff698e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff694151fe0 0x7ff694073020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:30.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.927+0000 7ff698e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff694158ae0 0x7ff694073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:30.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.927+0000 7ff698e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff6940ca280 con 0x7ff694158ae0 2024-05-12T10:56:30.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.927+0000 7ff698e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff6940ca100 con 0x7ff694151fe0 2024-05-12T10:56:30.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.927+0000 7ff698e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff6940ca400 con 0x7ff6940c8500 2024-05-12T10:56:30.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.931+0000 7ff691e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6940c8500 0x7ff6940cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:30.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.931+0000 7ff691400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff694151fe0 0x7ff694073020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:30.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.935+0000 7ff692800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff694158ae0 0x7ff694073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:30.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.935+0000 7ff692800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff694158ae0 0x7ff694073560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48678/0 (socket says 172.21.15.115:48678) 2024-05-12T10:56:30.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.935+0000 7ff692800640 1 -- 172.21.15.115:0/2741330996 learned_addr learned my addr 172.21.15.115:0/2741330996 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:30.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.939+0000 7ff692800640 1 -- 172.21.15.115:0/2741330996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6940c8500 msgr2=0x7ff6940cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:30.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.939+0000 7ff692800640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6940c8500 0x7ff6940cd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:30.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.939+0000 7ff692800640 1 -- 172.21.15.115:0/2741330996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff694151fe0 msgr2=0x7ff694073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:30.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.939+0000 7ff692800640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff694151fe0 0x7ff694073020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:30.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.939+0000 7ff692800640 1 -- 172.21.15.115:0/2741330996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6940c6930 con 0x7ff694158ae0 2024-05-12T10:56:30.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.943+0000 7ff692800640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff694158ae0 0x7ff694073560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff6800ad040 tx=0x7ff68001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:30.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.951+0000 7ff68a000640 1 -- 172.21.15.115:0/2741330996 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6800be5f0 con 0x7ff694158ae0 2024-05-12T10:56:30.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.951+0000 7ff68a000640 1 -- 172.21.15.115:0/2741330996 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6800be7b0 con 0x7ff694158ae0 2024-05-12T10:56:30.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.951+0000 7ff68a000640 1 -- 172.21.15.115:0/2741330996 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6800beba0 con 0x7ff694158ae0 2024-05-12T10:56:30.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.955+0000 7ff698e00640 1 -- 172.21.15.115:0/2741330996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6940c6bd0 con 0x7ff694158ae0 2024-05-12T10:56:30.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.955+0000 7ff698e00640 1 -- 172.21.15.115:0/2741330996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff694072540 con 0x7ff694158ae0 2024-05-12T10:56:30.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.963+0000 7ff698e00640 1 -- 172.21.15.115:0/2741330996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff694069730 con 0x7ff694158ae0 2024-05-12T10:56:30.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.987+0000 7ff68a000640 1 -- 172.21.15.115:0/2741330996 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff6800b43f0 con 0x7ff694158ae0 2024-05-12T10:56:30.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.987+0000 7ff68a000640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff67406f400 0x7ff6740718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:30.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.987+0000 7ff68a000640 1 -- 172.21.15.115:0/2741330996 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff68012a190 con 0x7ff694158ae0 2024-05-12T10:56:30.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.995+0000 7ff691e00640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff67406f400 0x7ff6740718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:30.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:30.995+0000 7ff691e00640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff67406f400 0x7ff6740718c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff68c007bf0 tx=0x7ff68c007240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:31.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.067+0000 7ff68a000640 1 -- 172.21.15.115:0/2741330996 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff6800a8050 con 0x7ff694158ae0 2024-05-12T10:56:31.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.635+0000 7ff698e00640 1 -- 172.21.15.115:0/2741330996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6940c8ff0 con 0x7ff694158ae0 2024-05-12T10:56:31.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.639+0000 7ff68a000640 1 -- 172.21.15.115:0/2741330996 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7ff680016150 con 0x7ff694158ae0 2024-05-12T10:56:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:56:31.634 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:56:31.634 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:56:31.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.639+0000 7ff698e00640 1 -- 172.21.15.115:0/2741330996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff67406f400 msgr2=0x7ff6740718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:31.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.639+0000 7ff698e00640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff67406f400 0x7ff6740718c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff68c007bf0 tx=0x7ff68c007240 comp rx=0 tx=0).stop 2024-05-12T10:56:31.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.639+0000 7ff698e00640 1 -- 172.21.15.115:0/2741330996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff694158ae0 msgr2=0x7ff694073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:31.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.639+0000 7ff698e00640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff694158ae0 0x7ff694073560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff6800ad040 tx=0x7ff68001ada0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.643+0000 7ff698e00640 1 -- 172.21.15.115:0/2741330996 shutdown_connections 2024-05-12T10:56:31.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.643+0000 7ff698e00640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7ff67406f400 0x7ff6740718c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.643+0000 7ff698e00640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff694158ae0 0x7ff694073560 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.643+0000 7ff698e00640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff694151fe0 0x7ff694073020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.643+0000 7ff698e00640 1 --2- 172.21.15.115:0/2741330996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6940c8500 0x7ff6940cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.643+0000 7ff698e00640 1 -- 172.21.15.115:0/2741330996 >> 172.21.15.115:0/2741330996 conn(0x7ff6940681c0 msgr2=0x7ff69414c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:31.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.643+0000 7ff698e00640 1 -- 172.21.15.115:0/2741330996 shutdown_connections 2024-05-12T10:56:31.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.643+0000 7ff698e00640 1 -- 172.21.15.115:0/2741330996 wait complete. 2024-05-12T10:56:31.677 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db / --timeout 60 --expiration 70 --await-for 42.0' 2024-05-12T10:56:31.677 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db / --timeout 60 --expiration 70 --await-for 42.0 2024-05-12T10:56:31.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.931+0000 7f28ddc00640 1 Processor -- start 2024-05-12T10:56:31.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.931+0000 7f28ddc00640 1 -- start start 2024-05-12T10:56:31.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.931+0000 7f28ddc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d815a680 0x7f28d8072c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.931+0000 7f28ddc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f28d8072370 0x7f28d8073190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.931+0000 7f28ddc00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d81645c0 con 0x7f28d815a2a0 2024-05-12T10:56:31.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.931+0000 7f28ddc00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f28d8163760 con 0x7f28d8072370 2024-05-12T10:56:31.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.931+0000 7f28ddc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f28d8163a40 con 0x7f28d815a680 2024-05-12T10:56:31.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.931+0000 7f28d7400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f28d8072370 0x7f28d8073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.935+0000 7f28d7400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f28d8072370 0x7f28d8073190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:46158/0 (socket says 172.21.15.115:46158) 2024-05-12T10:56:31.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.935+0000 7f28d7400640 1 -- 172.21.15.115:0/2751957938 learned_addr learned my addr 172.21.15.115:0/2751957938 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:31.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.935+0000 7f28ce000640 1 --2- 172.21.15.115:0/2751957938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d815a680 0x7f28d8072c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.935+0000 7f28ce000640 1 -- 172.21.15.115:0/2751957938 >> v2:172.21.15.134:3300/0 conn(0x7f28d8072370 msgr2=0x7f28d8073190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:31.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.935+0000 7f28ce000640 1 --2- 172.21.15.115:0/2751957938 >> v2:172.21.15.134:3300/0 conn(0x7f28d8072370 0x7f28d8073190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.935+0000 7f28ce000640 1 -- 172.21.15.115:0/2751957938 >> v1:172.21.15.115:6789/0 conn(0x7f28d815a2a0 legacy=0x7f28d8073790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:31.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.935+0000 7f28ce000640 1 -- 172.21.15.115:0/2751957938 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d8163d20 con 0x7f28d815a680 2024-05-12T10:56:31.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.935+0000 7f28d6000640 1 -- 172.21.15.115:0/2751957938 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286323627 0 0) 0x7f28d81645c0 con 0x7f28d815a2a0 2024-05-12T10:56:31.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.939+0000 7f28d7400640 1 --2- 172.21.15.115:0/2751957938 >> v2:172.21.15.134:3300/0 conn(0x7f28d8072370 0x7f28d8073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:56:31.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.939+0000 7f28ce000640 1 --2- 172.21.15.115:0/2751957938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d815a680 0x7f28d8072c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f28c00097f0 tx=0x7f28c001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=853b1851c0891043 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:31.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.939+0000 7f28d6000640 1 -- 172.21.15.115:0/2751957938 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00b5070 con 0x7f28d815a680 2024-05-12T10:56:31.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.939+0000 7f28d6000640 1 -- 172.21.15.115:0/2751957938 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c00a8990 con 0x7f28d815a680 2024-05-12T10:56:31.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.939+0000 7f28ddc00640 1 -- 172.21.15.115:0/2751957938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d815a680 msgr2=0x7f28d8072c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:31.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.943+0000 7f28d6000640 1 -- 172.21.15.115:0/2751957938 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00a8d60 con 0x7f28d815a680 2024-05-12T10:56:31.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.943+0000 7f28ddc00640 1 --2- 172.21.15.115:0/2751957938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d815a680 0x7f28d8072c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f28c00097f0 tx=0x7f28c001ecb0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.943+0000 7f28ddc00640 1 -- 172.21.15.115:0/2751957938 shutdown_connections 2024-05-12T10:56:31.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.943+0000 7f28ddc00640 1 --2- 172.21.15.115:0/2751957938 >> v2:172.21.15.134:3300/0 conn(0x7f28d8072370 0x7f28d8073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.943+0000 7f28ddc00640 1 --2- 172.21.15.115:0/2751957938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d815a680 0x7f28d8072c50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.943+0000 7f28ddc00640 1 -- 172.21.15.115:0/2751957938 >> 172.21.15.115:0/2751957938 conn(0x7f28d80681c0 msgr2=0x7f28d80685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:31.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.943+0000 7f28ddc00640 1 -- 172.21.15.115:0/2751957938 shutdown_connections 2024-05-12T10:56:31.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.943+0000 7f28ddc00640 1 -- 172.21.15.115:0/2751957938 wait complete. 2024-05-12T10:56:31.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.943+0000 7f28ddc00640 1 Processor -- start 2024-05-12T10:56:31.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.943+0000 7f28ddc00640 1 -- start start 2024-05-12T10:56:31.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28ddc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d8072370 0x7f28d8160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28ddc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d815a2a0 0x7f28d813ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28ddc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28d815a680 0x7f28d80cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28ddc00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f28d8070bc0 con 0x7f28d815a680 2024-05-12T10:56:31.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28ddc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f28d81642e0 con 0x7f28d8072370 2024-05-12T10:56:31.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28ddc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f28d8070d40 con 0x7f28d815a2a0 2024-05-12T10:56:31.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28d7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28d815a680 0x7f28d80cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28d7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28d815a680 0x7f28d80cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48688/0 (socket says 172.21.15.115:48688) 2024-05-12T10:56:31.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28d7400640 1 -- 172.21.15.115:0/2454258799 learned_addr learned my addr 172.21.15.115:0/2454258799 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:31.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28d6a00640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d8072370 0x7f28d8160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28ce000640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d815a2a0 0x7f28d813ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28d7400640 1 -- 172.21.15.115:0/2454258799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d815a2a0 msgr2=0x7f28d813ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:31.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28d7400640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d815a2a0 0x7f28d813ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28d7400640 1 -- 172.21.15.115:0/2454258799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d8072370 msgr2=0x7f28d8160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:31.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28d7400640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d8072370 0x7f28d8160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28d7400640 1 -- 172.21.15.115:0/2454258799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d815ed00 con 0x7f28d815a680 2024-05-12T10:56:31.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28d7400640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28d815a680 0x7f28d80cc270 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f28d000e930 tx=0x7f28d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:31.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28cf400640 1 -- 172.21.15.115:0/2454258799 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0017070 con 0x7f28d815a680 2024-05-12T10:56:31.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28cf400640 1 -- 172.21.15.115:0/2454258799 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d000ca00 con 0x7f28d815a680 2024-05-12T10:56:31.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.947+0000 7f28cf400640 1 -- 172.21.15.115:0/2454258799 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d000cdd0 con 0x7f28d815a680 2024-05-12T10:56:31.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.951+0000 7f28ddc00640 1 -- 172.21.15.115:0/2454258799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d815efe0 con 0x7f28d815a680 2024-05-12T10:56:31.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.951+0000 7f28ddc00640 1 -- 172.21.15.115:0/2454258799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d815f5a0 con 0x7f28d815a680 2024-05-12T10:56:31.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.955+0000 7f28cf400640 1 -- 172.21.15.115:0/2454258799 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f28d001a070 con 0x7f28d815a680 2024-05-12T10:56:31.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.955+0000 7f28cf400640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b406f480 0x7f28b4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.955+0000 7f28cf400640 1 -- 172.21.15.115:0/2454258799 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f28d008f8b0 con 0x7f28d815a680 2024-05-12T10:56:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.955+0000 7f28e106b000 1 Processor -- start 2024-05-12T10:56:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.955+0000 7f28d6a00640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b406f480 0x7f28b4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.955+0000 7f28e106b000 1 -- start start 2024-05-12T10:56:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d6a00640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b406f480 0x7f28b4071940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f28c8007fd0 tx=0x7f28c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:31.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28e106b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea2750740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28e106b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2750c80 0x559ea2751060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28e106b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2755a10 0x559ea2755df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28e106b000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559ea25640f0 con 0x559ea2755a10 2024-05-12T10:56:31.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28e106b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559ea251d670 con 0x559ea271adf0 2024-05-12T10:56:31.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28e106b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x559ea25600b0 con 0x559ea2750c80 2024-05-12T10:56:31.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2755a10 0x559ea2755df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2755a10 0x559ea2755df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48704/0 (socket says 172.21.15.115:48704) 2024-05-12T10:56:31.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d7400640 1 -- 172.21.15.115:0/3300345707 learned_addr learned my addr 172.21.15.115:0/3300345707 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:31.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28ce000640 1 --2- 172.21.15.115:0/3300345707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2750c80 0x559ea2751060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d6a00640 1 --2- 172.21.15.115:0/3300345707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea2750740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d7400640 1 -- 172.21.15.115:0/3300345707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2750c80 msgr2=0x559ea2751060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:31.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d7400640 1 --2- 172.21.15.115:0/3300345707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2750c80 0x559ea2751060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d7400640 1 -- 172.21.15.115:0/3300345707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 msgr2=0x559ea2750740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:31.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d7400640 1 --2- 172.21.15.115:0/3300345707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea2750740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d7400640 1 -- 172.21.15.115:0/3300345707 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ea2526010 con 0x559ea2755a10 2024-05-12T10:56:31.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d6a00640 1 --2- 172.21.15.115:0/3300345707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea2750740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:56:31.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28d7400640 1 --2- 172.21.15.115:0/3300345707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2755a10 0x559ea2755df0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f28d00583e0 tx=0x7f28d005b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5348b074c5503cd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:31.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28c7400640 1 -- 172.21.15.115:0/3300345707 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0021040 con 0x559ea2755a10 2024-05-12T10:56:31.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28c7400640 1 -- 172.21.15.115:0/3300345707 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d0064ba0 con 0x559ea2755a10 2024-05-12T10:56:31.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.959+0000 7f28c7400640 1 -- 172.21.15.115:0/3300345707 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0086b60 con 0x559ea2755a10 2024-05-12T10:56:31.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.963+0000 7f28e106b000 1 -- 172.21.15.115:0/3300345707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2755a10 msgr2=0x559ea2755df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:31.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.963+0000 7f28e106b000 1 --2- 172.21.15.115:0/3300345707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2755a10 0x559ea2755df0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f28d00583e0 tx=0x7f28d005b620 comp rx=0 tx=0).stop 2024-05-12T10:56:31.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.963+0000 7f28e106b000 1 -- 172.21.15.115:0/3300345707 shutdown_connections 2024-05-12T10:56:31.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.963+0000 7f28e106b000 1 --2- 172.21.15.115:0/3300345707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2755a10 0x559ea2755df0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.963+0000 7f28e106b000 1 --2- 172.21.15.115:0/3300345707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2750c80 0x559ea2751060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.963+0000 7f28e106b000 1 --2- 172.21.15.115:0/3300345707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea2750740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.963+0000 7f28e106b000 1 -- 172.21.15.115:0/3300345707 >> 172.21.15.115:0/3300345707 conn(0x559ea25fcf90 msgr2=0x559ea27537d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:31.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.963+0000 7f28e106b000 1 -- 172.21.15.115:0/3300345707 shutdown_connections 2024-05-12T10:56:31.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.963+0000 7f28e106b000 1 -- 172.21.15.115:0/3300345707 wait complete. 2024-05-12T10:56:31.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.963+0000 7f28e106b000 1 -- start start 2024-05-12T10:56:31.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.963+0000 7f28e106b000 1 Processor -- start 2024-05-12T10:56:31.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28e106b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea274fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28e106b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 0x559ea2750270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea274fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea274fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:46184/0 (socket says 172.21.15.115:46184) 2024-05-12T10:56:31.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28ce000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 0x559ea2750270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28ce000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 0x559ea2750270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48716/0 (socket says 172.21.15.115:48716) 2024-05-12T10:56:31.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28d6a00640 1 -- 172.21.15.115:0/2154983678 learned_addr learned my addr 172.21.15.115:0/2154983678 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:31.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28e106b000 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2755a10 0x559ea2716170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28e106b000 1 -- 172.21.15.115:0/2154983678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559ea25714f0 con 0x559ea2750c80 2024-05-12T10:56:31.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28e106b000 1 -- 172.21.15.115:0/2154983678 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559ea2504900 con 0x559ea271adf0 2024-05-12T10:56:31.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28e106b000 1 -- 172.21.15.115:0/2154983678 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x559ea271b1d0 con 0x559ea2755a10 2024-05-12T10:56:31.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28d7400640 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2755a10 0x559ea2716170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28d6a00640 1 -- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2755a10 msgr2=0x559ea2716170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:31.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28d6a00640 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2755a10 0x559ea2716170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28d6a00640 1 -- 172.21.15.115:0/2154983678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 msgr2=0x559ea2750270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:31.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28d6a00640 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 0x559ea2750270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28d6a00640 1 -- 172.21.15.115:0/2154983678 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ea2516e40 con 0x559ea271adf0 2024-05-12T10:56:31.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28e106b000 10 client.0 _ll_register_callbacks cb 0x559ea2700180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:56:31.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28e106b000 1 -- 172.21.15.115:0/2154983678 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28d0064ba0 con 0x559ea271adf0 2024-05-12T10:56:31.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28d6a00640 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea274fd30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f28c80016b0 tx=0x7f28c8001260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36a8153d4f7557a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:31.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.967+0000 7f28bbe00640 10 client.5176 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-12T10:56:31.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.971+0000 7f28bbe00640 1 -- 172.21.15.115:0/2154983678 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8027060 con 0x559ea271adf0 2024-05-12T10:56:31.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28bbe00640 1 -- 172.21.15.115:0/2154983678 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f28c8010040 con 0x559ea271adf0 2024-05-12T10:56:31.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28bbe00640 1 -- 172.21.15.115:0/2154983678 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f28c8013420 con 0x559ea271adf0 2024-05-12T10:56:31.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28e106b000 10 client.5176 fetch_fsmap learned FSMap version 14 2024-05-12T10:56:31.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28e106b000 1 -- 172.21.15.115:0/2154983678 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=14}) -- 0x559ea262eab0 con 0x559ea271adf0 2024-05-12T10:56:31.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28bbe00640 1 -- 172.21.15.115:0/2154983678 <== mon.1 v2:172.21.15.134:3300/0 4 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f28c80226d0 con 0x559ea271adf0 2024-05-12T10:56:31.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28e106b000 10 client.5176 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:56:31.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28e106b000 10 client.5176 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:56:31.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28e106b000 20 client.5176 populate_metadata read hostname 'smithi115' 2024-05-12T10:56:31.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28e106b000 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559ea2716f10 0x559ea27172f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:31.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28e106b000 4 client.5176 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:56:31.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28e106b000 1 -- 172.21.15.115:0/2154983678 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ea24fd7f0 con 0x559ea2716f10 2024-05-12T10:56:31.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.975+0000 7f28ce000640 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559ea2716f10 0x559ea27172f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:31.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.983+0000 7f28ce000640 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559ea2716f10 0x559ea27172f0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f91eccf2c5cb68ea server_cookie=cc284c4b22b3d095 in_seq=0 out_seq=0 2024-05-12T10:56:31.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.983+0000 7f28bbe00640 10 client.5176 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:56:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.983+0000 7f28bbe00640 1 -- 172.21.15.115:0/2154983678 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559ea24fd7f0 con 0x559ea2716f10 2024-05-12T10:56:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.983+0000 7f28bbe00640 10 client.5176 handle_command_reply: tid=0 2024-05-12T10:56:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.983+0000 7f28e106b000 1 client.5176 shutdown 2024-05-12T10:56:31.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.987+0000 7f28e106b000 1 -- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 msgr2=0x559ea274fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:31.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.987+0000 7f28e106b000 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea274fd30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f28c80016b0 tx=0x7f28c8001260 comp rx=0 tx=0).stop 2024-05-12T10:56:31.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.987+0000 7f28e106b000 1 -- 172.21.15.115:0/2154983678 shutdown_connections 2024-05-12T10:56:31.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.987+0000 7f28e106b000 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2755a10 0x559ea2716170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.987+0000 7f28e106b000 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 0x559ea2750270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.987+0000 7f28e106b000 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559ea2716f10 0x559ea27172f0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.987+0000 7f28e106b000 1 --2- 172.21.15.115:0/2154983678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea274fd30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:31.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.987+0000 7f28e106b000 1 -- 172.21.15.115:0/2154983678 >> 172.21.15.115:0/2154983678 conn(0x559ea25fcf90 msgr2=0x559ea2753490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:31.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.987+0000 7f28bbe00640 0 client.5176 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:56:31.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.995+0000 7f28e106b000 1 -- 172.21.15.115:0/2154983678 shutdown_connections 2024-05-12T10:56:31.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.995+0000 7f28e106b000 1 -- 172.21.15.115:0/2154983678 wait complete. 2024-05-12T10:56:31.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:31.995+0000 7f28e106b000 20 client.5176 trim_cache size 0 max 16384 2024-05-12T10:56:32.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28e106b000 1 Processor -- start 2024-05-12T10:56:32.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28e106b000 1 -- start start 2024-05-12T10:56:32.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28e106b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea25fcf90 0x559ea27cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:32.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28e106b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea271adf0 0x559ea2771450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:32.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea25fcf90 0x559ea27cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:32.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28e106b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2750c80 0x559ea2771990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:32.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28e106b000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f28d820cad0 con 0x559ea271adf0 2024-05-12T10:56:32.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28e106b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f28d820b240 con 0x559ea25fcf90 2024-05-12T10:56:32.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28e106b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f28d820a570 con 0x559ea2750c80 2024-05-12T10:56:32.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea25fcf90 0x559ea27cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:46192/0 (socket says 172.21.15.115:46192) 2024-05-12T10:56:32.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28d6a00640 1 -- 172.21.15.115:0/2305134234 learned_addr learned my addr 172.21.15.115:0/2305134234 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:32.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28ce000640 1 --2- 172.21.15.115:0/2305134234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea271adf0 0x559ea2771450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:32.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28d7400640 1 --2- 172.21.15.115:0/2305134234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2750c80 0x559ea2771990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:32.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28d6a00640 1 -- 172.21.15.115:0/2305134234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2750c80 msgr2=0x559ea2771990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:32.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28d6a00640 1 --2- 172.21.15.115:0/2305134234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2750c80 0x559ea2771990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28d6a00640 1 -- 172.21.15.115:0/2305134234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea271adf0 msgr2=0x559ea2771450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:32.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28d6a00640 1 --2- 172.21.15.115:0/2305134234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea271adf0 0x559ea2771450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28d6a00640 1 -- 172.21.15.115:0/2305134234 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ea25e4e30 con 0x559ea25fcf90 2024-05-12T10:56:32.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28ce000640 1 --2- 172.21.15.115:0/2305134234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea271adf0 0x559ea2771450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:56:32.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.035+0000 7f28d6a00640 1 --2- 172.21.15.115:0/2305134234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea25fcf90 0x559ea27cae00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f28c802a7c0 tx=0x7f28c8018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e736b483d453879 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:32.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28c6a00640 1 -- 172.21.15.115:0/2305134234 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8022460 con 0x559ea25fcf90 2024-05-12T10:56:32.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28c6a00640 1 -- 172.21.15.115:0/2305134234 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d0064ba0 con 0x559ea25fcf90 2024-05-12T10:56:32.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28c6a00640 1 -- 172.21.15.115:0/2305134234 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c800e870 con 0x559ea25fcf90 2024-05-12T10:56:32.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 -- 172.21.15.115:0/2305134234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea25fcf90 msgr2=0x559ea27cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:32.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 --2- 172.21.15.115:0/2305134234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea25fcf90 0x559ea27cae00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f28c802a7c0 tx=0x7f28c8018000 comp rx=0 tx=0).stop 2024-05-12T10:56:32.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 -- 172.21.15.115:0/2305134234 shutdown_connections 2024-05-12T10:56:32.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 --2- 172.21.15.115:0/2305134234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea2750c80 0x559ea2771990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 --2- 172.21.15.115:0/2305134234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea271adf0 0x559ea2771450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 --2- 172.21.15.115:0/2305134234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea25fcf90 0x559ea27cae00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 -- 172.21.15.115:0/2305134234 >> 172.21.15.115:0/2305134234 conn(0x559ea2750780 msgr2=0x559ea27159b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:32.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 -- 172.21.15.115:0/2305134234 shutdown_connections 2024-05-12T10:56:32.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 -- 172.21.15.115:0/2305134234 wait complete. 2024-05-12T10:56:32.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 -- start start 2024-05-12T10:56:32.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 Processor -- start 2024-05-12T10:56:32.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea25fcf90 0x559ea27ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:32.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea27cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:32.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 0x559ea276f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:32.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559ea24fa3e0 con 0x559ea2750c80 2024-05-12T10:56:32.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f28d820abc0 con 0x559ea271adf0 2024-05-12T10:56:32.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x559ea2563400 con 0x559ea25fcf90 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28e106b000 10 client.0 _ll_register_callbacks cb 0x7f28c8003980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea25fcf90 0x559ea27ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28d7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 0x559ea276f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea25fcf90 0x559ea27ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:49024/0 (socket says 172.21.15.115:49024) 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28d6a00640 1 -- 172.21.15.115:0/2208295870 learned_addr learned my addr 172.21.15.115:0/2208295870 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28ce000640 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea27cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28d7400640 1 -- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea25fcf90 msgr2=0x559ea27ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28d7400640 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea25fcf90 0x559ea27ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28d7400640 1 -- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 msgr2=0x559ea27cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28d7400640 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea27cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28d7400640 1 -- 172.21.15.115:0/2208295870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ea24f5d80 con 0x559ea2750c80 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28ce000640 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea27cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:56:32.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28d7400640 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 0x559ea276f1d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f28d000c520 tx=0x7f28d000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad19f5f7d261c070 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:32.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.039+0000 7f28bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:56:32.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28bbe00640 1 -- 172.21.15.115:0/2208295870 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0021040 con 0x559ea2750c80 2024-05-12T10:56:32.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28bbe00640 1 -- 172.21.15.115:0/2208295870 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f28d005b050 con 0x559ea2750c80 2024-05-12T10:56:32.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28e106b000 1 -- 172.21.15.115:0/2208295870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28d0064ba0 con 0x559ea2750c80 2024-05-12T10:56:32.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28bbe00640 1 -- 172.21.15.115:0/2208295870 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f28d005b250 con 0x559ea2750c80 2024-05-12T10:56:32.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28e106b000 10 client.5145 fetch_fsmap learned FSMap version 14 2024-05-12T10:56:32.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28e106b000 1 -- 172.21.15.115:0/2208295870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x559ea2508f80 con 0x559ea2750c80 2024-05-12T10:56:32.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28bbe00640 1 -- 172.21.15.115:0/2208295870 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d0064ba0 con 0x559ea2750c80 2024-05-12T10:56:32.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28bbe00640 1 -- 172.21.15.115:0/2208295870 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f28d0057760 con 0x559ea2750c80 2024-05-12T10:56:32.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28e106b000 10 client.5145 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:56:32.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28e106b000 10 client.5145 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:56:32.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28e106b000 20 client.5145 populate_metadata read hostname 'smithi115' 2024-05-12T10:56:32.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28e106b000 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559ea2755a10 0x559ea276fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:32.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28e106b000 4 client.5145 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}] 2024-05-12T10:56:32.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28e106b000 1 -- 172.21.15.115:0/2208295870 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}) -- 0x559ea2571d00 con 0x559ea2755a10 2024-05-12T10:56:32.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28d6a00640 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559ea2755a10 0x559ea276fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:32.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28bbe00640 10 client.5145 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:56:32.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.043+0000 7f28d6a00640 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559ea2755a10 0x559ea276fb60 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d880e18288d09b7 server_cookie=4318a54701b466f2 in_seq=0 out_seq=0 2024-05-12T10:56:32.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.059+0000 7f28bbe00640 1 -- 172.21.15.115:0/2208295870 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559ea2571d00 con 0x559ea2755a10 2024-05-12T10:56:32.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.059+0000 7f28bbe00640 10 client.5145 handle_command_reply: tid=0 2024-05-12T10:56:32.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.059+0000 7f28e106b000 1 client.5145 shutdown 2024-05-12T10:56:32.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28e106b000 1 -- 172.21.15.115:0/2208295870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 msgr2=0x559ea276f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:32.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28e106b000 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 0x559ea276f1d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f28d000c520 tx=0x7f28d000cf70 comp rx=0 tx=0).stop 2024-05-12T10:56:32.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28e106b000 1 -- 172.21.15.115:0/2208295870 shutdown_connections 2024-05-12T10:56:32.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28e106b000 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ea2750c80 0x559ea276f1d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28e106b000 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x559ea2755a10 0x559ea276fb60 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28e106b000 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ea271adf0 0x559ea27cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28e106b000 1 --2- 172.21.15.115:0/2208295870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ea25fcf90 0x559ea27ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28e106b000 1 -- 172.21.15.115:0/2208295870 >> 172.21.15.115:0/2208295870 conn(0x559ea2750780 msgr2=0x559ea2771880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:32.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28bbe00640 0 client.5145 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:56:32.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28e106b000 1 -- 172.21.15.115:0/2208295870 shutdown_connections 2024-05-12T10:56:32.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28e106b000 1 -- 172.21.15.115:0/2208295870 wait complete. 2024-05-12T10:56:32.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28e106b000 20 client.5145 trim_cache size 0 max 16384 2024-05-12T10:56:32.061 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:56:32.061 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:56:32.061 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:56:32.061 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 18, 2024-05-12T10:56:32.061 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:56:32.061 INFO:teuthology.orchestra.run.smithi115.stdout: "4727d837": { 2024-05-12T10:56:32.062 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 18, 2024-05-12T10:56:32.062 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:56:32.062 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:56:32.062 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:56:32.062 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:56:32.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:56:32.062 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:56:32.063 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 70.0, 2024-05-12T10:56:32.063 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:56:32.063 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:56:32.063 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:56:32.063 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:56:32.063 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:56:32.064 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:56:32.064 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:56:32.064 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:56:32.064 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:56:32.064 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:56:32.064 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:56:32.065 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:56:32.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 -- 172.21.15.115:0/2454258799 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b406f480 msgr2=0x7f28b4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:32.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b406f480 0x7f28b4071940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f28c8007fd0 tx=0x7f28c8009040 comp rx=0 tx=0).stop 2024-05-12T10:56:32.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 -- 172.21.15.115:0/2454258799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28d815a680 msgr2=0x7f28d80cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:32.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28d815a680 0x7f28d80cc270 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f28d000e930 tx=0x7f28d000edf0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 -- 172.21.15.115:0/2454258799 shutdown_connections 2024-05-12T10:56:32.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f28b406f480 0x7f28b4071940 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28d815a680 0x7f28d80cc270 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28d815a2a0 0x7f28d813ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 --2- 172.21.15.115:0/2454258799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d8072370 0x7f28d8160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:32.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 -- 172.21.15.115:0/2454258799 >> 172.21.15.115:0/2454258799 conn(0x7f28d80681c0 msgr2=0x7f28d8073790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:32.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 -- 172.21.15.115:0/2454258799 shutdown_connections 2024-05-12T10:56:32.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:32.063+0000 7f28ddc00640 1 -- 172.21.15.115:0/2454258799 wait complete. 2024-05-12T10:56:32.089 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4727d837', quiesce took 1.5 seconds. Will release after: 10 2024-05-12T10:56:42.090 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:56:42.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.439+0000 7f4654400640 1 Processor -- start 2024-05-12T10:56:42.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.439+0000 7f4654400640 1 -- start start 2024-05-12T10:56:42.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.439+0000 7f4654400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f464c073bf0 0x7f464c152950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:42.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.439+0000 7f4654400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f464c073fd0 0x7f464c152e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:42.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.439+0000 7f4654400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f464c0c5e70 con 0x7f464c0c59a0 2024-05-12T10:56:42.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.439+0000 7f4654400640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f464c0c5660 con 0x7f464c073fd0 2024-05-12T10:56:42.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.439+0000 7f4654400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f464c0c9790 con 0x7f464c073bf0 2024-05-12T10:56:42.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.443+0000 7f4651a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f464c073bf0 0x7f464c152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:42.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.443+0000 7f4651a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f464c073bf0 0x7f464c152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:40422/0 (socket says 172.21.15.115:40422) 2024-05-12T10:56:42.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.443+0000 7f4651a00640 1 -- 172.21.15.115:0/1813899793 learned_addr learned my addr 172.21.15.115:0/1813899793 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:42.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.443+0000 7f4652400640 1 --2- 172.21.15.115:0/1813899793 >> v2:172.21.15.115:3300/0 conn(0x7f464c073fd0 0x7f464c152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:42.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.443+0000 7f4651a00640 1 -- 172.21.15.115:0/1813899793 >> v2:172.21.15.115:3300/0 conn(0x7f464c073fd0 msgr2=0x7f464c152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:42.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.443+0000 7f4651a00640 1 --2- 172.21.15.115:0/1813899793 >> v2:172.21.15.115:3300/0 conn(0x7f464c073fd0 0x7f464c152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:42.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.443+0000 7f4651a00640 1 -- 172.21.15.115:0/1813899793 >> v1:172.21.15.115:6789/0 conn(0x7f464c0c59a0 legacy=0x7f464c158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:42.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.443+0000 7f4651a00640 1 -- 172.21.15.115:0/1813899793 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464c0c9a70 con 0x7f464c073bf0 2024-05-12T10:56:42.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.447+0000 7f4651a00640 1 --2- 172.21.15.115:0/1813899793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f464c073bf0 0x7f464c152950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f464c068fe0 tx=0x7f464001c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8ba2131a4cdffb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:42.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.447+0000 7f464be00640 1 -- 172.21.15.115:0/1813899793 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46400b0070 con 0x7f464c073bf0 2024-05-12T10:56:42.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.447+0000 7f464be00640 1 -- 172.21.15.115:0/1813899793 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46400ab600 con 0x7f464c073bf0 2024-05-12T10:56:42.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.447+0000 7f464be00640 1 -- 172.21.15.115:0/1813899793 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46400ab9d0 con 0x7f464c073bf0 2024-05-12T10:56:42.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.451+0000 7f4654400640 1 -- 172.21.15.115:0/1813899793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f464c073bf0 msgr2=0x7f464c152950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:42.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.451+0000 7f4654400640 1 --2- 172.21.15.115:0/1813899793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f464c073bf0 0x7f464c152950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f464c068fe0 tx=0x7f464001c490 comp rx=0 tx=0).stop 2024-05-12T10:56:42.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.451+0000 7f4654400640 1 -- 172.21.15.115:0/1813899793 shutdown_connections 2024-05-12T10:56:42.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.451+0000 7f4654400640 1 --2- 172.21.15.115:0/1813899793 >> v2:172.21.15.115:3300/0 conn(0x7f464c073fd0 0x7f464c152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:42.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.451+0000 7f4654400640 1 --2- 172.21.15.115:0/1813899793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f464c073bf0 0x7f464c152950 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:42.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.451+0000 7f4654400640 1 -- 172.21.15.115:0/1813899793 >> 172.21.15.115:0/1813899793 conn(0x7f464c076890 msgr2=0x7f464c0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:42.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.451+0000 7f4654400640 1 -- 172.21.15.115:0/1813899793 shutdown_connections 2024-05-12T10:56:42.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.451+0000 7f4654400640 1 -- 172.21.15.115:0/1813899793 wait complete. 2024-05-12T10:56:42.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4654400640 1 Processor -- start 2024-05-12T10:56:42.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4654400640 1 -- start start 2024-05-12T10:56:42.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4654400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f464c073bf0 0x7f464c146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:42.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4654400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f464c073fd0 0x7f464c0c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:42.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4654400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f464c0c59a0 0x7f464c0c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:42.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4654400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f464c0c82a0 con 0x7f464c0c59a0 2024-05-12T10:56:42.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4654400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f464c0c8120 con 0x7f464c073bf0 2024-05-12T10:56:42.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4654400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f464c0c8420 con 0x7f464c073fd0 2024-05-12T10:56:42.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4651a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f464c073bf0 0x7f464c146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:42.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4651a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f464c073bf0 0x7f464c146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:40426/0 (socket says 172.21.15.115:40426) 2024-05-12T10:56:42.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4651a00640 1 -- 172.21.15.115:0/17305365 learned_addr learned my addr 172.21.15.115:0/17305365 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:42.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4651a00640 1 -- 172.21.15.115:0/17305365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f464c073fd0 msgr2=0x7f464c0c3710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:56:42.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4651a00640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f464c073fd0 0x7f464c0c3710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:42.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4651a00640 1 -- 172.21.15.115:0/17305365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f464c0c59a0 msgr2=0x7f464c0c3c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:56:42.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.455+0000 7f4651a00640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f464c0c59a0 0x7f464c0c3c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:42.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.459+0000 7f4651a00640 1 -- 172.21.15.115:0/17305365 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464c0c4190 con 0x7f464c073bf0 2024-05-12T10:56:42.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.459+0000 7f4651a00640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f464c073bf0 0x7f464c146190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f464001cd30 tx=0x7f4640019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.459+0000 7f4649600640 1 -- 172.21.15.115:0/17305365 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46400bb070 con 0x7f464c073bf0 2024-05-12T10:56:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.459+0000 7f4654400640 1 -- 172.21.15.115:0/17305365 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f464c0c4d00 con 0x7f464c073bf0 2024-05-12T10:56:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.459+0000 7f4649600640 1 -- 172.21.15.115:0/17305365 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46400b6640 con 0x7f464c073bf0 2024-05-12T10:56:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.459+0000 7f4649600640 1 -- 172.21.15.115:0/17305365 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46400b0040 con 0x7f464c073bf0 2024-05-12T10:56:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.459+0000 7f4654400640 1 -- 172.21.15.115:0/17305365 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f464c0c2950 con 0x7f464c073bf0 2024-05-12T10:56:42.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.463+0000 7f4654400640 1 -- 172.21.15.115:0/17305365 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f464c069730 con 0x7f464c073bf0 2024-05-12T10:56:42.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.463+0000 7f4649600640 1 -- 172.21.15.115:0/17305365 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f46400be070 con 0x7f464c073bf0 2024-05-12T10:56:42.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.463+0000 7f4649600640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f462c06f500 0x7f462c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:42.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.463+0000 7f4649600640 1 -- 172.21.15.115:0/17305365 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f4640129120 con 0x7f464c073bf0 2024-05-12T10:56:42.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.463+0000 7f4651000640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f462c06f500 0x7f462c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:42.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.467+0000 7f4651000640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f462c06f500 0x7f462c0719c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4638007fd0 tx=0x7f46380079a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:42.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.467+0000 7f4649600640 1 -- 172.21.15.115:0/17305365 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f464c0c4d00 con 0x7f464c073bf0 2024-05-12T10:56:42.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.735+0000 7f4654400640 1 -- 172.21.15.115:0/17305365 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f464c14f790 con 0x7f464c073bf0 2024-05-12T10:56:42.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4649600640 1 -- 172.21.15.115:0/17305365 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f4640016110 con 0x7f464c073bf0 2024-05-12T10:56:42.734 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:56:42.734 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:56:42.734 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:56:42.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 -- 172.21.15.115:0/17305365 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f462c06f500 msgr2=0x7f462c0719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:42.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f462c06f500 0x7f462c0719c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4638007fd0 tx=0x7f46380079a0 comp rx=0 tx=0).stop 2024-05-12T10:56:42.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 -- 172.21.15.115:0/17305365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f464c073bf0 msgr2=0x7f464c146190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:42.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f464c073bf0 0x7f464c146190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f464001cd30 tx=0x7f4640019230 comp rx=0 tx=0).stop 2024-05-12T10:56:42.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 -- 172.21.15.115:0/17305365 shutdown_connections 2024-05-12T10:56:42.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f462c06f500 0x7f462c0719c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:42.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f464c0c59a0 0x7f464c0c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:42.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f464c073fd0 0x7f464c0c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:42.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 --2- 172.21.15.115:0/17305365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f464c073bf0 0x7f464c146190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:42.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 -- 172.21.15.115:0/17305365 >> 172.21.15.115:0/17305365 conn(0x7f464c076890 msgr2=0x7f464c06cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:42.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 -- 172.21.15.115:0/17305365 shutdown_connections 2024-05-12T10:56:42.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:42.739+0000 7f4654400640 1 -- 172.21.15.115:0/17305365 wait complete. 2024-05-12T10:56:42.755 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db --set-id 4727d837 --release --await' 2024-05-12T10:56:42.755 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db --set-id 4727d837 --release --await 2024-05-12T10:56:43.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.039+0000 7f9222e00640 1 Processor -- start 2024-05-12T10:56:43.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.043+0000 7f9222e00640 1 -- start start 2024-05-12T10:56:43.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.043+0000 7f9222e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f921c0c5a50 0x7f921c152620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.043+0000 7f9222e00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f921c0ce600 con 0x7f921c073dc0 2024-05-12T10:56:43.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.043+0000 7f9222e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f921c0ce8e0 con 0x7f921c0739e0 2024-05-12T10:56:43.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.043+0000 7f9222e00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f921c0c8990 con 0x7f921c0c5a50 2024-05-12T10:56:43.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.047+0000 7f921b400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f921c073dc0 0x7f921c159010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42230/0 (socket says 172.21.15.115:42230) 2024-05-12T10:56:43.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.047+0000 7f921b400640 1 -- 172.21.15.115:0/3648074653 learned_addr learned my addr 172.21.15.115:0/3648074653 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:56:43.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.047+0000 7f9220e00640 1 --2- 172.21.15.115:0/3648074653 >> v2:172.21.15.115:3300/0 conn(0x7f921c0c5a50 0x7f921c152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.051+0000 7f921aa00640 1 -- 172.21.15.115:0/3648074653 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655935768 0 0) 0x7f921c0ce600 con 0x7f921c073dc0 2024-05-12T10:56:43.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.051+0000 7f921aa00640 1 -- 172.21.15.115:0/3648074653 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9200003530 con 0x7f921c073dc0 2024-05-12T10:56:43.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.051+0000 7f9220e00640 1 -- 172.21.15.115:0/3648074653 >> v1:172.21.15.134:6789/0 conn(0x7f921c0739e0 legacy=0x7f921c074270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:43.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.051+0000 7f9220e00640 1 -- 172.21.15.115:0/3648074653 >> v1:172.21.15.115:6789/0 conn(0x7f921c073dc0 legacy=0x7f921c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:43.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.051+0000 7f9220e00640 1 -- 172.21.15.115:0/3648074653 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921c0cebc0 con 0x7f921c0c5a50 2024-05-12T10:56:43.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.059+0000 7f9220e00640 1 --2- 172.21.15.115:0/3648074653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f921c0c5a50 0x7f921c152620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f921400bfa0 tx=0x7f921401eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1caf8da6203b84b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:43.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.067+0000 7f921aa00640 1 -- 172.21.15.115:0/3648074653 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921400b2d0 con 0x7f921c0c5a50 2024-05-12T10:56:43.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.071+0000 7f921aa00640 1 -- 172.21.15.115:0/3648074653 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92140a7850 con 0x7f921c0c5a50 2024-05-12T10:56:43.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.071+0000 7f921aa00640 1 -- 172.21.15.115:0/3648074653 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92140a7c20 con 0x7f921c0c5a50 2024-05-12T10:56:43.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.103+0000 7f9222e00640 1 -- 172.21.15.115:0/3648074653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f921c0c5a50 msgr2=0x7f921c152620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:43.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.103+0000 7f9222e00640 1 --2- 172.21.15.115:0/3648074653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f921c0c5a50 0x7f921c152620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f921400bfa0 tx=0x7f921401eb70 comp rx=0 tx=0).stop 2024-05-12T10:56:43.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.103+0000 7f9222e00640 1 -- 172.21.15.115:0/3648074653 shutdown_connections 2024-05-12T10:56:43.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.103+0000 7f9222e00640 1 --2- 172.21.15.115:0/3648074653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f921c0c5a50 0x7f921c152620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.103+0000 7f9222e00640 1 -- 172.21.15.115:0/3648074653 >> 172.21.15.115:0/3648074653 conn(0x7f921c0681c0 msgr2=0x7f921c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:43.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.107+0000 7f9222e00640 1 -- 172.21.15.115:0/3648074653 shutdown_connections 2024-05-12T10:56:43.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.111+0000 7f9222e00640 1 -- 172.21.15.115:0/3648074653 wait complete. 2024-05-12T10:56:43.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.111+0000 7f9222e00640 1 Processor -- start 2024-05-12T10:56:43.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.111+0000 7f9222e00640 1 -- start start 2024-05-12T10:56:43.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.111+0000 7f9222e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f921c0739e0 0x7f921c158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.111+0000 7f9222e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f921c073dc0 0x7f921c13eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.111+0000 7f9222e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f921c0c5a50 0x7f921c145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f9222e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f921c159720 con 0x7f921c0739e0 2024-05-12T10:56:43.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f9222e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f921c0ce3b0 con 0x7f921c073dc0 2024-05-12T10:56:43.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f9222e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f921c1598a0 con 0x7f921c0c5a50 2024-05-12T10:56:43.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f921be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f921c0739e0 0x7f921c158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f921be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f921c0739e0 0x7f921c158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38482/0 (socket says 172.21.15.115:38482) 2024-05-12T10:56:43.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f921be00640 1 -- 172.21.15.115:0/654516665 learned_addr learned my addr 172.21.15.115:0/654516665 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:43.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f9220e00640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f921c0c5a50 0x7f921c145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f921b400640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f921c073dc0 0x7f921c13eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f921be00640 1 -- 172.21.15.115:0/654516665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f921c0c5a50 msgr2=0x7f921c145320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:43.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f921be00640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f921c0c5a50 0x7f921c145320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f921be00640 1 -- 172.21.15.115:0/654516665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f921c073dc0 msgr2=0x7f921c13eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:43.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f921be00640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f921c073dc0 0x7f921c13eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f921be00640 1 -- 172.21.15.115:0/654516665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921c146f70 con 0x7f921c0739e0 2024-05-12T10:56:43.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.115+0000 7f921be00640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f921c0739e0 0x7f921c158440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f920c00c4b0 tx=0x7f920c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:43.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.119+0000 7f9213e00640 1 -- 172.21.15.115:0/654516665 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c0052d0 con 0x7f921c0739e0 2024-05-12T10:56:43.113 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.119+0000 7f9213e00640 1 -- 172.21.15.115:0/654516665 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920c005470 con 0x7f921c0739e0 2024-05-12T10:56:43.113 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.119+0000 7f9213e00640 1 -- 172.21.15.115:0/654516665 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c012850 con 0x7f921c0739e0 2024-05-12T10:56:43.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.119+0000 7f9222e00640 1 -- 172.21.15.115:0/654516665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f921c1573e0 con 0x7f921c0739e0 2024-05-12T10:56:43.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.119+0000 7f9222e00640 1 -- 172.21.15.115:0/654516665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f921c157960 con 0x7f921c0739e0 2024-05-12T10:56:43.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.123+0000 7f9213e00640 1 -- 172.21.15.115:0/654516665 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f920c0129f0 con 0x7f921c0739e0 2024-05-12T10:56:43.118 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.123+0000 7f9213e00640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f91fc06f450 0x7f91fc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.123+0000 7f9213e00640 1 -- 172.21.15.115:0/654516665 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f920c08f070 con 0x7f921c0739e0 2024-05-12T10:56:43.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.123+0000 7f9226232000 1 Processor -- start 2024-05-12T10:56:43.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.123+0000 7f9226232000 1 -- start start 2024-05-12T10:56:43.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f921b400640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f91fc06f450 0x7f91fc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f9226232000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 0x563b620609e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f9226232000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 0x563b62062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f9226232000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b62062f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f9226232000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563b61f21a60 con 0x563b62060600 2024-05-12T10:56:43.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f9226232000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563b61e8a250 con 0x563b62062b90 2024-05-12T10:56:43.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f9226232000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x563b61e2e4d0 con 0x563b62062270 2024-05-12T10:56:43.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f9220e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b62062f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f921b400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 0x563b62062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f9220e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b62062f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:40444/0 (socket says 172.21.15.115:40444) 2024-05-12T10:56:43.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f9220e00640 1 -- 172.21.15.115:0/2736557021 learned_addr learned my addr 172.21.15.115:0/2736557021 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:43.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f921b400640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f91fc06f450 0x7f91fc071910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f921c152220 tx=0x7f9208001ad0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:43.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f921b400640 1 -- 172.21.15.115:0/2736557021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 msgr2=0x563b62062f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:43.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f921b400640 1 --2- 172.21.15.115:0/2736557021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b62062f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f921b400640 1 -- 172.21.15.115:0/2736557021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 msgr2=0x563b620609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:43.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f921be00640 1 --2- 172.21.15.115:0/2736557021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 0x563b620609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f921b400640 1 --2- 172.21.15.115:0/2736557021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 0x563b620609e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f921b400640 1 -- 172.21.15.115:0/2736557021 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b61e61970 con 0x563b62062270 2024-05-12T10:56:43.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f921be00640 1 --2- 172.21.15.115:0/2736557021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 0x563b620609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:56:43.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.127+0000 7f921b400640 1 --2- 172.21.15.115:0/2736557021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 0x563b62062650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9208005890 tx=0x7f920801b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3f91924fde30016 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:43.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9210c00640 1 -- 172.21.15.115:0/2736557021 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208007730 con 0x563b62062270 2024-05-12T10:56:43.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9210c00640 1 -- 172.21.15.115:0/2736557021 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920800e700 con 0x563b62062270 2024-05-12T10:56:43.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9210c00640 1 -- 172.21.15.115:0/2736557021 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920800eab0 con 0x563b62062270 2024-05-12T10:56:43.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9226232000 1 -- 172.21.15.115:0/2736557021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 msgr2=0x563b62062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:43.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9226232000 1 --2- 172.21.15.115:0/2736557021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 0x563b62062650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9208005890 tx=0x7f920801b000 comp rx=0 tx=0).stop 2024-05-12T10:56:43.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9226232000 1 -- 172.21.15.115:0/2736557021 shutdown_connections 2024-05-12T10:56:43.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9226232000 1 --2- 172.21.15.115:0/2736557021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b62062f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9226232000 1 --2- 172.21.15.115:0/2736557021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 0x563b62062650 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9226232000 1 --2- 172.21.15.115:0/2736557021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 0x563b620609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9226232000 1 -- 172.21.15.115:0/2736557021 >> 172.21.15.115:0/2736557021 conn(0x563b62077430 msgr2=0x563b62079820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:43.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9226232000 1 -- 172.21.15.115:0/2736557021 shutdown_connections 2024-05-12T10:56:43.129 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.131+0000 7f9226232000 1 -- 172.21.15.115:0/2736557021 wait complete. 2024-05-12T10:56:43.129 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.135+0000 7f9226232000 1 -- start start 2024-05-12T10:56:43.129 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.135+0000 7f9226232000 1 Processor -- start 2024-05-12T10:56:43.132 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.135+0000 7f9226232000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 0x563b62060040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.132 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.135+0000 7f9226232000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 0x563b6205dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.132 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.135+0000 7f9226232000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b6205e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.135+0000 7f9226232000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563b61e86210 con 0x563b62060600 2024-05-12T10:56:43.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.135+0000 7f9226232000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563b61e97650 con 0x563b62062b90 2024-05-12T10:56:43.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.135+0000 7f9226232000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x563b61ec85b0 con 0x563b62062270 2024-05-12T10:56:43.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.135+0000 7f9226232000 10 client.0 _ll_register_callbacks cb 0x563b62024f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:56:43.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.135+0000 7f9220e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b6205e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9220e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b6205e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:40448/0 (socket says 172.21.15.115:40448) 2024-05-12T10:56:43.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9220e00640 1 -- 172.21.15.115:0/1101536141 learned_addr learned my addr 172.21.15.115:0/1101536141 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:43.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f921b400640 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 0x563b6205dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f921b400640 1 -- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 msgr2=0x563b6205e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:43.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f921b400640 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b6205e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f921b400640 1 -- 172.21.15.115:0/1101536141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 msgr2=0x563b62060040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:43.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f921be00640 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 0x563b62060040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f921b400640 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 0x563b62060040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f921b400640 1 -- 172.21.15.115:0/1101536141 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x563b61ece0e0 con 0x563b62062270 2024-05-12T10:56:43.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f921be00640 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 0x563b62060040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:56:43.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f921b400640 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 0x563b6205dc00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9208017000 tx=0x7f9208000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c746860eb118688 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:43.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9205600640 10 client.0 ms_handle_connect on v2:172.21.15.134:3301/0 2024-05-12T10:56:43.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9205600640 1 -- 172.21.15.115:0/1101536141 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920802f060 con 0x563b62062270 2024-05-12T10:56:43.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9205600640 1 -- 172.21.15.115:0/1101536141 <== mon.2 v2:172.21.15.134:3301/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f9208021480 con 0x563b62062270 2024-05-12T10:56:43.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9226232000 1 -- 172.21.15.115:0/1101536141 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f920800e700 con 0x563b62062270 2024-05-12T10:56:43.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9205600640 1 -- 172.21.15.115:0/1101536141 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f92080216c0 con 0x563b62062270 2024-05-12T10:56:43.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9226232000 10 client.4877 fetch_fsmap learned FSMap version 14 2024-05-12T10:56:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9226232000 1 -- 172.21.15.115:0/1101536141 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x563b61e3c9e0 con 0x563b62062270 2024-05-12T10:56:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9205600640 1 -- 172.21.15.115:0/1101536141 <== mon.2 v2:172.21.15.134:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920800e700 con 0x563b62062270 2024-05-12T10:56:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9205600640 1 -- 172.21.15.115:0/1101536141 <== mon.2 v2:172.21.15.134:3301/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f9208021860 con 0x563b62062270 2024-05-12T10:56:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9226232000 10 client.4877 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:56:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9226232000 10 client.4877 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:56:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9226232000 20 client.4877 populate_metadata read hostname 'smithi115' 2024-05-12T10:56:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9226232000 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x563b6205eeb0 0x563b62096070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9226232000 4 client.4877 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:56:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.139+0000 7f9226232000 1 -- 172.21.15.115:0/1101536141 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b61e23060 con 0x563b6205eeb0 2024-05-12T10:56:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f921be00640 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x563b6205eeb0 0x563b62096070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f921be00640 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x563b6205eeb0 0x563b62096070 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=622e550296e6872d server_cookie=28d2eaae3b0f8d78 in_seq=0 out_seq=0 2024-05-12T10:56:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9205600640 10 client.4877 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:56:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9205600640 1 -- 172.21.15.115:0/1101536141 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563b61e23060 con 0x563b6205eeb0 2024-05-12T10:56:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9205600640 10 client.4877 handle_command_reply: tid=0 2024-05-12T10:56:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9226232000 1 client.4877 shutdown 2024-05-12T10:56:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9226232000 1 -- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 msgr2=0x563b6205dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9226232000 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 0x563b6205dc00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9208017000 tx=0x7f9208000ee0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9226232000 1 -- 172.21.15.115:0/1101536141 shutdown_connections 2024-05-12T10:56:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9226232000 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x563b6205eeb0 0x563b62096070 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9226232000 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b6205e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9226232000 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062270 0x563b6205dc00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9226232000 1 --2- 172.21.15.115:0/1101536141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62060600 0x563b62060040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9226232000 1 -- 172.21.15.115:0/1101536141 >> 172.21.15.115:0/1101536141 conn(0x563b62077430 msgr2=0x563b62079820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9205600640 0 client.4877 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:56:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9226232000 1 -- 172.21.15.115:0/1101536141 shutdown_connections 2024-05-12T10:56:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.143+0000 7f9226232000 1 -- 172.21.15.115:0/1101536141 wait complete. 2024-05-12T10:56:43.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.147+0000 7f9226232000 20 client.4877 trim_cache size 0 max 16384 2024-05-12T10:56:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f9226232000 1 Processor -- start 2024-05-12T10:56:43.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f9226232000 1 -- start start 2024-05-12T10:56:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f9226232000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62060600 0x563b6208dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f9226232000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 0x563b6208e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f9226232000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b6208e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f9226232000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f921c1fd5f0 con 0x563b62062270 2024-05-12T10:56:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f9226232000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f921c14e920 con 0x563b62062b90 2024-05-12T10:56:43.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f9226232000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f921c1fcf50 con 0x563b62060600 2024-05-12T10:56:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f921be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62060600 0x563b6208dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f921be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62060600 0x563b6208dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:46952/0 (socket says 172.21.15.115:46952) 2024-05-12T10:56:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f921be00640 1 -- 172.21.15.115:0/833548073 learned_addr learned my addr 172.21.15.115:0/833548073 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f921b400640 1 --2- 172.21.15.115:0/833548073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 0x563b6208e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f921b400640 1 -- 172.21.15.115:0/833548073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62060600 msgr2=0x563b6208dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f921b400640 1 --2- 172.21.15.115:0/833548073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62060600 0x563b6208dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f921b400640 1 -- 172.21.15.115:0/833548073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 msgr2=0x563b6208e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f921b400640 1 --2- 172.21.15.115:0/833548073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b6208e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.171+0000 7f921b400640 1 -- 172.21.15.115:0/833548073 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b61e2e6e0 con 0x563b62062270 2024-05-12T10:56:43.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f921b400640 1 --2- 172.21.15.115:0/833548073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 0x563b6208e280 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9208001ec0 tx=0x7f9208027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ea8e6050aba54d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:43.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9207e00640 1 -- 172.21.15.115:0/833548073 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208039080 con 0x563b62062270 2024-05-12T10:56:43.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9207e00640 1 -- 172.21.15.115:0/833548073 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9208021480 con 0x563b62062270 2024-05-12T10:56:43.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9207e00640 1 -- 172.21.15.115:0/833548073 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920800e530 con 0x563b62062270 2024-05-12T10:56:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 -- 172.21.15.115:0/833548073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 msgr2=0x563b6208e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 --2- 172.21.15.115:0/833548073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 0x563b6208e280 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9208001ec0 tx=0x7f9208027000 comp rx=0 tx=0).stop 2024-05-12T10:56:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 -- 172.21.15.115:0/833548073 shutdown_connections 2024-05-12T10:56:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 --2- 172.21.15.115:0/833548073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62062b90 0x563b6208e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 --2- 172.21.15.115:0/833548073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 0x563b6208e280 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 --2- 172.21.15.115:0/833548073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62060600 0x563b6208dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 -- 172.21.15.115:0/833548073 >> 172.21.15.115:0/833548073 conn(0x563b62077430 msgr2=0x563b620609e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 -- 172.21.15.115:0/833548073 shutdown_connections 2024-05-12T10:56:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 -- 172.21.15.115:0/833548073 wait complete. 2024-05-12T10:56:43.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 -- start start 2024-05-12T10:56:43.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 Processor -- start 2024-05-12T10:56:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.175+0000 7f9226232000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62060600 0x563b620f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 0x563b620f8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062b90 0x563b620b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563b61e1fc50 con 0x563b62062270 2024-05-12T10:56:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563b61e82d70 con 0x563b62060600 2024-05-12T10:56:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x563b61e89560 con 0x563b62062b90 2024-05-12T10:56:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 10 client.0 _ll_register_callbacks cb 0x7f921400bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:56:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921be00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62060600 0x563b620f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921b400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 0x563b620f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921be00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62060600 0x563b620f81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:40466/0 (socket says 172.21.15.115:40466) 2024-05-12T10:56:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921be00640 1 -- 172.21.15.115:0/3143413932 learned_addr learned my addr 172.21.15.115:0/3143413932 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:56:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9220e00640 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062b90 0x563b620b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921b400640 1 -- 172.21.15.115:0/3143413932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062b90 msgr2=0x563b620b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921b400640 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062b90 0x563b620b7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921b400640 1 -- 172.21.15.115:0/3143413932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62060600 msgr2=0x563b620f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:56:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921b400640 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62060600 0x563b620f81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921b400640 1 -- 172.21.15.115:0/3143413932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b61ee12a0 con 0x563b62062270 2024-05-12T10:56:43.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921b400640 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 0x563b620f8710 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x563b6202a240 tx=0x7f9208019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa544b985f49d5b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:56:43.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9205600640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:56:43.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9205600640 1 -- 172.21.15.115:0/3143413932 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920800edf0 con 0x563b62062270 2024-05-12T10:56:43.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 1 -- 172.21.15.115:0/3143413932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9208021480 con 0x563b62062270 2024-05-12T10:56:43.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9205600640 1 -- 172.21.15.115:0/3143413932 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f9208034420 con 0x563b62062270 2024-05-12T10:56:43.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9205600640 1 -- 172.21.15.115:0/3143413932 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f920804d050 con 0x563b62062270 2024-05-12T10:56:43.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 10 client.5160 fetch_fsmap learned FSMap version 14 2024-05-12T10:56:43.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 1 -- 172.21.15.115:0/3143413932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x563b61e1e9c0 con 0x563b62062270 2024-05-12T10:56:43.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9205600640 1 -- 172.21.15.115:0/3143413932 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9208021480 con 0x563b62062270 2024-05-12T10:56:43.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9205600640 1 -- 172.21.15.115:0/3143413932 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f9208050020 con 0x563b62062270 2024-05-12T10:56:43.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 10 client.5160 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:56:43.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 10 client.5160 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:56:43.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 20 client.5160 populate_metadata read hostname 'smithi115' 2024-05-12T10:56:43.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x563b620b8890 0x563b620b8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:56:43.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 4 client.5160 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4727d837", "release": true, "await": true}] 2024-05-12T10:56:43.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9226232000 1 -- 172.21.15.115:0/3143413932 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4727d837", "release": true, "await": true}) -- 0x563b61e97e60 con 0x563b620b8890 2024-05-12T10:56:43.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921be00640 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x563b620b8890 0x563b620b8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:56:43.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f921be00640 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x563b620b8890 0x563b620b8c70 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=836127d0b179935 server_cookie=926847022e7cee4c in_seq=0 out_seq=0 2024-05-12T10:56:43.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.179+0000 7f9205600640 10 client.5160 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:56:43.178 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9205600640 1 -- 172.21.15.115:0/3143413932 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x563b61e97e60 con 0x563b620b8890 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9205600640 10 client.5160 handle_command_reply: tid=0 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 1 client.5160 shutdown 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 1 -- 172.21.15.115:0/3143413932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 msgr2=0x563b620f8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 0x563b620f8710 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x563b6202a240 tx=0x7f9208019040 comp rx=0 tx=0).stop 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 1 -- 172.21.15.115:0/3143413932 shutdown_connections 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x563b62062b90 0x563b620b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563b62062270 0x563b620f8710 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x563b620b8890 0x563b620b8c70 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 1 --2- 172.21.15.115:0/3143413932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b62060600 0x563b620f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 1 -- 172.21.15.115:0/3143413932 >> 172.21.15.115:0/3143413932 conn(0x563b62077430 msgr2=0x563b620911a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9205600640 0 client.5160 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 1 -- 172.21.15.115:0/3143413932 shutdown_connections 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 1 -- 172.21.15.115:0/3143413932 wait complete. 2024-05-12T10:56:43.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9226232000 20 client.5160 trim_cache size 0 max 16384 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 20, 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout: "4727d837": { 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 20, 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:56:43.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 70.0, 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:56:43.181 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:56:43.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 -- 172.21.15.115:0/654516665 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f91fc06f450 msgr2=0x7f91fc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:43.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f91fc06f450 0x7f91fc071910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f921c152220 tx=0x7f9208001ad0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 -- 172.21.15.115:0/654516665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f921c0739e0 msgr2=0x7f921c158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:56:43.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f921c0739e0 0x7f921c158440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f920c00c4b0 tx=0x7f920c00c970 comp rx=0 tx=0).stop 2024-05-12T10:56:43.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 -- 172.21.15.115:0/654516665 shutdown_connections 2024-05-12T10:56:43.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f91fc06f450 0x7f91fc071910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f921c0c5a50 0x7f921c145320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f921c073dc0 0x7f921c13eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 --2- 172.21.15.115:0/654516665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f921c0739e0 0x7f921c158440 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:56:43.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 -- 172.21.15.115:0/654516665 >> 172.21.15.115:0/654516665 conn(0x7f921c0681c0 msgr2=0x7f921c06cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:56:43.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 -- 172.21.15.115:0/654516665 shutdown_connections 2024-05-12T10:56:43.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:56:43.183+0000 7f9222e00640 1 -- 172.21.15.115:0/654516665 wait complete. 2024-05-12T10:56:43.203 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4727d837', seconds elapsed: 12.6 2024-05-12T10:56:49.032 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:56:49.032 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 rewriters = 205133.19 kB/sec 2024-05-12T10:56:49.032 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 rewriters = 205131.00 kB/sec 2024-05-12T10:56:49.032 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 205133.19 kB/sec 2024-05-12T10:56:49.032 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 205133.19 kB/sec 2024-05-12T10:56:49.032 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 205133.19 kB/sec 2024-05-12T10:56:49.032 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 10485760.00 kB 2024-05-12T10:56:51.278 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:56:51.281 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:57:01.775 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.5 2024-05-12T10:57:01.776 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:57:01.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f45a3800640 1 Processor -- start 2024-05-12T10:57:01.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f45a3800640 1 -- start start 2024-05-12T10:57:01.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f45a3800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f459c0c9950 0x7f459c167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:01.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f45a3800640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f459c0c81e0 con 0x7f459c15c910 2024-05-12T10:57:01.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f45a3800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f459c0c84c0 con 0x7f459c0c8b20 2024-05-12T10:57:01.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f45a3800640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f459c0c9780 con 0x7f459c0c9950 2024-05-12T10:57:01.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f459be00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f459c15c910 0x7f459c1559a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38260/0 (socket says 172.21.15.115:38260) 2024-05-12T10:57:01.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f459be00640 1 -- 172.21.15.115:0/2313787046 learned_addr learned my addr 172.21.15.115:0/2313787046 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:57:01.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f45a1800640 1 --2- 172.21.15.115:0/2313787046 >> v2:172.21.15.115:3300/0 conn(0x7f459c0c9950 0x7f459c167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:01.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f45a1800640 1 -- 172.21.15.115:0/2313787046 >> v1:172.21.15.134:6789/0 conn(0x7f459c0c8b20 legacy=0x7f459c15f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:01.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f45a1800640 1 -- 172.21.15.115:0/2313787046 >> v1:172.21.15.115:6789/0 conn(0x7f459c15c910 legacy=0x7f459c1559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:01.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f45a1800640 1 -- 172.21.15.115:0/2313787046 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c15be30 con 0x7f459c0c9950 2024-05-12T10:57:01.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.955+0000 7f459b400640 1 -- 172.21.15.115:0/2313787046 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968021275 0 0) 0x7f459c0c84c0 con 0x7f459c0c8b20 2024-05-12T10:57:01.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.959+0000 7f45a1800640 1 --2- 172.21.15.115:0/2313787046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f459c0c9950 0x7f459c167550 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4594009d90 tx=0x7f459401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f279b2765d9ca2e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:01.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.959+0000 7f459b400640 1 -- 172.21.15.115:0/2313787046 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45940b4070 con 0x7f459c0c9950 2024-05-12T10:57:01.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.959+0000 7f459b400640 1 -- 172.21.15.115:0/2313787046 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45940af600 con 0x7f459c0c9950 2024-05-12T10:57:01.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.959+0000 7f459b400640 1 -- 172.21.15.115:0/2313787046 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45940af9d0 con 0x7f459c0c9950 2024-05-12T10:57:01.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 -- 172.21.15.115:0/2313787046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f459c0c9950 msgr2=0x7f459c167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:01.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 --2- 172.21.15.115:0/2313787046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f459c0c9950 0x7f459c167550 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4594009d90 tx=0x7f459401f150 comp rx=0 tx=0).stop 2024-05-12T10:57:01.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 -- 172.21.15.115:0/2313787046 shutdown_connections 2024-05-12T10:57:01.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 --2- 172.21.15.115:0/2313787046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f459c0c9950 0x7f459c167550 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:01.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 -- 172.21.15.115:0/2313787046 >> 172.21.15.115:0/2313787046 conn(0x7f459c0681c0 msgr2=0x7f459c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:01.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 -- 172.21.15.115:0/2313787046 shutdown_connections 2024-05-12T10:57:01.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 -- 172.21.15.115:0/2313787046 wait complete. 2024-05-12T10:57:01.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 Processor -- start 2024-05-12T10:57:01.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 -- start start 2024-05-12T10:57:01.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c0c8b20 0x7f459c0c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:01.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f459c0c9950 0x7f459c1e4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:01.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f459c15c910 0x7f459c1f17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:01.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f459c0c8f00 con 0x7f459c15c910 2024-05-12T10:57:01.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f459c15c3f0 con 0x7f459c0c8b20 2024-05-12T10:57:01.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a3800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f459c0c9080 con 0x7f459c0c9950 2024-05-12T10:57:01.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a0e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c0c8b20 0x7f459c0c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:01.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a1800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f459c15c910 0x7f459c1f17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:01.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f459be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f459c0c9950 0x7f459c1e4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:01.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a0e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c0c8b20 0x7f459c0c5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:45418/0 (socket says 172.21.15.115:45418) 2024-05-12T10:57:01.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.963+0000 7f45a0e00640 1 -- 172.21.15.115:0/679163838 learned_addr learned my addr 172.21.15.115:0/679163838 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:01.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f45a1800640 1 -- 172.21.15.115:0/679163838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f459c0c9950 msgr2=0x7f459c1e4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:01.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f45a1800640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f459c0c9950 0x7f459c1e4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:01.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f45a1800640 1 -- 172.21.15.115:0/679163838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c0c8b20 msgr2=0x7f459c0c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:01.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f45a1800640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c0c8b20 0x7f459c0c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:01.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f45a1800640 1 -- 172.21.15.115:0/679163838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c15ce20 con 0x7f459c15c910 2024-05-12T10:57:01.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f45a0e00640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c0c8b20 0x7f459c0c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:57:01.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f45a1800640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f459c15c910 0x7f459c1f17a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f45940af000 tx=0x7f459401bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:01.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f4598c00640 1 -- 172.21.15.115:0/679163838 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45940b4040 con 0x7f459c15c910 2024-05-12T10:57:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f4598c00640 1 -- 172.21.15.115:0/679163838 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45940af400 con 0x7f459c15c910 2024-05-12T10:57:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f4598c00640 1 -- 172.21.15.115:0/679163838 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45940ba670 con 0x7f459c15c910 2024-05-12T10:57:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f45a3800640 1 -- 172.21.15.115:0/679163838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459c15d100 con 0x7f459c15c910 2024-05-12T10:57:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f45a3800640 1 -- 172.21.15.115:0/679163838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459c15f190 con 0x7f459c15c910 2024-05-12T10:57:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.967+0000 7f45a3800640 1 -- 172.21.15.115:0/679163838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f459c069730 con 0x7f459c15c910 2024-05-12T10:57:01.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.971+0000 7f4598c00640 1 -- 172.21.15.115:0/679163838 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f45940c3020 con 0x7f459c15c910 2024-05-12T10:57:01.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.971+0000 7f4598c00640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f457c06f400 0x7f457c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:01.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.971+0000 7f4598c00640 1 -- 172.21.15.115:0/679163838 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f459412d930 con 0x7f459c15c910 2024-05-12T10:57:01.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.971+0000 7f45a0e00640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f457c06f400 0x7f457c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:01.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.971+0000 7f45a0e00640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f457c06f400 0x7f457c0718c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4590001c80 tx=0x7f4590009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:01.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:01.975+0000 7f4598c00640 1 -- 172.21.15.115:0/679163838 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4594018cb0 con 0x7f459c15c910 2024-05-12T10:57:02.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.223+0000 7f45a3800640 1 -- 172.21.15.115:0/679163838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f459c15ef40 con 0x7f459c15c910 2024-05-12T10:57:02.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.223+0000 7f4598c00640 1 -- 172.21.15.115:0/679163838 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f45940f9e60 con 0x7f459c15c910 2024-05-12T10:57:02.216 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:57:02.216 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:57:02.216 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:57:02.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 -- 172.21.15.115:0/679163838 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f457c06f400 msgr2=0x7f457c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f457c06f400 0x7f457c0718c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4590001c80 tx=0x7f4590009040 comp rx=0 tx=0).stop 2024-05-12T10:57:02.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 -- 172.21.15.115:0/679163838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f459c15c910 msgr2=0x7f459c1f17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f459c15c910 0x7f459c1f17a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f45940af000 tx=0x7f459401bef0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 -- 172.21.15.115:0/679163838 shutdown_connections 2024-05-12T10:57:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f457c06f400 0x7f457c0718c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f459c15c910 0x7f459c1f17a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f459c0c9950 0x7f459c1e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 --2- 172.21.15.115:0/679163838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c0c8b20 0x7f459c0c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 -- 172.21.15.115:0/679163838 >> 172.21.15.115:0/679163838 conn(0x7f459c0681c0 msgr2=0x7f459c14e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 -- 172.21.15.115:0/679163838 shutdown_connections 2024-05-12T10:57:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.227+0000 7f45a3800640 1 -- 172.21.15.115:0/679163838 wait complete. 2024-05-12T10:57:02.247 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db / --timeout 60 --expiration 78.5 --await-for 42.0' 2024-05-12T10:57:02.247 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db / --timeout 60 --expiration 78.5 --await-for 42.0 2024-05-12T10:57:02.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.443+0000 7f11fb800640 1 Processor -- start 2024-05-12T10:57:02.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.443+0000 7f11fb800640 1 -- start start 2024-05-12T10:57:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.443+0000 7f11fb800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11f4150ba0 0x7f11f40c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.443+0000 7f11fb800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11f4159b40 0x7f11f4159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.443+0000 7f11fb800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11f4070c70 con 0x7f11f40c9fd0 2024-05-12T10:57:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.443+0000 7f11fb800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f11f40cba70 con 0x7f11f4150ba0 2024-05-12T10:57:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.443+0000 7f11fb800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f11f4070f30 con 0x7f11f4159b40 2024-05-12T10:57:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.443+0000 7f11f8e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11f4150ba0 0x7f11f40c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.443+0000 7f11f9800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11f4159b40 0x7f11f4159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.443+0000 7f11f8e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11f4150ba0 0x7f11f40c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:58894/0 (socket says 172.21.15.115:58894) 2024-05-12T10:57:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.443+0000 7f11f8e00640 1 -- 172.21.15.115:0/3848039208 learned_addr learned my addr 172.21.15.115:0/3848039208 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:02.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.447+0000 7f11f8e00640 1 -- 172.21.15.115:0/3848039208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11f4159b40 msgr2=0x7f11f4159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:02.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.447+0000 7f11f8e00640 1 --2- 172.21.15.115:0/3848039208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11f4159b40 0x7f11f4159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.447+0000 7f11f8e00640 1 -- 172.21.15.115:0/3848039208 >> v1:172.21.15.134:6789/0 conn(0x7f11f40c9fd0 legacy=0x7f11f40cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.447+0000 7f11f8e00640 1 -- 172.21.15.115:0/3848039208 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f4071210 con 0x7f11f4150ba0 2024-05-12T10:57:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11f8e00640 1 --2- 172.21.15.115:0/3848039208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4150ba0 0x7f11f40c6440 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009870 tx=0x7f11e001ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a67bda038064ea2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:02.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11f3400640 1 -- 172.21.15.115:0/3848039208 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e00b5070 con 0x7f11f4150ba0 2024-05-12T10:57:02.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11f3400640 1 -- 172.21.15.115:0/3848039208 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e00a8a50 con 0x7f11f4150ba0 2024-05-12T10:57:02.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11f3400640 1 -- 172.21.15.115:0/3848039208 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e00a8e20 con 0x7f11f4150ba0 2024-05-12T10:57:02.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11fb800640 1 -- 172.21.15.115:0/3848039208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4150ba0 msgr2=0x7f11f40c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11fb800640 1 --2- 172.21.15.115:0/3848039208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4150ba0 0x7f11f40c6440 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009870 tx=0x7f11e001ed50 comp rx=0 tx=0).stop 2024-05-12T10:57:02.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11fb800640 1 -- 172.21.15.115:0/3848039208 shutdown_connections 2024-05-12T10:57:02.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11fb800640 1 --2- 172.21.15.115:0/3848039208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11f4159b40 0x7f11f4159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11fb800640 1 --2- 172.21.15.115:0/3848039208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4150ba0 0x7f11f40c6440 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11fb800640 1 -- 172.21.15.115:0/3848039208 >> 172.21.15.115:0/3848039208 conn(0x7f11f406c610 msgr2=0x7f11f406ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:02.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11fb800640 1 -- 172.21.15.115:0/3848039208 shutdown_connections 2024-05-12T10:57:02.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11fb800640 1 -- 172.21.15.115:0/3848039208 wait complete. 2024-05-12T10:57:02.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11fb800640 1 Processor -- start 2024-05-12T10:57:02.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.451+0000 7f11fb800640 1 -- start start 2024-05-12T10:57:02.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11fb800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11f40c9fd0 0x7f11f41f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11fb800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4150ba0 0x7f11f414c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11fb800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11f4159b40 0x7f11f41f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11fb800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f11f40cb700 con 0x7f11f4159b40 2024-05-12T10:57:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11fb800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11f40cb420 con 0x7f11f4150ba0 2024-05-12T10:57:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11fb800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f11f40ca410 con 0x7f11f40c9fd0 2024-05-12T10:57:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11f4159b40 0x7f11f41f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11f4159b40 0x7f11f41f24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50238/0 (socket says 172.21.15.115:50238) 2024-05-12T10:57:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f9800640 1 -- 172.21.15.115:0/3200341907 learned_addr learned my addr 172.21.15.115:0/3200341907 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f8e00640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11f40c9fd0 0x7f11f41f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f3e00640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4150ba0 0x7f11f414c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f9800640 1 -- 172.21.15.115:0/3200341907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11f40c9fd0 msgr2=0x7f11f41f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f9800640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11f40c9fd0 0x7f11f41f5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f9800640 1 -- 172.21.15.115:0/3200341907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4150ba0 msgr2=0x7f11f414c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f9800640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4150ba0 0x7f11f414c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f9800640 1 -- 172.21.15.115:0/3200341907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f41f60a0 con 0x7f11f4159b40 2024-05-12T10:57:02.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f3e00640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4150ba0 0x7f11f414c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:57:02.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f9800640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11f4159b40 0x7f11f41f24a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009d30 tx=0x7f11ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:02.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f0c00640 1 -- 172.21.15.115:0/3200341907 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0179c0 con 0x7f11f4159b40 2024-05-12T10:57:02.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f0c00640 1 -- 172.21.15.115:0/3200341907 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec01b070 con 0x7f11f4159b40 2024-05-12T10:57:02.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11fb800640 1 -- 172.21.15.115:0/3200341907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f406e720 con 0x7f11f4159b40 2024-05-12T10:57:02.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11f0c00640 1 -- 172.21.15.115:0/3200341907 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec017da0 con 0x7f11f4159b40 2024-05-12T10:57:02.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.455+0000 7f11fb800640 1 -- 172.21.15.115:0/3200341907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f406eca0 con 0x7f11f4159b40 2024-05-12T10:57:02.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.459+0000 7f11f0c00640 1 -- 172.21.15.115:0/3200341907 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f11ec01d030 con 0x7f11f4159b40 2024-05-12T10:57:02.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.459+0000 7f11f0c00640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f11d406f430 0x7f11d40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.459+0000 7f11f0c00640 1 -- 172.21.15.115:0/3200341907 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f11ec0980c0 con 0x7f11f4159b40 2024-05-12T10:57:02.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.459+0000 7f11f8e00640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f11d406f430 0x7f11d40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f8e00640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f11d406f430 0x7f11d40718f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f11e00b2000 tx=0x7f11e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:02.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 Processor -- start 2024-05-12T10:57:02.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 -- start start 2024-05-12T10:57:02.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e1f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e20060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e24df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564271c330f0 con 0x564271e24a10 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564271bec670 con 0x564271de9df0 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x564271c2f0b0 con 0x564271e1fc80 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e24df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e24df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50246/0 (socket says 172.21.15.115:50246) 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f9800640 1 -- 172.21.15.115:0/917625361 learned_addr learned my addr 172.21.15.115:0/917625361 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f3e00640 1 --2- 172.21.15.115:0/917625361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e20060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f8e00640 1 --2- 172.21.15.115:0/917625361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e1f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f9800640 1 -- 172.21.15.115:0/917625361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 msgr2=0x564271e20060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f9800640 1 --2- 172.21.15.115:0/917625361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e20060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f9800640 1 -- 172.21.15.115:0/917625361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 msgr2=0x564271e1f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:02.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f9800640 1 --2- 172.21.15.115:0/917625361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e1f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f9800640 1 -- 172.21.15.115:0/917625361 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564271bf5010 con 0x564271e24a10 2024-05-12T10:57:02.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11f9800640 1 --2- 172.21.15.115:0/917625361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e24df0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f11ec060b30 tx=0x7f11ec063cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341bb0953b5e4477 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:02.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11e5600640 1 -- 172.21.15.115:0/917625361 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec064540 con 0x564271e24a10 2024-05-12T10:57:02.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11e5600640 1 -- 172.21.15.115:0/917625361 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec0688f0 con 0x564271e24a10 2024-05-12T10:57:02.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11e5600640 1 -- 172.21.15.115:0/917625361 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec06d0c0 con 0x564271e24a10 2024-05-12T10:57:02.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 -- 172.21.15.115:0/917625361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 msgr2=0x564271e24df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 --2- 172.21.15.115:0/917625361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e24df0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f11ec060b30 tx=0x7f11ec063cb0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 -- 172.21.15.115:0/917625361 shutdown_connections 2024-05-12T10:57:02.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 --2- 172.21.15.115:0/917625361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e24df0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 --2- 172.21.15.115:0/917625361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e20060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 --2- 172.21.15.115:0/917625361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e1f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 -- 172.21.15.115:0/917625361 >> 172.21.15.115:0/917625361 conn(0x564271ccbf90 msgr2=0x564271e227d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:02.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 -- 172.21.15.115:0/917625361 shutdown_connections 2024-05-12T10:57:02.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.463+0000 7f11febe0000 1 -- 172.21.15.115:0/917625361 wait complete. 2024-05-12T10:57:02.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 -- start start 2024-05-12T10:57:02.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 Processor -- start 2024-05-12T10:57:02.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271de9df0 0x564271e1eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271e1fc80 0x564271e1f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271de51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564271c404f0 con 0x564271e24a10 2024-05-12T10:57:02.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564271bd3900 con 0x564271e1fc80 2024-05-12T10:57:02.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x564271dea1d0 con 0x564271de9df0 2024-05-12T10:57:02.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 10 client.0 _ll_register_callbacks cb 0x564271dcf180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:57:02.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11f9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271de51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11f9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271de51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50250/0 (socket says 172.21.15.115:50250) 2024-05-12T10:57:02.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11f9800640 1 -- 172.21.15.115:0/2140365732 learned_addr learned my addr 172.21.15.115:0/2140365732 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:02.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11f9800640 1 -- 172.21.15.115:0/2140365732 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271de9df0 msgr2=0x564271e1eb20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-12T10:57:02.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11f9800640 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271de9df0 0x564271e1eb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11f9800640 1 -- 172.21.15.115:0/2140365732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271e1fc80 msgr2=0x564271e1f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:02.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11f3e00640 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271e1fc80 0x564271e1f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11f9800640 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271e1fc80 0x564271e1f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11f9800640 1 -- 172.21.15.115:0/2140365732 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564271be5e40 con 0x564271e24a10 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11f9800640 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271de51b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0617b0 tx=0x7f11ec02a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef1f78c63a134c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11da000640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11da000640 1 -- 172.21.15.115:0/2140365732 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec06d310 con 0x564271e24a10 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11da000640 1 -- 172.21.15.115:0/2140365732 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f11ec0639b0 con 0x564271e24a10 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 -- 172.21.15.115:0/2140365732 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11ec0688f0 con 0x564271e24a10 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11da000640 1 -- 172.21.15.115:0/2140365732 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f11ec064540 con 0x564271e24a10 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 10 client.5178 fetch_fsmap learned FSMap version 14 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 -- 172.21.15.115:0/2140365732 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x564271cfdab0 con 0x564271e24a10 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11da000640 1 -- 172.21.15.115:0/2140365732 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec0688f0 con 0x564271e24a10 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11da000640 1 -- 172.21.15.115:0/2140365732 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f11ec05feb0 con 0x564271e24a10 2024-05-12T10:57:02.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 10 client.5178 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:57:02.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 10 client.5178 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:57:02.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 20 client.5178 populate_metadata read hostname 'smithi115' 2024-05-12T10:57:02.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x564271de5f50 0x564271de6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 4 client.5178 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:57:02.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.467+0000 7f11febe0000 1 -- 172.21.15.115:0/2140365732 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564271bcc7f0 con 0x564271de5f50 2024-05-12T10:57:02.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.471+0000 7f11f8e00640 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x564271de5f50 0x564271de6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.471+0000 7f11f8e00640 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x564271de5f50 0x564271de6360 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f1ec10fdbafb242 server_cookie=bfc6c2d1a528989c in_seq=0 out_seq=0 2024-05-12T10:57:02.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.471+0000 7f11da000640 10 client.5178 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:02.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11da000640 1 -- 172.21.15.115:0/2140365732 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564271bcc7f0 con 0x564271de5f50 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11da000640 10 client.5178 handle_command_reply: tid=0 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 1 client.5178 shutdown 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 1 -- 172.21.15.115:0/2140365732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 msgr2=0x564271de51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271de51b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0617b0 tx=0x7f11ec02a070 comp rx=0 tx=0).stop 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 1 -- 172.21.15.115:0/2140365732 shutdown_connections 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271de51b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x564271de5f50 0x564271de6360 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271e1fc80 0x564271e1f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 1 --2- 172.21.15.115:0/2140365732 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271de9df0 0x564271e1eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 1 -- 172.21.15.115:0/2140365732 >> 172.21.15.115:0/2140365732 conn(0x564271ccbf90 msgr2=0x564271e22490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11da000640 0 client.5178 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 1 -- 172.21.15.115:0/2140365732 shutdown_connections 2024-05-12T10:57:02.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 1 -- 172.21.15.115:0/2140365732 wait complete. 2024-05-12T10:57:02.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.475+0000 7f11febe0000 20 client.5178 trim_cache size 0 max 16384 2024-05-12T10:57:02.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11febe0000 1 Processor -- start 2024-05-12T10:57:02.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11febe0000 1 -- start start 2024-05-12T10:57:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11febe0000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e99160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11febe0000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11febe0000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e99be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11febe0000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f11f4154ba0 con 0x564271e24a10 2024-05-12T10:57:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11febe0000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11f4153390 con 0x564271de9df0 2024-05-12T10:57:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11febe0000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f11f40c9600 con 0x564271e1fc80 2024-05-12T10:57:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11f9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e99be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11f9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e99be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50258/0 (socket says 172.21.15.115:50258) 2024-05-12T10:57:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11f9800640 1 -- 172.21.15.115:0/448798979 learned_addr learned my addr 172.21.15.115:0/448798979 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11f3e00640 1 --2- 172.21.15.115:0/448798979 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.495+0000 7f11f8e00640 1 --2- 172.21.15.115:0/448798979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e99160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11f9800640 1 -- 172.21.15.115:0/448798979 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 msgr2=0x564271e996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11f9800640 1 --2- 172.21.15.115:0/448798979 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11f9800640 1 -- 172.21.15.115:0/448798979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 msgr2=0x564271e99160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11f9800640 1 --2- 172.21.15.115:0/448798979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e99160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11f9800640 1 -- 172.21.15.115:0/448798979 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564271cb3e30 con 0x564271e24a10 2024-05-12T10:57:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11f8e00640 1 --2- 172.21.15.115:0/448798979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e99160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:57:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11f9800640 1 --2- 172.21.15.115:0/448798979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e99be0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00d010 tx=0x7f11ec021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8bc2613ae1e8d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11e4c00640 1 -- 172.21.15.115:0/448798979 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0688f0 con 0x564271e24a10 2024-05-12T10:57:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11e4c00640 1 -- 172.21.15.115:0/448798979 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec06d310 con 0x564271e24a10 2024-05-12T10:57:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11e4c00640 1 -- 172.21.15.115:0/448798979 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0639b0 con 0x564271e24a10 2024-05-12T10:57:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11febe0000 1 -- 172.21.15.115:0/448798979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 msgr2=0x564271e99be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11febe0000 1 --2- 172.21.15.115:0/448798979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e99be0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00d010 tx=0x7f11ec021040 comp rx=0 tx=0).stop 2024-05-12T10:57:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11febe0000 1 -- 172.21.15.115:0/448798979 shutdown_connections 2024-05-12T10:57:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11febe0000 1 --2- 172.21.15.115:0/448798979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e99be0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11febe0000 1 --2- 172.21.15.115:0/448798979 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11febe0000 1 --2- 172.21.15.115:0/448798979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e99160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11febe0000 1 -- 172.21.15.115:0/448798979 >> 172.21.15.115:0/448798979 conn(0x564271ccbf90 msgr2=0x564271de49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11febe0000 1 -- 172.21.15.115:0/448798979 shutdown_connections 2024-05-12T10:57:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11febe0000 1 -- 172.21.15.115:0/448798979 wait complete. 2024-05-12T10:57:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11febe0000 1 -- start start 2024-05-12T10:57:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.499+0000 7f11febe0000 1 Processor -- start 2024-05-12T10:57:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e3e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e3ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e3f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564271bc93e0 con 0x564271e24a10 2024-05-12T10:57:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11f4152cc0 con 0x564271de9df0 2024-05-12T10:57:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x564271c32400 con 0x564271e1fc80 2024-05-12T10:57:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 10 client.0 _ll_register_callbacks cb 0x7f11ec0643a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:57:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e3f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.494 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f9800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e3f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50262/0 (socket says 172.21.15.115:50262) 2024-05-12T10:57:02.494 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f8e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e3e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.494 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f9800640 1 -- 172.21.15.115:0/1000429934 learned_addr learned my addr 172.21.15.115:0/1000429934 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:02.494 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f3e00640 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e3ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f9800640 1 -- 172.21.15.115:0/1000429934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 msgr2=0x564271e3ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f9800640 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e3ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f9800640 1 -- 172.21.15.115:0/1000429934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 msgr2=0x564271e3e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f9800640 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e3e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f9800640 1 -- 172.21.15.115:0/1000429934 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564271bc4d80 con 0x564271e24a10 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f9800640 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e3f290 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f11ec060d00 tx=0x7f11ec009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2967837bf035239d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11da000640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11da000640 1 -- 172.21.15.115:0/1000429934 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec063210 con 0x564271e24a10 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11da000640 1 -- 172.21.15.115:0/1000429934 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f11ec0633b0 con 0x564271e24a10 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 1 -- 172.21.15.115:0/1000429934 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11ec06d310 con 0x564271e24a10 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11da000640 1 -- 172.21.15.115:0/1000429934 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f11ec08e050 con 0x564271e24a10 2024-05-12T10:57:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 10 client.5184 fetch_fsmap learned FSMap version 14 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 1 -- 172.21.15.115:0/1000429934 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x564271bd7f80 con 0x564271e24a10 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11da000640 1 -- 172.21.15.115:0/1000429934 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec06d310 con 0x564271e24a10 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11da000640 1 -- 172.21.15.115:0/1000429934 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f11ec069a80 con 0x564271e24a10 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 10 client.5184 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 10 client.5184 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 20 client.5184 populate_metadata read hostname 'smithi115' 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x564271e3fbf0 0x564271ea51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 4 client.5184 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.5, "await_for": 42.0}] 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11febe0000 1 -- 172.21.15.115:0/1000429934 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.5, "await_for": 42.0}) -- 0x564271c40d00 con 0x564271e3fbf0 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f8e00640 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x564271e3fbf0 0x564271ea51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11f8e00640 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x564271e3fbf0 0x564271ea51e0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69334e94aa0c6894 server_cookie=f24532a2f0edd6c3 in_seq=0 out_seq=0 2024-05-12T10:57:02.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.503+0000 7f11da000640 10 client.5184 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:02.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.531+0000 7f11da000640 1 -- 172.21.15.115:0/1000429934 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x564271c40d00 con 0x564271e3fbf0 2024-05-12T10:57:02.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.531+0000 7f11da000640 10 client.5184 handle_command_reply: tid=0 2024-05-12T10:57:02.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.531+0000 7f11febe0000 1 client.5184 shutdown 2024-05-12T10:57:02.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11febe0000 1 -- 172.21.15.115:0/1000429934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 msgr2=0x564271e3f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11febe0000 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e3f290 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f11ec060d00 tx=0x7f11ec009c20 comp rx=0 tx=0).stop 2024-05-12T10:57:02.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11febe0000 1 -- 172.21.15.115:0/1000429934 shutdown_connections 2024-05-12T10:57:02.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11febe0000 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564271e24a10 0x564271e3f290 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11febe0000 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x564271e1fc80 0x564271e3ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11febe0000 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x564271e3fbf0 0x564271ea51e0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11febe0000 1 --2- 172.21.15.115:0/1000429934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564271de9df0 0x564271e3e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11da000640 0 client.5184 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:02.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11febe0000 1 -- 172.21.15.115:0/1000429934 >> 172.21.15.115:0/1000429934 conn(0x564271ccbf90 msgr2=0x564271e40670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:02.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11febe0000 1 -- 172.21.15.115:0/1000429934 shutdown_connections 2024-05-12T10:57:02.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11febe0000 1 -- 172.21.15.115:0/1000429934 wait complete. 2024-05-12T10:57:02.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11febe0000 20 client.5184 trim_cache size 0 max 16384 2024-05-12T10:57:02.527 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:57:02.527 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:57:02.527 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:57:02.527 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 22, 2024-05-12T10:57:02.527 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:57:02.527 INFO:teuthology.orchestra.run.smithi115.stdout: "f99ce107": { 2024-05-12T10:57:02.527 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 22, 2024-05-12T10:57:02.527 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:57:02.527 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:57:02.527 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 78.5, 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:02.528 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:02.529 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:02.529 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:57:02.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 -- 172.21.15.115:0/3200341907 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f11d406f430 msgr2=0x7f11d40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f11d406f430 0x7f11d40718f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f11e00b2000 tx=0x7f11e0008040 comp rx=0 tx=0).stop 2024-05-12T10:57:02.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 -- 172.21.15.115:0/3200341907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11f4159b40 msgr2=0x7f11f41f24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:02.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11f4159b40 0x7f11f41f24a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009d30 tx=0x7f11ec00c490 comp rx=0 tx=0).stop 2024-05-12T10:57:02.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 -- 172.21.15.115:0/3200341907 shutdown_connections 2024-05-12T10:57:02.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f11d406f430 0x7f11d40718f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11f4159b40 0x7f11f41f24a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4150ba0 0x7f11f414c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 --2- 172.21.15.115:0/3200341907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11f40c9fd0 0x7f11f41f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:02.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 -- 172.21.15.115:0/3200341907 >> 172.21.15.115:0/3200341907 conn(0x7f11f406c610 msgr2=0x7f11f40cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:02.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 -- 172.21.15.115:0/3200341907 shutdown_connections 2024-05-12T10:57:02.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:02.535+0000 7f11fb800640 1 -- 172.21.15.115:0/3200341907 wait complete. 2024-05-12T10:57:02.550 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f99ce107', quiesce took 0.8 seconds. Will release after: 18.5 2024-05-12T10:57:18.516 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:57:18.516 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 readers = 389895.94 kB/sec 2024-05-12T10:57:18.517 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 readers = 389888.82 kB/sec 2024-05-12T10:57:18.517 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 389895.94 kB/sec 2024-05-12T10:57:18.517 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 389895.94 kB/sec 2024-05-12T10:57:18.517 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 389895.94 kB/sec 2024-05-12T10:57:18.517 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 10485760.00 kB 2024-05-12T10:57:21.052 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:57:21.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.207+0000 7f6242e00640 1 Processor -- start 2024-05-12T10:57:21.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.207+0000 7f6242e00640 1 -- start start 2024-05-12T10:57:21.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6242e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f623c153f60 0x7f623c0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6242e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f623c0ca660 0x7f623c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6242e00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623c15da10 con 0x7f623c153b80 2024-05-12T10:57:21.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6242e00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f623c0b2160 con 0x7f623c0ca660 2024-05-12T10:57:21.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6242e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f623c0c4510 con 0x7f623c153f60 2024-05-12T10:57:21.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6241a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f623c153b80 0x7f623c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44438/0 (socket says 172.21.15.115:44438) 2024-05-12T10:57:21.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6242400640 1 --2- 172.21.15.115:0/2262811023 >> v2:172.21.15.115:3300/0 conn(0x7f623c0ca660 0x7f623c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6241a00640 1 -- 172.21.15.115:0/2262811023 learned_addr learned my addr 172.21.15.115:0/2262811023 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:57:21.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6241000640 1 --2- 172.21.15.115:0/2262811023 >> v2:172.21.15.134:3300/0 conn(0x7f623c153f60 0x7f623c0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6242400640 1 -- 172.21.15.115:0/2262811023 >> v2:172.21.15.134:3300/0 conn(0x7f623c153f60 msgr2=0x7f623c0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6242400640 1 --2- 172.21.15.115:0/2262811023 >> v2:172.21.15.134:3300/0 conn(0x7f623c153f60 0x7f623c0c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6242400640 1 -- 172.21.15.115:0/2262811023 >> v1:172.21.15.115:6789/0 conn(0x7f623c153b80 legacy=0x7f623c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.211+0000 7f6242400640 1 -- 172.21.15.115:0/2262811023 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c15dcf0 con 0x7f623c0ca660 2024-05-12T10:57:21.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242400640 1 --2- 172.21.15.115:0/2262811023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f623c0ca660 0x7f623c159e40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f623c072f40 tx=0x7f623401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5440da108a56d74a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:21.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f623be00640 1 -- 172.21.15.115:0/2262811023 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340b4070 con 0x7f623c0ca660 2024-05-12T10:57:21.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f623be00640 1 -- 172.21.15.115:0/2262811023 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62340af600 con 0x7f623c0ca660 2024-05-12T10:57:21.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f623be00640 1 -- 172.21.15.115:0/2262811023 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340af9d0 con 0x7f623c0ca660 2024-05-12T10:57:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 -- 172.21.15.115:0/2262811023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f623c0ca660 msgr2=0x7f623c159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 --2- 172.21.15.115:0/2262811023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f623c0ca660 0x7f623c159e40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f623c072f40 tx=0x7f623401f110 comp rx=0 tx=0).stop 2024-05-12T10:57:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 -- 172.21.15.115:0/2262811023 shutdown_connections 2024-05-12T10:57:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 --2- 172.21.15.115:0/2262811023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f623c0ca660 0x7f623c159e40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 --2- 172.21.15.115:0/2262811023 >> v2:172.21.15.134:3300/0 conn(0x7f623c153f60 0x7f623c0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 -- 172.21.15.115:0/2262811023 >> 172.21.15.115:0/2262811023 conn(0x7f623c071780 msgr2=0x7f623c076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 -- 172.21.15.115:0/2262811023 shutdown_connections 2024-05-12T10:57:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 -- 172.21.15.115:0/2262811023 wait complete. 2024-05-12T10:57:21.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 Processor -- start 2024-05-12T10:57:21.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 -- start start 2024-05-12T10:57:21.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f623c0ca660 0x7f623c06ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.215+0000 7f6242e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f623c153b80 0x7f623c154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f623c153f60 0x7f623c14ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f623c072530 con 0x7f623c153f60 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f623c0c4a40 con 0x7f623c153b80 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f623c0726b0 con 0x7f623c0ca660 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f623c153f60 0x7f623c14ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f623c153f60 0x7f623c14ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48312/0 (socket says 172.21.15.115:48312) 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242400640 1 -- 172.21.15.115:0/3268283785 learned_addr learned my addr 172.21.15.115:0/3268283785 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6241000640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f623c153b80 0x7f623c154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6241a00640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f623c0ca660 0x7f623c06ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242400640 1 -- 172.21.15.115:0/3268283785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f623c0ca660 msgr2=0x7f623c06ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242400640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f623c0ca660 0x7f623c06ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242400640 1 -- 172.21.15.115:0/3268283785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f623c153b80 msgr2=0x7f623c154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242400640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f623c153b80 0x7f623c154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242400640 1 -- 172.21.15.115:0/3268283785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c1f5180 con 0x7f623c153f60 2024-05-12T10:57:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242400640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f623c153f60 0x7f623c14ee20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f623401bd20 tx=0x7f623401beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6239600640 1 -- 172.21.15.115:0/3268283785 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340b4040 con 0x7f623c153f60 2024-05-12T10:57:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6239600640 1 -- 172.21.15.115:0/3268283785 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62340c1070 con 0x7f623c153f60 2024-05-12T10:57:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6239600640 1 -- 172.21.15.115:0/3268283785 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234009450 con 0x7f623c153f60 2024-05-12T10:57:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242e00640 1 -- 172.21.15.115:0/3268283785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623c155df0 con 0x7f623c153f60 2024-05-12T10:57:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242e00640 1 -- 172.21.15.115:0/3268283785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f623c0ce240 con 0x7f623c153f60 2024-05-12T10:57:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6242e00640 1 -- 172.21.15.115:0/3268283785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f623c1f55c0 con 0x7f623c153f60 2024-05-12T10:57:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.219+0000 7f6239600640 1 -- 172.21.15.115:0/3268283785 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f62340ba6b0 con 0x7f623c153f60 2024-05-12T10:57:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.223+0000 7f6239600640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f621c06f430 0x7f621c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.223+0000 7f6239600640 1 -- 172.21.15.115:0/3268283785 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f623412e0e0 con 0x7f623c153f60 2024-05-12T10:57:21.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.223+0000 7f6241a00640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f621c06f430 0x7f621c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.223+0000 7f6241a00640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f621c06f430 0x7f621c0718f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6230007fd0 tx=0x7f6230009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:21.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.227+0000 7f6239600640 1 -- 172.21.15.115:0/3268283785 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f623c155df0 con 0x7f623c153f60 2024-05-12T10:57:21.383 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:57:21.386 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:57:21.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 -- 172.21.15.115:0/3268283785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f623c0720b0 con 0x7f623c153f60 2024-05-12T10:57:21.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6239600640 1 -- 172.21.15.115:0/3268283785 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f6234018c70 con 0x7f623c153f60 2024-05-12T10:57:21.409 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:57:21.410 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:57:21.410 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:57:21.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 -- 172.21.15.115:0/3268283785 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f621c06f430 msgr2=0x7f621c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f621c06f430 0x7f621c0718f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6230007fd0 tx=0x7f6230009040 comp rx=0 tx=0).stop 2024-05-12T10:57:21.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 -- 172.21.15.115:0/3268283785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f623c153f60 msgr2=0x7f623c14ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f623c153f60 0x7f623c14ee20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f623401bd20 tx=0x7f623401beb0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 -- 172.21.15.115:0/3268283785 shutdown_connections 2024-05-12T10:57:21.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f621c06f430 0x7f621c0718f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f623c153f60 0x7f623c14ee20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f623c153b80 0x7f623c154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 --2- 172.21.15.115:0/3268283785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f623c0ca660 0x7f623c06ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 -- 172.21.15.115:0/3268283785 >> 172.21.15.115:0/3268283785 conn(0x7f623c071780 msgr2=0x7f623c0cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:21.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 -- 172.21.15.115:0/3268283785 shutdown_connections 2024-05-12T10:57:21.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.419+0000 7f6242e00640 1 -- 172.21.15.115:0/3268283785 wait complete. 2024-05-12T10:57:21.430 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db --set-id f99ce107 --release --await' 2024-05-12T10:57:21.430 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db --set-id f99ce107 --release --await 2024-05-12T10:57:21.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.631+0000 7f124f200640 1 Processor -- start 2024-05-12T10:57:21.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.631+0000 7f124f200640 1 -- start start 2024-05-12T10:57:21.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.631+0000 7f124f200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1250153ae0 0x7f12500c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.631+0000 7f124f200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12500c5260 con 0x7f125015d620 2024-05-12T10:57:21.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.631+0000 7f124f200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12500c4af0 con 0x7f12500c7390 2024-05-12T10:57:21.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.631+0000 7f124f200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f12500c5500 con 0x7f1250153ae0 2024-05-12T10:57:21.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.631+0000 7f124e800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f125015d620 0x7f1250164210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44450/0 (socket says 172.21.15.115:44450) 2024-05-12T10:57:21.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.631+0000 7f124e800640 1 -- 172.21.15.115:0/3660856678 learned_addr learned my addr 172.21.15.115:0/3660856678 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:57:21.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.631+0000 7f124de00640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1250153ae0 0x7f12500c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793182723 0 0) 0x7f12500c5260 con 0x7f125015d620 2024-05-12T10:57:21.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1234003530 con 0x7f125015d620 2024-05-12T10:57:21.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3573466073 0 0) 0x7f12500c4af0 con 0x7f12500c7390 2024-05-12T10:57:21.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12500c5260 con 0x7f12500c7390 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3735855011 0 0) 0x7f1234003530 con 0x7f125015d620 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1250153ae0 msgr2=0x7f12500c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1250153ae0 0x7f12500c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 >> v1:172.21.15.134:6789/0 conn(0x7f12500c7390 legacy=0x7f125015cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12500c57e0 con 0x7f125015d620 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f1248001aa0 con 0x7f125015d620 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 >> v1:172.21.15.115:6789/0 conn(0x7f125015d620 legacy=0x7f1250164210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1234003c70 0x7f1234004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1234004810 0x7f1234004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1250153ae0 0x7f1234005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f12500c5500 con 0x7f1234004810 2024-05-12T10:57:21.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f123400bb90 con 0x7f1234003c70 2024-05-12T10:57:21.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f123400bd90 con 0x7f1250153ae0 2024-05-12T10:57:21.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124d400640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1234004810 0x7f1234004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124de00640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1234003c70 0x7f1234004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124e800640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1250153ae0 0x7f1234005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124d400640 1 -- 172.21.15.115:0/3660856678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1250153ae0 msgr2=0x7f1234005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124d400640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1250153ae0 0x7f1234005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124d400640 1 -- 172.21.15.115:0/3660856678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1234003c70 msgr2=0x7f1234004070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124d400640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1234003c70 0x7f1234004070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.635+0000 7f124d400640 1 -- 172.21.15.115:0/3660856678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1234003530 con 0x7f1234004810 2024-05-12T10:57:21.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124d400640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1234004810 0x7f1234004c90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f123c001930 tx=0x7f123c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e9a8c6f4eafeb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:21.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c001550 con 0x7f1234004810 2024-05-12T10:57:21.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f123c0052d0 con 0x7f1234004810 2024-05-12T10:57:21.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124ca00640 1 -- 172.21.15.115:0/3660856678 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c007260 con 0x7f1234004810 2024-05-12T10:57:21.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 -- 172.21.15.115:0/3660856678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1234004810 msgr2=0x7f1234004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 --2- 172.21.15.115:0/3660856678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1234004810 0x7f1234004c90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f123c001930 tx=0x7f123c01c520 comp rx=0 tx=0).stop 2024-05-12T10:57:21.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124e800640 1 -- 172.21.15.115:0/3660856678 reap_dead start 2024-05-12T10:57:21.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 -- 172.21.15.115:0/3660856678 shutdown_connections 2024-05-12T10:57:21.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 -- 172.21.15.115:0/3660856678 >> 172.21.15.115:0/3660856678 conn(0x7f125006e610 msgr2=0x7f12500681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:21.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 -- 172.21.15.115:0/3660856678 shutdown_connections 2024-05-12T10:57:21.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 -- 172.21.15.115:0/3660856678 wait complete. 2024-05-12T10:57:21.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 Processor -- start 2024-05-12T10:57:21.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 -- start start 2024-05-12T10:57:21.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1234004810 0x7f12501420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12501431e0 0x7f1250141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250143640 0x7f1250141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f12500c47b0 con 0x7f12501431e0 2024-05-12T10:57:21.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12500c4dd0 con 0x7f1250143640 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124f200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1250153ec0 con 0x7f1234004810 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124d400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12501431e0 0x7f1250141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124d400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12501431e0 0x7f1250141000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48322/0 (socket says 172.21.15.115:48322) 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124d400640 1 -- 172.21.15.115:0/1385527316 learned_addr learned my addr 172.21.15.115:0/1385527316 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.639+0000 7f124de00640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1234004810 0x7f12501420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f124e800640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250143640 0x7f1250141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f124d400640 1 -- 172.21.15.115:0/1385527316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1234004810 msgr2=0x7f12501420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f124d400640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1234004810 0x7f12501420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f124d400640 1 -- 172.21.15.115:0/1385527316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250143640 msgr2=0x7f1250141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f124d400640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250143640 0x7f1250141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f124d400640 1 -- 172.21.15.115:0/1385527316 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125015abf0 con 0x7f12501431e0 2024-05-12T10:57:21.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f124d400640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12501431e0 0x7f1250141000 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f123c005040 tx=0x7f1234005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:21.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f1246000640 1 -- 172.21.15.115:0/1385527316 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c007a20 con 0x7f12501431e0 2024-05-12T10:57:21.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f1246000640 1 -- 172.21.15.115:0/1385527316 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f123c0bc070 con 0x7f12501431e0 2024-05-12T10:57:21.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f1246000640 1 -- 172.21.15.115:0/1385527316 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c005480 con 0x7f12501431e0 2024-05-12T10:57:21.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f124f200640 1 -- 172.21.15.115:0/1385527316 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12501e58b0 con 0x7f12501431e0 2024-05-12T10:57:21.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f124f200640 1 -- 172.21.15.115:0/1385527316 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f125015b170 con 0x7f12501431e0 2024-05-12T10:57:21.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.643+0000 7f1246000640 1 -- 172.21.15.115:0/1385527316 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f123c0b3040 con 0x7f12501431e0 2024-05-12T10:57:21.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f1246000640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f123006f430 0x7f12300718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f1246000640 1 -- 172.21.15.115:0/1385527316 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f123c129a80 con 0x7f12501431e0 2024-05-12T10:57:21.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f125808c000 1 Processor -- start 2024-05-12T10:57:21.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124de00640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f123006f430 0x7f12300718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f125808c000 1 -- start start 2024-05-12T10:57:21.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124de00640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f123006f430 0x7f12300718f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1240009b00 tx=0x7f1240009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f125808c000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7419ff600 0x55a7419ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f125808c000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a01650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f125808c000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a01f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f125808c000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a7418c0a60 con 0x55a741a01b90 2024-05-12T10:57:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f125808c000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a741829250 con 0x55a7419ff600 2024-05-12T10:57:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f125808c000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55a7417cd4d0 con 0x55a741a01270 2024-05-12T10:57:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124e800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a01f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124e800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a01f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48332/0 (socket says 172.21.15.115:48332) 2024-05-12T10:57:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124e800640 1 -- 172.21.15.115:0/579395731 learned_addr learned my addr 172.21.15.115:0/579395731 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124d400640 1 --2- 172.21.15.115:0/579395731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a01650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124de00640 1 --2- 172.21.15.115:0/579395731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7419ff600 0x55a7419ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124e800640 1 -- 172.21.15.115:0/579395731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 msgr2=0x55a741a01650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124e800640 1 --2- 172.21.15.115:0/579395731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a01650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124e800640 1 -- 172.21.15.115:0/579395731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7419ff600 msgr2=0x55a7419ff9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124e800640 1 --2- 172.21.15.115:0/579395731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7419ff600 0x55a7419ff9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124e800640 1 -- 172.21.15.115:0/579395731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a741800970 con 0x55a741a01b90 2024-05-12T10:57:21.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f124e800640 1 --2- 172.21.15.115:0/579395731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a01f70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f12500c87f0 tx=0x7f124800aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cf89ecc194ed31 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:21.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f123aa00640 1 -- 172.21.15.115:0/579395731 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248010040 con 0x55a741a01b90 2024-05-12T10:57:21.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f123aa00640 1 -- 172.21.15.115:0/579395731 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1248007500 con 0x55a741a01b90 2024-05-12T10:57:21.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.647+0000 7f123aa00640 1 -- 172.21.15.115:0/579395731 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12480078b0 con 0x55a741a01b90 2024-05-12T10:57:21.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 -- 172.21.15.115:0/579395731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 msgr2=0x55a741a01f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 --2- 172.21.15.115:0/579395731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a01f70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f12500c87f0 tx=0x7f124800aa80 comp rx=0 tx=0).stop 2024-05-12T10:57:21.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 -- 172.21.15.115:0/579395731 shutdown_connections 2024-05-12T10:57:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 --2- 172.21.15.115:0/579395731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a01f70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 --2- 172.21.15.115:0/579395731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a01650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 --2- 172.21.15.115:0/579395731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7419ff600 0x55a7419ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 -- 172.21.15.115:0/579395731 >> 172.21.15.115:0/579395731 conn(0x55a741a16430 msgr2=0x55a741a18820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 -- 172.21.15.115:0/579395731 shutdown_connections 2024-05-12T10:57:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 -- 172.21.15.115:0/579395731 wait complete. 2024-05-12T10:57:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 -- start start 2024-05-12T10:57:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 Processor -- start 2024-05-12T10:57:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7419ff600 0x55a7419de820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a208f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a20e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a741825210 con 0x55a741a01b90 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a741836650 con 0x55a7419ff600 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55a7418675b0 con 0x55a741a01270 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 10 client.0 _ll_register_callbacks cb 0x55a7419c3f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f124e800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a20e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f124e800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a20e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48346/0 (socket says 172.21.15.115:48346) 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f124e800640 1 -- 172.21.15.115:0/429999039 learned_addr learned my addr 172.21.15.115:0/429999039 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f124de00640 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7419ff600 0x55a7419de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f124d400640 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f124e800640 1 -- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 msgr2=0x55a741a208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f124e800640 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f124e800640 1 -- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7419ff600 msgr2=0x55a7419de820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f124e800640 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7419ff600 0x55a7419de820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f124e800640 1 -- 172.21.15.115:0/429999039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a74186d0e0 con 0x55a741a01b90 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f124e800640 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a20e30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f124800aac0 tx=0x7f1250159890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c61a468ab800a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f122f400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f122f400640 1 -- 172.21.15.115:0/429999039 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248017460 con 0x55a741a01b90 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f122f400640 1 -- 172.21.15.115:0/429999039 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f1248017600 con 0x55a741a01b90 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 -- 172.21.15.115:0/429999039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1248007500 con 0x55a741a01b90 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f122f400640 1 -- 172.21.15.115:0/429999039 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f1248034050 con 0x55a741a01b90 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 10 client.5205 fetch_fsmap learned FSMap version 14 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 1 -- 172.21.15.115:0/429999039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55a7417db9e0 con 0x55a741a01b90 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f122f400640 1 -- 172.21.15.115:0/429999039 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1248007500 con 0x55a741a01b90 2024-05-12T10:57:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f122f400640 1 -- 172.21.15.115:0/429999039 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f1248037020 con 0x55a741a01b90 2024-05-12T10:57:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 10 client.5205 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:57:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 10 client.5205 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:57:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.651+0000 7f125808c000 20 client.5205 populate_metadata read hostname 'smithi115' 2024-05-12T10:57:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a7419feac0 0x55a7419feea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 4 client.5205 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:57:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 -- 172.21.15.115:0/429999039 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7417c2060 con 0x55a7419feac0 2024-05-12T10:57:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f124de00640 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a7419feac0 0x55a7419feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f124de00640 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a7419feac0 0x55a7419feea0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c28e45a10acb033 server_cookie=fb99b538e22e61b1 in_seq=0 out_seq=0 2024-05-12T10:57:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f122f400640 10 client.5205 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:21.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f122f400640 1 -- 172.21.15.115:0/429999039 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a7417c2060 con 0x55a7419feac0 2024-05-12T10:57:21.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f122f400640 10 client.5205 handle_command_reply: tid=0 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 client.5205 shutdown 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 -- 172.21.15.115:0/429999039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 msgr2=0x55a741a20e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a20e30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f124800aac0 tx=0x7f1250159890 comp rx=0 tx=0).stop 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 -- 172.21.15.115:0/429999039 shutdown_connections 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01b90 0x55a741a20e30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a7419feac0 0x55a7419feea0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 --2- 172.21.15.115:0/429999039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7419ff600 0x55a7419de820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 -- 172.21.15.115:0/429999039 >> 172.21.15.115:0/429999039 conn(0x55a741a16430 msgr2=0x55a741a18820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f122f400640 0 client.5205 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 -- 172.21.15.115:0/429999039 shutdown_connections 2024-05-12T10:57:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 1 -- 172.21.15.115:0/429999039 wait complete. 2024-05-12T10:57:21.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.655+0000 7f125808c000 20 client.5205 trim_cache size 0 max 16384 2024-05-12T10:57:21.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 Processor -- start 2024-05-12T10:57:21.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 -- start start 2024-05-12T10:57:21.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a7419ff600 0x55a741a2bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a2c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a741a01b90 0x55a741a14000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f12501fee50 con 0x55a7419ff600 2024-05-12T10:57:21.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1250073e30 con 0x55a741a01b90 2024-05-12T10:57:21.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f12501fe7a0 con 0x55a741a01270 2024-05-12T10:57:21.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124de00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a7419ff600 0x55a741a2bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124de00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a7419ff600 0x55a741a2bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48360/0 (socket says 172.21.15.115:48360) 2024-05-12T10:57:21.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124de00640 1 -- 172.21.15.115:0/626864856 learned_addr learned my addr 172.21.15.115:0/626864856 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:21.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124e800640 1 --2- 172.21.15.115:0/626864856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a741a01b90 0x55a741a14000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124d400640 1 --2- 172.21.15.115:0/626864856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a2c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124de00640 1 -- 172.21.15.115:0/626864856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 msgr2=0x55a741a2c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124de00640 1 --2- 172.21.15.115:0/626864856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a2c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124de00640 1 -- 172.21.15.115:0/626864856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a741a01b90 msgr2=0x55a741a14000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124de00640 1 --2- 172.21.15.115:0/626864856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a741a01b90 0x55a741a14000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124de00640 1 -- 172.21.15.115:0/626864856 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7417cd6e0 con 0x55a7419ff600 2024-05-12T10:57:21.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124d400640 1 --2- 172.21.15.115:0/626864856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a2c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:57:21.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f124de00640 1 --2- 172.21.15.115:0/626864856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a7419ff600 0x55a741a2bfe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1240004410 tx=0x7f1240017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ea211e3ca5c43 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:21.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f123a000640 1 -- 172.21.15.115:0/626864856 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240034070 con 0x55a7419ff600 2024-05-12T10:57:21.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f123a000640 1 -- 172.21.15.115:0/626864856 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1240004440 con 0x55a7419ff600 2024-05-12T10:57:21.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f123a000640 1 -- 172.21.15.115:0/626864856 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124001b070 con 0x55a7419ff600 2024-05-12T10:57:21.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 -- 172.21.15.115:0/626864856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a7419ff600 msgr2=0x55a741a2bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 --2- 172.21.15.115:0/626864856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a7419ff600 0x55a741a2bfe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1240004410 tx=0x7f1240017000 comp rx=0 tx=0).stop 2024-05-12T10:57:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 -- 172.21.15.115:0/626864856 shutdown_connections 2024-05-12T10:57:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 --2- 172.21.15.115:0/626864856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a741a01b90 0x55a741a14000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 --2- 172.21.15.115:0/626864856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a741a01270 0x55a741a2c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 --2- 172.21.15.115:0/626864856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a7419ff600 0x55a741a2bfe0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 -- 172.21.15.115:0/626864856 >> 172.21.15.115:0/626864856 conn(0x55a741a16430 msgr2=0x55a741a00a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 -- 172.21.15.115:0/626864856 shutdown_connections 2024-05-12T10:57:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 -- 172.21.15.115:0/626864856 wait complete. 2024-05-12T10:57:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.675+0000 7f125808c000 1 -- start start 2024-05-12T10:57:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 1 Processor -- start 2024-05-12T10:57:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a7419ff600 0x55a7419dd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01270 0x55a741a8e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a741a01b90 0x55a741a8e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a7417bec50 con 0x55a741a01270 2024-05-12T10:57:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a741821d70 con 0x55a741a01b90 2024-05-12T10:57:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55a741828560 con 0x55a7419ff600 2024-05-12T10:57:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 10 client.0 _ll_register_callbacks cb 0x7f1240009770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:57:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124d400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01270 0x55a741a8e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124d400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01270 0x55a741a8e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48368/0 (socket says 172.21.15.115:48368) 2024-05-12T10:57:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124d400640 1 -- 172.21.15.115:0/4203246349 learned_addr learned my addr 172.21.15.115:0/4203246349 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124de00640 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a7419ff600 0x55a7419dd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124e800640 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a741a01b90 0x55a741a8e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124d400640 1 -- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a7419ff600 msgr2=0x55a7419dd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124d400640 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a7419ff600 0x55a7419dd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124d400640 1 -- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a741a01b90 msgr2=0x55a741a8e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124d400640 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a741a01b90 0x55a741a8e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124d400640 1 -- 172.21.15.115:0/4203246349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7418802a0 con 0x55a741a01270 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124d400640 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01270 0x55a741a8e000 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f123c01ca90 tx=0x7f123c0f6400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d952e7b4411f99 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f122f400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f122f400640 1 -- 172.21.15.115:0/4203246349 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c0f5970 con 0x55a741a01270 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f122f400640 1 -- 172.21.15.115:0/4203246349 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f123c0f52d0 con 0x55a741a01270 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 1 -- 172.21.15.115:0/4203246349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1240004440 con 0x55a741a01270 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f122f400640 1 -- 172.21.15.115:0/4203246349 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f123c116050 con 0x55a741a01270 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 10 client.5211 fetch_fsmap learned FSMap version 14 2024-05-12T10:57:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 1 -- 172.21.15.115:0/4203246349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55a7417bd9c0 con 0x55a741a01270 2024-05-12T10:57:21.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f122f400640 1 -- 172.21.15.115:0/4203246349 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1240004440 con 0x55a741a01270 2024-05-12T10:57:21.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f122f400640 1 -- 172.21.15.115:0/4203246349 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f123c0fc410 con 0x55a741a01270 2024-05-12T10:57:21.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 10 client.5211 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:57:21.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 10 client.5211 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:57:21.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 20 client.5211 populate_metadata read hostname 'smithi115' 2024-05-12T10:57:21.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a741a8ea80 0x55a741a8ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:21.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 4 client.5211 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f99ce107", "release": true, "await": true}] 2024-05-12T10:57:21.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f125808c000 1 -- 172.21.15.115:0/4203246349 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f99ce107", "release": true, "await": true}) -- 0x55a741836e60 con 0x55a741a8ea80 2024-05-12T10:57:21.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124de00640 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a741a8ea80 0x55a741a8ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:21.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f124de00640 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a741a8ea80 0x55a741a8ee60 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=557c3e0949aa2988 server_cookie=19483902440d1dcf in_seq=0 out_seq=0 2024-05-12T10:57:21.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.679+0000 7f122f400640 10 client.5211 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:21.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f122f400640 1 -- 172.21.15.115:0/4203246349 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a741836e60 con 0x55a741a8ea80 2024-05-12T10:57:21.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f122f400640 10 client.5211 handle_command_reply: tid=0 2024-05-12T10:57:21.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 1 client.5211 shutdown 2024-05-12T10:57:21.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 1 -- 172.21.15.115:0/4203246349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01270 msgr2=0x55a741a8e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01270 0x55a741a8e000 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f123c01ca90 tx=0x7f123c0f6400 comp rx=0 tx=0).stop 2024-05-12T10:57:21.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 1 -- 172.21.15.115:0/4203246349 shutdown_connections 2024-05-12T10:57:21.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a741a8ea80 0x55a741a8ee60 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a741a01b90 0x55a741a8e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f122f400640 0 client.5211 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:21.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a741a01270 0x55a741a8e000 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 1 --2- 172.21.15.115:0/4203246349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a7419ff600 0x55a7419dd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 1 -- 172.21.15.115:0/4203246349 >> 172.21.15.115:0/4203246349 conn(0x55a741a16430 msgr2=0x55a741a35b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:21.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 1 -- 172.21.15.115:0/4203246349 shutdown_connections 2024-05-12T10:57:21.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 1 -- 172.21.15.115:0/4203246349 wait complete. 2024-05-12T10:57:21.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f125808c000 20 client.5211 trim_cache size 0 max 16384 2024-05-12T10:57:21.679 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:57:21.679 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:57:21.679 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:57:21.679 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 24, 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: "f99ce107": { 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 24, 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 78.5, 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:57:21.680 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:57:21.681 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:57:21.681 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:57:21.681 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:57:21.681 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:57:21.681 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:21.681 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:21.681 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:21.681 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:21.681 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:21.681 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:57:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 -- 172.21.15.115:0/1385527316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f123006f430 msgr2=0x7f12300718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f123006f430 0x7f12300718f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1240009b00 tx=0x7f1240009190 comp rx=0 tx=0).stop 2024-05-12T10:57:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 -- 172.21.15.115:0/1385527316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12501431e0 msgr2=0x7f1250141000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12501431e0 0x7f1250141000 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f123c005040 tx=0x7f1234005840 comp rx=0 tx=0).stop 2024-05-12T10:57:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 -- 172.21.15.115:0/1385527316 shutdown_connections 2024-05-12T10:57:21.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f123006f430 0x7f12300718f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250143640 0x7f1250141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12501431e0 0x7f1250141000 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 --2- 172.21.15.115:0/1385527316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1234004810 0x7f12501420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:21.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 -- 172.21.15.115:0/1385527316 >> 172.21.15.115:0/1385527316 conn(0x7f125006e610 msgr2=0x7f1250152b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:21.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 -- 172.21.15.115:0/1385527316 shutdown_connections 2024-05-12T10:57:21.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:21.683+0000 7f124f200640 1 -- 172.21.15.115:0/1385527316 wait complete. 2024-05-12T10:57:21.694 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f99ce107', seconds elapsed: 19.9 2024-05-12T10:57:48.535 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:57:48.535 INFO:tasks.workunit.client.0.smithi115.stdout: Children see throughput for 1 re-readers = 396283.16 kB/sec 2024-05-12T10:57:48.535 INFO:tasks.workunit.client.0.smithi115.stdout: Parent sees throughput for 1 re-readers = 396274.98 kB/sec 2024-05-12T10:57:48.535 INFO:tasks.workunit.client.0.smithi115.stdout: Min throughput per process = 396283.16 kB/sec 2024-05-12T10:57:48.535 INFO:tasks.workunit.client.0.smithi115.stdout: Max throughput per process = 396283.16 kB/sec 2024-05-12T10:57:48.536 INFO:tasks.workunit.client.0.smithi115.stdout: Avg throughput per process = 396283.16 kB/sec 2024-05-12T10:57:48.536 INFO:tasks.workunit.client.0.smithi115.stdout: Min xfer = 10485760.00 kB 2024-05-12T10:57:51.514 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:57:51.517 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:57:56.051 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.3 2024-05-12T10:57:56.052 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:57:56.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.195+0000 7f6df7c00640 1 Processor -- start 2024-05-12T10:57:56.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.195+0000 7f6df7c00640 1 -- start start 2024-05-12T10:57:56.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.199+0000 7f6df7c00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6df00cb7d0 0x7f6df015f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.199+0000 7f6df7c00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df015bfe0 con 0x7f6df0071140 2024-05-12T10:57:56.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.199+0000 7f6df7c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df015c2c0 con 0x7f6df0155c00 2024-05-12T10:57:56.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.199+0000 7f6df7c00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f6df015cb60 con 0x7f6df00cb7d0 2024-05-12T10:57:56.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.199+0000 7f6de7e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6df00cb7d0 0x7f6df015f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.199+0000 7f6de7e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6df00cb7d0 0x7f6df015f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44700/0 (socket says 172.21.15.115:44700) 2024-05-12T10:57:56.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.199+0000 7f6de7e00640 1 -- 172.21.15.115:0/3585498142 learned_addr learned my addr 172.21.15.115:0/3585498142 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:56.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.199+0000 7f6de7e00640 1 -- 172.21.15.115:0/3585498142 >> v1:172.21.15.134:6789/0 conn(0x7f6df0155c00 legacy=0x7f6df0073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.199+0000 7f6de7e00640 1 -- 172.21.15.115:0/3585498142 >> v1:172.21.15.115:6789/0 conn(0x7f6df0071140 legacy=0x7f6df0166520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.199+0000 7f6de7e00640 1 -- 172.21.15.115:0/3585498142 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df015c5a0 con 0x7f6df00cb7d0 2024-05-12T10:57:56.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6de7e00640 1 --2- 172.21.15.115:0/3585498142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df00cb7d0 0x7f6df015f7e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6df015cce0 tx=0x7f6dd801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c633a723b983dd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:56.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6defe00640 1 -- 172.21.15.115:0/3585498142 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80b0070 con 0x7f6df00cb7d0 2024-05-12T10:57:56.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6defe00640 1 -- 172.21.15.115:0/3585498142 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd80ab600 con 0x7f6df00cb7d0 2024-05-12T10:57:56.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6defe00640 1 -- 172.21.15.115:0/3585498142 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80ab9d0 con 0x7f6df00cb7d0 2024-05-12T10:57:56.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6df7c00640 1 -- 172.21.15.115:0/3585498142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df00cb7d0 msgr2=0x7f6df015f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6df7c00640 1 --2- 172.21.15.115:0/3585498142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df00cb7d0 0x7f6df015f7e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6df015cce0 tx=0x7f6dd801c4b0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6df7c00640 1 -- 172.21.15.115:0/3585498142 shutdown_connections 2024-05-12T10:57:56.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6df7c00640 1 --2- 172.21.15.115:0/3585498142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df00cb7d0 0x7f6df015f7e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6df7c00640 1 -- 172.21.15.115:0/3585498142 >> 172.21.15.115:0/3585498142 conn(0x7f6df00681c0 msgr2=0x7f6df00685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:56.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6df7c00640 1 -- 172.21.15.115:0/3585498142 shutdown_connections 2024-05-12T10:57:56.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6df7c00640 1 -- 172.21.15.115:0/3585498142 wait complete. 2024-05-12T10:57:56.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6df7c00640 1 Processor -- start 2024-05-12T10:57:56.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.203+0000 7f6df7c00640 1 -- start start 2024-05-12T10:57:56.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6df7c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df0071140 0x7f6df0153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6df7c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df00cb7d0 0x7f6df0156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6df7c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0155c00 0x7f6df0157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6df7c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6df0074700 con 0x7f6df00cb7d0 2024-05-12T10:57:56.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6df7c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6df0074580 con 0x7f6df0071140 2024-05-12T10:57:56.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6df7c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6df015bba0 con 0x7f6df0155c00 2024-05-12T10:57:56.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6de7e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df00cb7d0 0x7f6df0156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6de7e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df00cb7d0 0x7f6df0156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44702/0 (socket says 172.21.15.115:44702) 2024-05-12T10:57:56.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6de7e00640 1 -- 172.21.15.115:0/280106963 learned_addr learned my addr 172.21.15.115:0/280106963 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:56.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6df5200640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df0071140 0x7f6df0153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6df5c00640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0155c00 0x7f6df0157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6de7e00640 1 -- 172.21.15.115:0/280106963 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0155c00 msgr2=0x7f6df0157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6de7e00640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0155c00 0x7f6df0157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6de7e00640 1 -- 172.21.15.115:0/280106963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df0071140 msgr2=0x7f6df0153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6de7e00640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df0071140 0x7f6df0153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6de7e00640 1 -- 172.21.15.115:0/280106963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df0153140 con 0x7f6df00cb7d0 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6de7e00640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df00cb7d0 0x7f6df0156d20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80ae040 tx=0x7f6dd8019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6ded600640 1 -- 172.21.15.115:0/280106963 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80b0040 con 0x7f6df00cb7d0 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6ded600640 1 -- 172.21.15.115:0/280106963 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd80b4640 con 0x7f6df00cb7d0 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6ded600640 1 -- 172.21.15.115:0/280106963 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80b4a30 con 0x7f6df00cb7d0 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6df7c00640 1 -- 172.21.15.115:0/280106963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df01533e0 con 0x7f6df00cb7d0 2024-05-12T10:57:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6df7c00640 1 -- 172.21.15.115:0/280106963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df0153680 con 0x7f6df00cb7d0 2024-05-12T10:57:56.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6df7c00640 1 -- 172.21.15.115:0/280106963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df0069730 con 0x7f6df00cb7d0 2024-05-12T10:57:56.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.207+0000 7f6ded600640 1 -- 172.21.15.115:0/280106963 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6dd80ab4c0 con 0x7f6df00cb7d0 2024-05-12T10:57:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.211+0000 7f6ded600640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6dcc06f400 0x7f6dcc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.211+0000 7f6ded600640 1 -- 172.21.15.115:0/280106963 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f6dd8129210 con 0x7f6df00cb7d0 2024-05-12T10:57:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.211+0000 7f6df5200640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6dcc06f400 0x7f6dcc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.211+0000 7f6df5200640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6dcc06f400 0x7f6dcc0718c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6de0001650 tx=0x7f6de0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.215+0000 7f6ded600640 1 -- 172.21.15.115:0/280106963 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6dd8016130 con 0x7f6df00cb7d0 2024-05-12T10:57:56.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.403+0000 7f6df7c00640 1 -- 172.21.15.115:0/280106963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6df00c5bb0 con 0x7f6df00cb7d0 2024-05-12T10:57:56.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.403+0000 7f6ded600640 1 -- 172.21.15.115:0/280106963 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f6dd80f5d80 con 0x7f6df00cb7d0 2024-05-12T10:57:56.394 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:57:56.394 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:57:56.394 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:57:56.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 -- 172.21.15.115:0/280106963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6dcc06f400 msgr2=0x7f6dcc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6dcc06f400 0x7f6dcc0718c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6de0001650 tx=0x7f6de0009040 comp rx=0 tx=0).stop 2024-05-12T10:57:56.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 -- 172.21.15.115:0/280106963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df00cb7d0 msgr2=0x7f6df0156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df00cb7d0 0x7f6df0156d20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80ae040 tx=0x7f6dd8019250 comp rx=0 tx=0).stop 2024-05-12T10:57:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 -- 172.21.15.115:0/280106963 shutdown_connections 2024-05-12T10:57:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6dcc06f400 0x7f6dcc0718c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0155c00 0x7f6df0157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df00cb7d0 0x7f6df0156d20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 --2- 172.21.15.115:0/280106963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df0071140 0x7f6df0153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 -- 172.21.15.115:0/280106963 >> 172.21.15.115:0/280106963 conn(0x7f6df00681c0 msgr2=0x7f6df0152500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 -- 172.21.15.115:0/280106963 shutdown_connections 2024-05-12T10:57:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.407+0000 7f6df7c00640 1 -- 172.21.15.115:0/280106963 wait complete. 2024-05-12T10:57:56.416 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db / --timeout 60 --expiration 89.3 --await-for 42.0' 2024-05-12T10:57:56.416 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db / --timeout 60 --expiration 89.3 --await-for 42.0 2024-05-12T10:57:56.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.571+0000 7fee5da00640 1 Processor -- start 2024-05-12T10:57:56.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.571+0000 7fee5da00640 1 -- start start 2024-05-12T10:57:56.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee5da00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee5806f3f0 0x7fee5815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee5da00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee58070600 con 0x7fee5806d550 2024-05-12T10:57:56.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee5da00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee580708a0 con 0x7fee58152ab0 2024-05-12T10:57:56.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee5da00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fee580cae60 con 0x7fee5806f3f0 2024-05-12T10:57:56.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee57400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fee5806d550 0x7fee58166490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33262/0 (socket says 172.21.15.115:33262) 2024-05-12T10:57:56.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee57400640 1 -- 172.21.15.115:0/897107866 learned_addr learned my addr 172.21.15.115:0/897107866 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:57:56.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee56000640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee5806f3f0 0x7fee5815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2232392971 0 0) 0x7fee58070600 con 0x7fee5806d550 2024-05-12T10:57:56.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee3c003530 con 0x7fee5806d550 2024-05-12T10:57:56.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3425476055 0 0) 0x7fee3c003530 con 0x7fee5806d550 2024-05-12T10:57:56.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee5806f3f0 msgr2=0x7fee5815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:56.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee5806f3f0 0x7fee5815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 >> v1:172.21.15.134:6789/0 conn(0x7fee58152ab0 legacy=0x7fee580c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee58070b60 con 0x7fee5806d550 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fee50001700 con 0x7fee5806d550 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 >> v1:172.21.15.115:6789/0 conn(0x7fee5806d550 legacy=0x7fee58166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3c0039f0 0x7fee3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c004810 0x7fee3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee5806f3f0 0x7fee3c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fee580cae60 con 0x7fee3c0039f0 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c00ba80 con 0x7fee3c004810 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fee3c00bc80 con 0x7fee5806f3f0 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee56a00640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3c0039f0 0x7fee3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee56000640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c004810 0x7fee3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee57400640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee5806f3f0 0x7fee3c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee56a00640 1 -- 172.21.15.115:0/897107866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee5806f3f0 msgr2=0x7fee3c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee56a00640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee5806f3f0 0x7fee3c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee56a00640 1 -- 172.21.15.115:0/897107866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c004810 msgr2=0x7fee3c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:56.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee56a00640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c004810 0x7fee3c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.575+0000 7fee56a00640 1 -- 172.21.15.115:0/897107866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3c003530 con 0x7fee3c0039f0 2024-05-12T10:57:56.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee56a00640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3c0039f0 0x7fee3c003dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fee48007fd0 tx=0x7fee4801eff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d0f8d473bf50d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:56.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480b5070 con 0x7fee3c0039f0 2024-05-12T10:57:56.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee480a8c30 con 0x7fee3c0039f0 2024-05-12T10:57:56.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee55600640 1 -- 172.21.15.115:0/897107866 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48001be0 con 0x7fee3c0039f0 2024-05-12T10:57:56.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee5da00640 1 -- 172.21.15.115:0/897107866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3c0039f0 msgr2=0x7fee3c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee5da00640 1 --2- 172.21.15.115:0/897107866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3c0039f0 0x7fee3c003dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fee48007fd0 tx=0x7fee4801eff0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee57400640 1 -- 172.21.15.115:0/897107866 reap_dead start 2024-05-12T10:57:56.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee5da00640 1 -- 172.21.15.115:0/897107866 shutdown_connections 2024-05-12T10:57:56.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee5da00640 1 -- 172.21.15.115:0/897107866 >> 172.21.15.115:0/897107866 conn(0x7fee58076830 msgr2=0x7fee5806c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:56.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee5da00640 1 -- 172.21.15.115:0/897107866 shutdown_connections 2024-05-12T10:57:56.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee5da00640 1 -- 172.21.15.115:0/897107866 wait complete. 2024-05-12T10:57:56.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee5da00640 1 Processor -- start 2024-05-12T10:57:56.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.579+0000 7fee5da00640 1 -- start start 2024-05-12T10:57:56.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee5da00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee3c0039f0 0x7fee58158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee5da00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee5815caf0 0x7fee5815e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee5da00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee58158530 0x7fee58156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee5da00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fee580cfd90 con 0x7fee58158530 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee5da00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee580caaf0 con 0x7fee5815caf0 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee5da00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fee580cb2f0 con 0x7fee3c0039f0 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee57400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee58158530 0x7fee58156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee57400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee58158530 0x7fee58156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44728/0 (socket says 172.21.15.115:44728) 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee57400640 1 -- 172.21.15.115:0/2647725090 learned_addr learned my addr 172.21.15.115:0/2647725090 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee56a00640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee3c0039f0 0x7fee58158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee56000640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee5815caf0 0x7fee5815e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee57400640 1 -- 172.21.15.115:0/2647725090 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee3c0039f0 msgr2=0x7fee58158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee57400640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee3c0039f0 0x7fee58158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee57400640 1 -- 172.21.15.115:0/2647725090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee5815caf0 msgr2=0x7fee5815e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee57400640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee5815caf0 0x7fee5815e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee57400640 1 -- 172.21.15.115:0/2647725090 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee58155f70 con 0x7fee58158530 2024-05-12T10:57:56.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee56a00640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee3c0039f0 0x7fee58158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:57:56.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee57400640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee58158530 0x7fee58156530 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fee580ccfa0 tx=0x7fee5000e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:56.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee4ea00640 1 -- 172.21.15.115:0/2647725090 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50012590 con 0x7fee58158530 2024-05-12T10:57:56.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee4ea00640 1 -- 172.21.15.115:0/2647725090 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee50018070 con 0x7fee58158530 2024-05-12T10:57:56.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee4ea00640 1 -- 172.21.15.115:0/2647725090 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50012990 con 0x7fee58158530 2024-05-12T10:57:56.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee5da00640 1 -- 172.21.15.115:0/2647725090 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee58159260 con 0x7fee58158530 2024-05-12T10:57:56.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.583+0000 7fee5da00640 1 -- 172.21.15.115:0/2647725090 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee581f1670 con 0x7fee58158530 2024-05-12T10:57:56.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee4ea00640 1 -- 172.21.15.115:0/2647725090 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fee50012b30 con 0x7fee58158530 2024-05-12T10:57:56.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee4ea00640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee3406f430 0x7fee340718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee4ea00640 1 -- 172.21.15.115:0/2647725090 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fee5008eed0 con 0x7fee58158530 2024-05-12T10:57:56.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56a00640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee3406f430 0x7fee340718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee60f19000 1 Processor -- start 2024-05-12T10:57:56.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee60f19000 1 -- start start 2024-05-12T10:57:56.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56a00640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee3406f430 0x7fee340718f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fee48007fd0 tx=0x7fee480aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:56.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee60f19000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c371df0 0x55803c3a7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee60f19000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee60f19000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3aca10 0x55803c3acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee60f19000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55803c1bb0f0 con 0x55803c3a7c80 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee60f19000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55803c174670 con 0x55803c3aca10 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee60f19000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55803c1b70b0 con 0x55803c371df0 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44742/0 (socket says 172.21.15.115:44742) 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56000640 1 -- 172.21.15.115:0/2294556011 learned_addr learned my addr 172.21.15.115:0/2294556011 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56a00640 1 --2- 172.21.15.115:0/2294556011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c371df0 0x55803c3a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee57400640 1 --2- 172.21.15.115:0/2294556011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3aca10 0x55803c3acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56000640 1 -- 172.21.15.115:0/2294556011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c371df0 msgr2=0x55803c3a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56000640 1 --2- 172.21.15.115:0/2294556011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c371df0 0x55803c3a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56000640 1 -- 172.21.15.115:0/2294556011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3aca10 msgr2=0x55803c3acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:56.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56000640 1 --2- 172.21.15.115:0/2294556011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3aca10 0x55803c3acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56000640 1 -- 172.21.15.115:0/2294556011 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803c17d010 con 0x55803c3a7c80 2024-05-12T10:57:56.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee57400640 1 --2- 172.21.15.115:0/2294556011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3aca10 0x55803c3acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:57:56.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee56000640 1 --2- 172.21.15.115:0/2294556011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a8060 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fee40009960 tx=0x7fee40009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b218be51248d3a49 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:56.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee47400640 1 -- 172.21.15.115:0/2294556011 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4001a030 con 0x55803c3a7c80 2024-05-12T10:57:56.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee47400640 1 -- 172.21.15.115:0/2294556011 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40013980 con 0x55803c3a7c80 2024-05-12T10:57:56.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.587+0000 7fee47400640 1 -- 172.21.15.115:0/2294556011 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40013d70 con 0x55803c3a7c80 2024-05-12T10:57:56.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 -- 172.21.15.115:0/2294556011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 msgr2=0x55803c3a8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 --2- 172.21.15.115:0/2294556011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a8060 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fee40009960 tx=0x7fee40009190 comp rx=0 tx=0).stop 2024-05-12T10:57:56.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 -- 172.21.15.115:0/2294556011 shutdown_connections 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 --2- 172.21.15.115:0/2294556011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3aca10 0x55803c3acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 --2- 172.21.15.115:0/2294556011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a8060 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 --2- 172.21.15.115:0/2294556011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c371df0 0x55803c3a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 -- 172.21.15.115:0/2294556011 >> 172.21.15.115:0/2294556011 conn(0x55803c253f90 msgr2=0x55803c3aa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 -- 172.21.15.115:0/2294556011 shutdown_connections 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 -- 172.21.15.115:0/2294556011 wait complete. 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 -- start start 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 Processor -- start 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c371df0 0x55803c3a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3aca10 0x55803c36d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55803c1c84f0 con 0x55803c3a7c80 2024-05-12T10:57:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55803c15b900 con 0x55803c3aca10 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55803c3721d0 con 0x55803c371df0 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 10 client.0 _ll_register_callbacks cb 0x55803c357180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee56000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee56000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44754/0 (socket says 172.21.15.115:44754) 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee56000640 1 -- 172.21.15.115:0/3119377360 learned_addr learned my addr 172.21.15.115:0/3119377360 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee56a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c371df0 0x55803c3a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee57400640 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3aca10 0x55803c36d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee56000640 1 -- 172.21.15.115:0/3119377360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c371df0 msgr2=0x55803c3a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee56000640 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c371df0 0x55803c3a6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee56000640 1 -- 172.21.15.115:0/3119377360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3aca10 msgr2=0x55803c36d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee56000640 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3aca10 0x55803c36d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee56000640 1 -- 172.21.15.115:0/3119377360 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803c16de40 con 0x55803c3a7c80 2024-05-12T10:57:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee56000640 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a7060 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fee4001a000 tx=0x7fee400046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e66079b7f632648 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee3be00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee3be00640 1 -- 172.21.15.115:0/3119377360 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40004450 con 0x55803c3a7c80 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 -- 172.21.15.115:0/3119377360 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee40013980 con 0x55803c3a7c80 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee3be00640 1 -- 172.21.15.115:0/3119377360 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fee40003620 con 0x55803c3a7c80 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee3be00640 1 -- 172.21.15.115:0/3119377360 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fee40031050 con 0x55803c3a7c80 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 10 client.5232 fetch_fsmap learned FSMap version 14 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee60f19000 1 -- 172.21.15.115:0/3119377360 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55803c285ab0 con 0x55803c3a7c80 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.591+0000 7fee3be00640 1 -- 172.21.15.115:0/3119377360 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40013980 con 0x55803c3a7c80 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee3be00640 1 -- 172.21.15.115:0/3119377360 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fee40034020 con 0x55803c3a7c80 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 10 client.5232 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 10 client.5232 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 20 client.5232 populate_metadata read hostname 'smithi115' 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55803c36df20 0x55803c36e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 4 client.5232 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:57:56.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 -- 172.21.15.115:0/3119377360 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55803c1547f0 con 0x55803c36df20 2024-05-12T10:57:56.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee56a00640 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55803c36df20 0x55803c36e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee56a00640 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55803c36df20 0x55803c36e300 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b65f982b2282c5b0 server_cookie=28c5c9b17f62ceee in_seq=0 out_seq=0 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee3be00640 10 client.5232 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee3be00640 1 -- 172.21.15.115:0/3119377360 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55803c1547f0 con 0x55803c36df20 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee3be00640 10 client.5232 handle_command_reply: tid=0 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 client.5232 shutdown 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 -- 172.21.15.115:0/3119377360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 msgr2=0x55803c3a7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a7060 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fee4001a000 tx=0x7fee400046d0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 -- 172.21.15.115:0/3119377360 shutdown_connections 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55803c36df20 0x55803c36e300 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3aca10 0x55803c36d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c3a7c80 0x55803c3a7060 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 --2- 172.21.15.115:0/3119377360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c371df0 0x55803c3a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee3be00640 0 client.5232 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:56.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 -- 172.21.15.115:0/3119377360 >> 172.21.15.115:0/3119377360 conn(0x55803c253f90 msgr2=0x55803c3aa490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:56.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 -- 172.21.15.115:0/3119377360 shutdown_connections 2024-05-12T10:57:56.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 1 -- 172.21.15.115:0/3119377360 wait complete. 2024-05-12T10:57:56.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.595+0000 7fee60f19000 20 client.5232 trim_cache size 0 max 16384 2024-05-12T10:57:56.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 Processor -- start 2024-05-12T10:57:56.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 -- start start 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c421160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3a7c80 0x55803c4216a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c3aca10 0x55803c421be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fee58200460 con 0x55803c371df0 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee581febd0 con 0x55803c3a7c80 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fee581fdf70 con 0x55803c3aca10 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee56a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c421160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee56a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c421160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44770/0 (socket says 172.21.15.115:44770) 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee56a00640 1 -- 172.21.15.115:0/1801810961 learned_addr learned my addr 172.21.15.115:0/1801810961 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee57400640 1 --2- 172.21.15.115:0/1801810961 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c3aca10 0x55803c421be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee56000640 1 --2- 172.21.15.115:0/1801810961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3a7c80 0x55803c4216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee56a00640 1 -- 172.21.15.115:0/1801810961 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c3aca10 msgr2=0x55803c421be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee56a00640 1 --2- 172.21.15.115:0/1801810961 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c3aca10 0x55803c421be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee56a00640 1 -- 172.21.15.115:0/1801810961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3a7c80 msgr2=0x55803c4216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:56.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee56a00640 1 --2- 172.21.15.115:0/1801810961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3a7c80 0x55803c4216a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee56a00640 1 -- 172.21.15.115:0/1801810961 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803c23be30 con 0x55803c371df0 2024-05-12T10:57:56.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee56a00640 1 --2- 172.21.15.115:0/1801810961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c421160 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fee48002050 tx=0x7fee48001680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4f982d87e55f52 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:56.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee46a00640 1 -- 172.21.15.115:0/1801810961 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480d1020 con 0x55803c371df0 2024-05-12T10:57:56.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee46a00640 1 -- 172.21.15.115:0/1801810961 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee480cd3d0 con 0x55803c371df0 2024-05-12T10:57:56.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee46a00640 1 -- 172.21.15.115:0/1801810961 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480b5040 con 0x55803c371df0 2024-05-12T10:57:56.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 -- 172.21.15.115:0/1801810961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 msgr2=0x55803c421160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 --2- 172.21.15.115:0/1801810961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c421160 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fee48002050 tx=0x7fee48001680 comp rx=0 tx=0).stop 2024-05-12T10:57:56.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 -- 172.21.15.115:0/1801810961 shutdown_connections 2024-05-12T10:57:56.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 --2- 172.21.15.115:0/1801810961 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c3aca10 0x55803c421be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 --2- 172.21.15.115:0/1801810961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3a7c80 0x55803c4216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 --2- 172.21.15.115:0/1801810961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c421160 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 -- 172.21.15.115:0/1801810961 >> 172.21.15.115:0/1801810961 conn(0x55803c253f90 msgr2=0x55803c370310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:56.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 -- 172.21.15.115:0/1801810961 shutdown_connections 2024-05-12T10:57:56.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.615+0000 7fee60f19000 1 -- 172.21.15.115:0/1801810961 wait complete. 2024-05-12T10:57:56.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 -- start start 2024-05-12T10:57:56.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 Processor -- start 2024-05-12T10:57:56.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c425590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3a7c80 0x55803c425ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c3aca10 0x55803c3c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55803c1513e0 con 0x55803c371df0 2024-05-12T10:57:56.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee581fe520 con 0x55803c3a7c80 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55803c1ba400 con 0x55803c3aca10 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 10 client.0 _ll_register_callbacks cb 0x7fee480b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee56a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c425590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee56a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c425590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44778/0 (socket says 172.21.15.115:44778) 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee56a00640 1 -- 172.21.15.115:0/3939198740 learned_addr learned my addr 172.21.15.115:0/3939198740 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee57400640 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c3aca10 0x55803c3c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee56a00640 1 -- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c3aca10 msgr2=0x55803c3c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee56a00640 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c3aca10 0x55803c3c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee56a00640 1 -- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3a7c80 msgr2=0x55803c425ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee56000640 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3a7c80 0x55803c425ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee56a00640 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3a7c80 0x55803c425ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee56a00640 1 -- 172.21.15.115:0/3939198740 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803c14cd80 con 0x55803c371df0 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee56a00640 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c425590 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fee48002050 tx=0x7fee4801d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db6a52fcd54127a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee3be00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:57:56.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee3be00640 1 -- 172.21.15.115:0/3939198740 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480b5050 con 0x55803c371df0 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee3be00640 1 -- 172.21.15.115:0/3939198740 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fee480cd780 con 0x55803c371df0 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 -- 172.21.15.115:0/3939198740 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee480cd3d0 con 0x55803c371df0 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee3be00640 1 -- 172.21.15.115:0/3939198740 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fee480e5050 con 0x55803c371df0 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 10 client.5238 fetch_fsmap learned FSMap version 14 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 -- 172.21.15.115:0/3939198740 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55803c15ff80 con 0x55803c371df0 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee3be00640 1 -- 172.21.15.115:0/3939198740 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee480cd3d0 con 0x55803c371df0 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee3be00640 1 -- 172.21.15.115:0/3939198740 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fee480e8020 con 0x55803c371df0 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 10 client.5238 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 10 client.5238 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 20 client.5238 populate_metadata read hostname 'smithi115' 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55803c3c6a50 0x55803c3c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 4 client.5238 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.3, "await_for": 42.0}] 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee60f19000 1 -- 172.21.15.115:0/3939198740 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.3, "await_for": 42.0}) -- 0x55803c1c8d00 con 0x55803c3c6a50 2024-05-12T10:57:56.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.619+0000 7fee56000640 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55803c3c6a50 0x55803c3c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:56.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.623+0000 7fee56000640 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55803c3c6a50 0x55803c3c6e60 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=991567d7b455f502 server_cookie=72826f73d8be513c in_seq=0 out_seq=0 2024-05-12T10:57:56.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.623+0000 7fee3be00640 10 client.5238 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:56.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee3be00640 1 -- 172.21.15.115:0/3939198740 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55803c1c8d00 con 0x55803c3c6a50 2024-05-12T10:57:56.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee3be00640 10 client.5238 handle_command_reply: tid=0 2024-05-12T10:57:56.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 1 client.5238 shutdown 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 1 -- 172.21.15.115:0/3939198740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 msgr2=0x55803c425590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c425590 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fee48002050 tx=0x7fee4801d830 comp rx=0 tx=0).stop 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 1 -- 172.21.15.115:0/3939198740 shutdown_connections 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55803c3aca10 0x55803c3c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55803c3c6a50 0x55803c3c6e60 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55803c3a7c80 0x55803c425ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 1 --2- 172.21.15.115:0/3939198740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55803c371df0 0x55803c425590 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 1 -- 172.21.15.115:0/3939198740 >> 172.21.15.115:0/3939198740 conn(0x55803c253f90 msgr2=0x55803c3c8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee3be00640 0 client.5238 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 1 -- 172.21.15.115:0/3939198740 shutdown_connections 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 1 -- 172.21.15.115:0/3939198740 wait complete. 2024-05-12T10:57:56.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee60f19000 20 client.5238 trim_cache size 0 max 16384 2024-05-12T10:57:56.620 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:57:56.620 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:57:56.620 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:57:56.620 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 26, 2024-05-12T10:57:56.620 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:57:56.620 INFO:teuthology.orchestra.run.smithi115.stdout: "e147707b": { 2024-05-12T10:57:56.620 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 26, 2024-05-12T10:57:56.620 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:57:56.620 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:57:56.620 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:57:56.620 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 89.3, 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "QUIESCED", 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:57:56.621 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:57:56.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 -- 172.21.15.115:0/2647725090 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee3406f430 msgr2=0x7fee340718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee3406f430 0x7fee340718f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fee48007fd0 tx=0x7fee480aa070 comp rx=0 tx=0).stop 2024-05-12T10:57:56.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 -- 172.21.15.115:0/2647725090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee58158530 msgr2=0x7fee58156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:56.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee58158530 0x7fee58156530 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fee580ccfa0 tx=0x7fee5000e9e0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 -- 172.21.15.115:0/2647725090 shutdown_connections 2024-05-12T10:57:56.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fee3406f430 0x7fee340718f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee58158530 0x7fee58156530 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee5815caf0 0x7fee5815e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 --2- 172.21.15.115:0/2647725090 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fee3c0039f0 0x7fee58158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:56.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 -- 172.21.15.115:0/2647725090 >> 172.21.15.115:0/2647725090 conn(0x7fee58076830 msgr2=0x7fee580ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:56.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 -- 172.21.15.115:0/2647725090 shutdown_connections 2024-05-12T10:57:56.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:57:56.627+0000 7fee5da00640 1 -- 172.21.15.115:0/2647725090 wait complete. 2024-05-12T10:57:56.638 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e147707b', quiesce took 0.6 seconds. Will release after: 29.3 2024-05-12T10:57:58.201 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:57:58.201 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:57:58.202 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-05-12T10:57:58.202 INFO:tasks.workunit.client.0.smithi115.stdout:iozone test complete. 2024-05-12T10:57:58.204 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-12T10:57:58.205 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-12T10:58:21.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:58:21.588 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:58:25.939 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:58:26.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.094+0000 7fd7a5800640 1 Processor -- start 2024-05-12T10:58:26.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd7a5800640 1 -- start start 2024-05-12T10:58:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd7a5800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7a0153de0 0x7fd7a00c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd7a5800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd7a00ca040 0x7fd7a00cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd7a5800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7a015ab40 con 0x7fd7a00cfaa0 2024-05-12T10:58:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd7a5800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a0159ce0 con 0x7fd7a00ca040 2024-05-12T10:58:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd7a5800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a0159fc0 con 0x7fd7a0153de0 2024-05-12T10:58:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd79ea00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7a0153de0 0x7fd7a00c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd79e000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd7a00ca040 0x7fd7a00cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd79f400640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd7a00cfaa0 0x7fd7a00cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:42734/0 (socket says 172.21.15.115:42734) 2024-05-12T10:58:26.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd79f400640 1 -- 172.21.15.115:0/1200538304 learned_addr learned my addr 172.21.15.115:0/1200538304 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd79d600640 1 -- 172.21.15.115:0/1200538304 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2823984450 0 0) 0x7fd7a015ab40 con 0x7fd7a00cfaa0 2024-05-12T10:58:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd79d600640 1 -- 172.21.15.115:0/1200538304 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd784003530 con 0x7fd7a00cfaa0 2024-05-12T10:58:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd79e000640 1 -- 172.21.15.115:0/1200538304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7a0153de0 msgr2=0x7fd7a00c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd79e000640 1 --2- 172.21.15.115:0/1200538304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7a0153de0 0x7fd7a00c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd79e000640 1 -- 172.21.15.115:0/1200538304 >> v1:172.21.15.134:6789/0 conn(0x7fd7a00cfaa0 legacy=0x7fd7a00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.098+0000 7fd79e000640 1 -- 172.21.15.115:0/1200538304 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a015a2a0 con 0x7fd7a00ca040 2024-05-12T10:58:26.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd79e000640 1 --2- 172.21.15.115:0/1200538304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7a00ca040 0x7fd7a00cf560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0097c0 tx=0x7fd78c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cb9ab22303f3320 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:26.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd79d600640 1 -- 172.21.15.115:0/1200538304 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0b5070 con 0x7fd7a00ca040 2024-05-12T10:58:26.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd79d600640 1 -- 172.21.15.115:0/1200538304 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78c0a8990 con 0x7fd7a00ca040 2024-05-12T10:58:26.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd79d600640 1 -- 172.21.15.115:0/1200538304 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0a8d40 con 0x7fd7a00ca040 2024-05-12T10:58:26.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd7a5800640 1 -- 172.21.15.115:0/1200538304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7a00ca040 msgr2=0x7fd7a00cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd7a5800640 1 --2- 172.21.15.115:0/1200538304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7a00ca040 0x7fd7a00cf560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0097c0 tx=0x7fd78c01ec90 comp rx=0 tx=0).stop 2024-05-12T10:58:26.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd7a5800640 1 -- 172.21.15.115:0/1200538304 shutdown_connections 2024-05-12T10:58:26.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd7a5800640 1 --2- 172.21.15.115:0/1200538304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7a00ca040 0x7fd7a00cf560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd7a5800640 1 --2- 172.21.15.115:0/1200538304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7a0153de0 0x7fd7a00c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd7a5800640 1 -- 172.21.15.115:0/1200538304 >> 172.21.15.115:0/1200538304 conn(0x7fd7a006c440 msgr2=0x7fd7a006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:26.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd7a5800640 1 -- 172.21.15.115:0/1200538304 shutdown_connections 2024-05-12T10:58:26.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.102+0000 7fd7a5800640 1 -- 172.21.15.115:0/1200538304 wait complete. 2024-05-12T10:58:26.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd7a5800640 1 Processor -- start 2024-05-12T10:58:26.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd7a5800640 1 -- start start 2024-05-12T10:58:26.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd7a5800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7a00ca040 0x7fd7a014a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd7a5800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7a00cfaa0 0x7fd7a01e5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd7a5800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7a0153de0 0x7fd7a00b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd7a5800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a006d0b0 con 0x7fd7a0153de0 2024-05-12T10:58:26.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd7a5800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a015a860 con 0x7fd7a00cfaa0 2024-05-12T10:58:26.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd7a5800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a00c4b30 con 0x7fd7a00ca040 2024-05-12T10:58:26.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7a0153de0 0x7fd7a00b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7a0153de0 0x7fd7a00b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54528/0 (socket says 172.21.15.115:54528) 2024-05-12T10:58:26.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79f400640 1 -- 172.21.15.115:0/1004521594 learned_addr learned my addr 172.21.15.115:0/1004521594 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:26.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79e000640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7a00cfaa0 0x7fd7a01e5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79ea00640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7a00ca040 0x7fd7a014a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79f400640 1 -- 172.21.15.115:0/1004521594 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7a00ca040 msgr2=0x7fd7a014a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79f400640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7a00ca040 0x7fd7a014a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79f400640 1 -- 172.21.15.115:0/1004521594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7a00cfaa0 msgr2=0x7fd7a01e5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79f400640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7a00cfaa0 0x7fd7a01e5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79f400640 1 -- 172.21.15.115:0/1004521594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a01e8330 con 0x7fd7a0153de0 2024-05-12T10:58:26.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79ea00640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7a00ca040 0x7fd7a014a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:26.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd79f400640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7a0153de0 0x7fd7a00b0a50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd79800cb40 tx=0x7fd79800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:26.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd796a00640 1 -- 172.21.15.115:0/1004521594 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79800ac40 con 0x7fd7a0153de0 2024-05-12T10:58:26.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd796a00640 1 -- 172.21.15.115:0/1004521594 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79800ade0 con 0x7fd7a0153de0 2024-05-12T10:58:26.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd796a00640 1 -- 172.21.15.115:0/1004521594 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798012600 con 0x7fd7a0153de0 2024-05-12T10:58:26.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd7a5800640 1 -- 172.21.15.115:0/1004521594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a014a7f0 con 0x7fd7a0153de0 2024-05-12T10:58:26.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.106+0000 7fd7a5800640 1 -- 172.21.15.115:0/1004521594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a01e5270 con 0x7fd7a0153de0 2024-05-12T10:58:26.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.110+0000 7fd7a5800640 1 -- 172.21.15.115:0/1004521594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a01e5440 con 0x7fd7a0153de0 2024-05-12T10:58:26.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.110+0000 7fd796a00640 1 -- 172.21.15.115:0/1004521594 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd7980127a0 con 0x7fd7a0153de0 2024-05-12T10:58:26.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.110+0000 7fd796a00640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd78006f400 0x7fd7800718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.110+0000 7fd796a00640 1 -- 172.21.15.115:0/1004521594 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd79808fd00 con 0x7fd7a0153de0 2024-05-12T10:58:26.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.110+0000 7fd79ea00640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd78006f400 0x7fd7800718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.110+0000 7fd79ea00640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd78006f400 0x7fd7800718c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd790009bb0 tx=0x7fd790008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:26.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.114+0000 7fd796a00640 1 -- 172.21.15.115:0/1004521594 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd79805c7e0 con 0x7fd7a0153de0 2024-05-12T10:58:26.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.306+0000 7fd7a5800640 1 -- 172.21.15.115:0/1004521594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7a0069730 con 0x7fd7a0153de0 2024-05-12T10:58:26.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.306+0000 7fd796a00640 1 -- 172.21.15.115:0/1004521594 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7fd79808f020 con 0x7fd7a0153de0 2024-05-12T10:58:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:58:26.299 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:58:26.299 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:58:26.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 -- 172.21.15.115:0/1004521594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd78006f400 msgr2=0x7fd7800718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd78006f400 0x7fd7800718c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd790009bb0 tx=0x7fd790008040 comp rx=0 tx=0).stop 2024-05-12T10:58:26.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 -- 172.21.15.115:0/1004521594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7a0153de0 msgr2=0x7fd7a00b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7a0153de0 0x7fd7a00b0a50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd79800cb40 tx=0x7fd79800a060 comp rx=0 tx=0).stop 2024-05-12T10:58:26.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 -- 172.21.15.115:0/1004521594 shutdown_connections 2024-05-12T10:58:26.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd78006f400 0x7fd7800718c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7a0153de0 0x7fd7a00b0a50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7a00cfaa0 0x7fd7a01e5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 --2- 172.21.15.115:0/1004521594 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7a00ca040 0x7fd7a014a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 -- 172.21.15.115:0/1004521594 >> 172.21.15.115:0/1004521594 conn(0x7fd7a006c440 msgr2=0x7fd7a0152580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:26.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 -- 172.21.15.115:0/1004521594 shutdown_connections 2024-05-12T10:58:26.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.310+0000 7fd7a5800640 1 -- 172.21.15.115:0/1004521594 wait complete. 2024-05-12T10:58:26.320 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db --set-id e147707b --release --await' 2024-05-12T10:58:26.320 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db --set-id e147707b --release --await 2024-05-12T10:58:26.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.470+0000 7fd448200640 1 Processor -- start 2024-05-12T10:58:26.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.470+0000 7fd448200640 1 -- start start 2024-05-12T10:58:26.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd448200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd4400c7700 0x7fd4400c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd448200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd440159490 0x7fd4400c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd448200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd440159980 con 0x7fd440152ef0 2024-05-12T10:58:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd448200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fd4400c4ac0 con 0x7fd4400c7700 2024-05-12T10:58:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd448200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fd4400c4d60 con 0x7fd440159490 2024-05-12T10:58:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd445800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd440152ef0 0x7fd440072d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:39378/0 (socket says 172.21.15.115:39378) 2024-05-12T10:58:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd445800640 1 -- 172.21.15.115:0/3264524906 learned_addr learned my addr 172.21.15.115:0/3264524906 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd444e00640 1 --2- 172.21.15.115:0/3264524906 >> v2:172.21.15.115:3300/0 conn(0x7fd4400c7700 0x7fd4400c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd446200640 1 --2- 172.21.15.115:0/3264524906 >> v2:172.21.15.134:3300/0 conn(0x7fd440159490 0x7fd4400c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd444e00640 1 -- 172.21.15.115:0/3264524906 >> v2:172.21.15.134:3300/0 conn(0x7fd440159490 msgr2=0x7fd4400c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd444e00640 1 --2- 172.21.15.115:0/3264524906 >> v2:172.21.15.134:3300/0 conn(0x7fd440159490 0x7fd4400c6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd444e00640 1 -- 172.21.15.115:0/3264524906 >> v1:172.21.15.115:6789/0 conn(0x7fd440152ef0 legacy=0x7fd440072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.474+0000 7fd444e00640 1 -- 172.21.15.115:0/3264524906 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd440072510 con 0x7fd4400c7700 2024-05-12T10:58:26.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd444e00640 1 --2- 172.21.15.115:0/3264524906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4400c7700 0x7fd4400c6610 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd4400c45b0 tx=0x7fd42c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15311fde43b4291 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:26.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd43fe00640 1 -- 172.21.15.115:0/3264524906 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0b0070 con 0x7fd4400c7700 2024-05-12T10:58:26.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd43fe00640 1 -- 172.21.15.115:0/3264524906 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42c0ab600 con 0x7fd4400c7700 2024-05-12T10:58:26.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd43fe00640 1 -- 172.21.15.115:0/3264524906 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0ab9d0 con 0x7fd4400c7700 2024-05-12T10:58:26.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 -- 172.21.15.115:0/3264524906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4400c7700 msgr2=0x7fd4400c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 --2- 172.21.15.115:0/3264524906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4400c7700 0x7fd4400c6610 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd4400c45b0 tx=0x7fd42c01c480 comp rx=0 tx=0).stop 2024-05-12T10:58:26.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 -- 172.21.15.115:0/3264524906 shutdown_connections 2024-05-12T10:58:26.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 --2- 172.21.15.115:0/3264524906 >> v2:172.21.15.134:3300/0 conn(0x7fd440159490 0x7fd4400c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 --2- 172.21.15.115:0/3264524906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4400c7700 0x7fd4400c6610 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 -- 172.21.15.115:0/3264524906 >> 172.21.15.115:0/3264524906 conn(0x7fd4400681c0 msgr2=0x7fd4400685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:26.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 -- 172.21.15.115:0/3264524906 shutdown_connections 2024-05-12T10:58:26.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 -- 172.21.15.115:0/3264524906 wait complete. 2024-05-12T10:58:26.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 Processor -- start 2024-05-12T10:58:26.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 -- start start 2024-05-12T10:58:26.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4400c7700 0x7fd4401486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd440152ef0 0x7fd440141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd440159490 0x7fd4401421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd4400735a0 con 0x7fd440152ef0 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd440073420 con 0x7fd4400c7700 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd448200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd440165ad0 con 0x7fd440159490 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd444e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd440152ef0 0x7fd440141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd444e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd440152ef0 0x7fd440141c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54534/0 (socket says 172.21.15.115:54534) 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.478+0000 7fd444e00640 1 -- 172.21.15.115:0/92628926 learned_addr learned my addr 172.21.15.115:0/92628926 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd445800640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4400c7700 0x7fd4401486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd446200640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd440159490 0x7fd4401421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd444e00640 1 -- 172.21.15.115:0/92628926 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd440159490 msgr2=0x7fd4401421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd444e00640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd440159490 0x7fd4401421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd444e00640 1 -- 172.21.15.115:0/92628926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4400c7700 msgr2=0x7fd4401486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd444e00640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4400c7700 0x7fd4401486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd444e00640 1 -- 172.21.15.115:0/92628926 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4401516e0 con 0x7fd440152ef0 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd444e00640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd440152ef0 0x7fd440141c80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0ae040 tx=0x7fd42c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:26.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd43d600640 1 -- 172.21.15.115:0/92628926 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0b0040 con 0x7fd440152ef0 2024-05-12T10:58:26.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd43d600640 1 -- 172.21.15.115:0/92628926 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42c0ba070 con 0x7fd440152ef0 2024-05-12T10:58:26.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd448200640 1 -- 172.21.15.115:0/92628926 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4400cdc70 con 0x7fd440152ef0 2024-05-12T10:58:26.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd43d600640 1 -- 172.21.15.115:0/92628926 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0b4870 con 0x7fd440152ef0 2024-05-12T10:58:26.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd448200640 1 -- 172.21.15.115:0/92628926 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd440151fd0 con 0x7fd440152ef0 2024-05-12T10:58:26.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd43d600640 1 -- 172.21.15.115:0/92628926 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd42c0ab4c0 con 0x7fd440152ef0 2024-05-12T10:58:26.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd43d600640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd42006f400 0x7fd4200718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.482+0000 7fd43d600640 1 -- 172.21.15.115:0/92628926 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd42c1294c0 con 0x7fd440152ef0 2024-05-12T10:58:26.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd445800640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd42006f400 0x7fd4200718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 Processor -- start 2024-05-12T10:58:26.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 -- start start 2024-05-12T10:58:26.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd445800640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd42006f400 0x7fd4200718c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd434000f70 tx=0x7fd434009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b2600 0x55a9aa8b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4270 0x55a9aa8b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b4b90 0x55a9aa8b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a9aa773a60 con 0x55a9aa8b4b90 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a9aa6dc250 con 0x55a9aa8b2600 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55a9aa6804d0 con 0x55a9aa8b4270 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd446200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b4b90 0x55a9aa8b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd446200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b4b90 0x55a9aa8b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54550/0 (socket says 172.21.15.115:54550) 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd446200640 1 -- 172.21.15.115:0/273622265 learned_addr learned my addr 172.21.15.115:0/273622265 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd445800640 1 --2- 172.21.15.115:0/273622265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b2600 0x55a9aa8b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd444e00640 1 --2- 172.21.15.115:0/273622265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4270 0x55a9aa8b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd446200640 1 -- 172.21.15.115:0/273622265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4270 msgr2=0x55a9aa8b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:26.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd446200640 1 --2- 172.21.15.115:0/273622265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4270 0x55a9aa8b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd446200640 1 -- 172.21.15.115:0/273622265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b2600 msgr2=0x55a9aa8b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:26.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd446200640 1 --2- 172.21.15.115:0/273622265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b2600 0x55a9aa8b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd446200640 1 -- 172.21.15.115:0/273622265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9aa6b3970 con 0x55a9aa8b4b90 2024-05-12T10:58:26.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd444e00640 1 --2- 172.21.15.115:0/273622265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4270 0x55a9aa8b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:26.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd446200640 1 --2- 172.21.15.115:0/273622265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b4b90 0x55a9aa8b4f70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd438007400 tx=0x7fd4380078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bbeed9d19007e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:26.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd432000640 1 -- 172.21.15.115:0/273622265 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4380147e0 con 0x55a9aa8b4b90 2024-05-12T10:58:26.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd432000640 1 -- 172.21.15.115:0/273622265 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43801a070 con 0x55a9aa8b4b90 2024-05-12T10:58:26.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd432000640 1 -- 172.21.15.115:0/273622265 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438014ba0 con 0x55a9aa8b4b90 2024-05-12T10:58:26.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 -- 172.21.15.115:0/273622265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b4b90 msgr2=0x55a9aa8b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 --2- 172.21.15.115:0/273622265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b4b90 0x55a9aa8b4f70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd438007400 tx=0x7fd4380078c0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 -- 172.21.15.115:0/273622265 shutdown_connections 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 --2- 172.21.15.115:0/273622265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b4b90 0x55a9aa8b4f70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 --2- 172.21.15.115:0/273622265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4270 0x55a9aa8b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 --2- 172.21.15.115:0/273622265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b2600 0x55a9aa8b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 -- 172.21.15.115:0/273622265 >> 172.21.15.115:0/273622265 conn(0x55a9aa8c9430 msgr2=0x55a9aa8cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 -- 172.21.15.115:0/273622265 shutdown_connections 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 -- 172.21.15.115:0/273622265 wait complete. 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.486+0000 7fd44b70b000 1 -- start start 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 1 Processor -- start 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa8b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 0x55a9aa8d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a9aa6d8210 con 0x55a9aa8b2600 2024-05-12T10:58:26.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a9aa6e9650 con 0x55a9aa8b4270 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55a9aa71a5b0 con 0x55a9aa8b4b90 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 10 client.0 _ll_register_callbacks cb 0x55a9aa876f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd445800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd445800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54560/0 (socket says 172.21.15.115:54560) 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd445800640 1 -- 172.21.15.115:0/2515622112 learned_addr learned my addr 172.21.15.115:0/2515622112 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd446200640 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 0x55a9aa8d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd444e00640 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa8b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd445800640 1 -- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 msgr2=0x55a9aa8d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd445800640 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 0x55a9aa8d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd445800640 1 -- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 msgr2=0x55a9aa8b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd445800640 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa8b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd445800640 1 -- 172.21.15.115:0/2515622112 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9aa7200e0 con 0x55a9aa8b2600 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd445800640 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8b19e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd434007380 tx=0x7fd434000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1379585cb97dfc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:26.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd426a00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd426a00640 1 -- 172.21.15.115:0/2515622112 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434028060 con 0x55a9aa8b2600 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd426a00640 1 -- 172.21.15.115:0/2515622112 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd434010040 con 0x55a9aa8b2600 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 1 -- 172.21.15.115:0/2515622112 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd43801a070 con 0x55a9aa8b2600 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd426a00640 1 -- 172.21.15.115:0/2515622112 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fd43400ec70 con 0x55a9aa8b2600 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 10 client.5256 fetch_fsmap learned FSMap version 14 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 1 -- 172.21.15.115:0/2515622112 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55a9aa68e9e0 con 0x55a9aa8b2600 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd426a00640 1 -- 172.21.15.115:0/2515622112 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43801a070 con 0x55a9aa8b2600 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd426a00640 1 -- 172.21.15.115:0/2515622112 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fd434023740 con 0x55a9aa8b2600 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 10 client.5256 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 10 client.5256 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 20 client.5256 populate_metadata read hostname 'smithi115' 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a9aa8d4870 0x55a9aa8d4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 4 client.5256 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd44b70b000 1 -- 172.21.15.115:0/2515622112 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9aa675060 con 0x55a9aa8d4870 2024-05-12T10:58:26.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.490+0000 7fd444e00640 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a9aa8d4870 0x55a9aa8d4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd426a00640 10 client.5256 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:58:26.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd444e00640 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a9aa8d4870 0x55a9aa8d4c80 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=629fb9363df3d904 server_cookie=309a94fca6ecfba4 in_seq=0 out_seq=0 2024-05-12T10:58:26.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd426a00640 1 -- 172.21.15.115:0/2515622112 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a9aa675060 con 0x55a9aa8d4870 2024-05-12T10:58:26.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd426a00640 10 client.5256 handle_command_reply: tid=0 2024-05-12T10:58:26.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 1 client.5256 shutdown 2024-05-12T10:58:26.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 1 -- 172.21.15.115:0/2515622112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 msgr2=0x55a9aa8b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8b19e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd434007380 tx=0x7fd434000ee0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 1 -- 172.21.15.115:0/2515622112 shutdown_connections 2024-05-12T10:58:26.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 0x55a9aa8d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a9aa8d4870 0x55a9aa8d4c80 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa8b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2515622112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8b19e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd426a00640 0 client.5256 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:58:26.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 1 -- 172.21.15.115:0/2515622112 >> 172.21.15.115:0/2515622112 conn(0x55a9aa8c9430 msgr2=0x55a9aa8cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:26.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 1 -- 172.21.15.115:0/2515622112 shutdown_connections 2024-05-12T10:58:26.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 1 -- 172.21.15.115:0/2515622112 wait complete. 2024-05-12T10:58:26.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.494+0000 7fd44b70b000 20 client.5256 trim_cache size 0 max 16384 2024-05-12T10:58:26.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.510+0000 7fd44b70b000 1 Processor -- start 2024-05-12T10:58:26.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.510+0000 7fd44b70b000 1 -- start start 2024-05-12T10:58:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8d6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa8d4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 0x55a9aa8d5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd440201a00 con 0x55a9aa8b2600 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd4401f8eb0 con 0x55a9aa8b4270 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd440201350 con 0x55a9aa8b4b90 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd445800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8d6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd445800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8d6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54574/0 (socket says 172.21.15.115:54574) 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd445800640 1 -- 172.21.15.115:0/2559572876 learned_addr learned my addr 172.21.15.115:0/2559572876 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd444e00640 1 --2- 172.21.15.115:0/2559572876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa8d4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd445800640 1 -- 172.21.15.115:0/2559572876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 msgr2=0x55a9aa8d5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd445800640 1 --2- 172.21.15.115:0/2559572876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 0x55a9aa8d5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd445800640 1 -- 172.21.15.115:0/2559572876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 msgr2=0x55a9aa8d4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd445800640 1 --2- 172.21.15.115:0/2559572876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa8d4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd445800640 1 -- 172.21.15.115:0/2559572876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9aa6806e0 con 0x55a9aa8b2600 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd444e00640 1 --2- 172.21.15.115:0/2559572876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa8d4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd445800640 1 --2- 172.21.15.115:0/2559572876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8d6080 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd434008fd0 tx=0x7fd43401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5246bf35ffe24a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd431600640 1 -- 172.21.15.115:0/2559572876 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43400e8b0 con 0x55a9aa8b2600 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd431600640 1 -- 172.21.15.115:0/2559572876 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43400ee10 con 0x55a9aa8b2600 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd431600640 1 -- 172.21.15.115:0/2559572876 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434023030 con 0x55a9aa8b2600 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 -- 172.21.15.115:0/2559572876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 msgr2=0x55a9aa8d6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2559572876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8d6080 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd434008fd0 tx=0x7fd43401d000 comp rx=0 tx=0).stop 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 -- 172.21.15.115:0/2559572876 shutdown_connections 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2559572876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 0x55a9aa8d5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2559572876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa8d4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2559572876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa8d6080 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 -- 172.21.15.115:0/2559572876 >> 172.21.15.115:0/2559572876 conn(0x55a9aa8c9430 msgr2=0x55a9aa8b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 -- 172.21.15.115:0/2559572876 shutdown_connections 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 -- 172.21.15.115:0/2559572876 wait complete. 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 -- start start 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.514+0000 7fd44b70b000 1 Processor -- start 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa948be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa949120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 0x55a9aa8d4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a9aa671c50 con 0x55a9aa8b2600 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a9aa6d4d70 con 0x55a9aa8b4270 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55a9aa6db560 con 0x55a9aa8b4b90 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 10 client.0 _ll_register_callbacks cb 0x7fd434005940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd445800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa948be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd445800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa948be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54588/0 (socket says 172.21.15.115:54588) 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd445800640 1 -- 172.21.15.115:0/2352771508 learned_addr learned my addr 172.21.15.115:0/2352771508 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd444e00640 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa949120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd446200640 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 0x55a9aa8d4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd445800640 1 -- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 msgr2=0x55a9aa8d4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd445800640 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 0x55a9aa8d4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd445800640 1 -- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 msgr2=0x55a9aa949120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd445800640 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa949120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd445800640 1 -- 172.21.15.115:0/2352771508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9aa7332a0 con 0x55a9aa8b2600 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd445800640 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa948be0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd434024c70 tx=0x7fd434013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71b8f3c68461597 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd426a00640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd426a00640 1 -- 172.21.15.115:0/2352771508 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43400e8b0 con 0x55a9aa8b2600 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd426a00640 1 -- 172.21.15.115:0/2352771508 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd434028c20 con 0x55a9aa8b2600 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 1 -- 172.21.15.115:0/2352771508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd43400ee10 con 0x55a9aa8b2600 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd426a00640 1 -- 172.21.15.115:0/2352771508 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fd434046050 con 0x55a9aa8b2600 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 10 client.5262 fetch_fsmap learned FSMap version 14 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 1 -- 172.21.15.115:0/2352771508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55a9aa6709c0 con 0x55a9aa8b2600 2024-05-12T10:58:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd426a00640 1 -- 172.21.15.115:0/2352771508 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43400ee10 con 0x55a9aa8b2600 2024-05-12T10:58:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd426a00640 1 -- 172.21.15.115:0/2352771508 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fd434049020 con 0x55a9aa8b2600 2024-05-12T10:58:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 10 client.5262 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:58:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 10 client.5262 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:58:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 20 client.5262 populate_metadata read hostname 'smithi115' 2024-05-12T10:58:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a9aa8d5670 0x55a9aa8d5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 4 client.5262 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e147707b", "release": true, "await": true}] 2024-05-12T10:58:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd44b70b000 1 -- 172.21.15.115:0/2352771508 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e147707b", "release": true, "await": true}) -- 0x55a9aa6e9e60 con 0x55a9aa8d5670 2024-05-12T10:58:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd444e00640 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a9aa8d5670 0x55a9aa8d5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd444e00640 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a9aa8d5670 0x55a9aa8d5a50 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbbec7518527b38a server_cookie=c512cb3c95720fa0 in_seq=0 out_seq=0 2024-05-12T10:58:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.518+0000 7fd426a00640 10 client.5262 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:58:26.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd426a00640 1 -- 172.21.15.115:0/2352771508 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a9aa6e9e60 con 0x55a9aa8d5670 2024-05-12T10:58:26.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd426a00640 10 client.5262 handle_command_reply: tid=0 2024-05-12T10:58:26.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 1 client.5262 shutdown 2024-05-12T10:58:26.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 1 -- 172.21.15.115:0/2352771508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 msgr2=0x55a9aa948be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa948be0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd434024c70 tx=0x7fd434013000 comp rx=0 tx=0).stop 2024-05-12T10:58:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 1 -- 172.21.15.115:0/2352771508 shutdown_connections 2024-05-12T10:58:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a9aa8b4b90 0x55a9aa8d4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55a9aa8d5670 0x55a9aa8d5a50 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9aa8b4270 0x55a9aa949120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 1 --2- 172.21.15.115:0/2352771508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9aa8b2600 0x55a9aa948be0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd426a00640 0 client.5262 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:58:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 1 -- 172.21.15.115:0/2352771508 >> 172.21.15.115:0/2352771508 conn(0x55a9aa8c9430 msgr2=0x55a9aa8b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 1 -- 172.21.15.115:0/2352771508 shutdown_connections 2024-05-12T10:58:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 1 -- 172.21.15.115:0/2352771508 wait complete. 2024-05-12T10:58:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd44b70b000 20 client.5262 trim_cache size 0 max 16384 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 28, 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": { 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout: "e147707b": { 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout: "version": 28, 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout: "age_ref": 0.0, 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:58:26.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: "timeout": 60.0, 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: "expiration": 89.3, 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: "members": { 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: "file:/": { 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: "excluded": false, 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: "state": { 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "RELEASED", 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-12T10:58:26.523 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:58:26.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 -- 172.21.15.115:0/92628926 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd42006f400 msgr2=0x7fd4200718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd42006f400 0x7fd4200718c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd434000f70 tx=0x7fd434009040 comp rx=0 tx=0).stop 2024-05-12T10:58:26.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 -- 172.21.15.115:0/92628926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd440152ef0 msgr2=0x7fd440141c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:26.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd440152ef0 0x7fd440141c80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0ae040 tx=0x7fd42c019220 comp rx=0 tx=0).stop 2024-05-12T10:58:26.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 -- 172.21.15.115:0/92628926 shutdown_connections 2024-05-12T10:58:26.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fd42006f400 0x7fd4200718c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd440159490 0x7fd4401421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd440152ef0 0x7fd440141c80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 --2- 172.21.15.115:0/92628926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4400c7700 0x7fd4401486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:26.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 -- 172.21.15.115:0/92628926 >> 172.21.15.115:0/92628926 conn(0x7fd4400681c0 msgr2=0x7fd440158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:26.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 -- 172.21.15.115:0/92628926 shutdown_connections 2024-05-12T10:58:26.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:26.530+0000 7fd448200640 1 -- 172.21.15.115:0/92628926 wait complete. 2024-05-12T10:58:26.526 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-05-12T10:58:26.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-12T10:58:26.541 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e147707b', seconds elapsed: 30.5 2024-05-12T10:58:27.430 DEBUG:teuthology.parallel:result is None 2024-05-12T10:58:27.431 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-12T10:58:27.466 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-12T10:58:27.466 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-05-12T10:58:27.477 INFO:tasks.quiescer:joining Quiescers 2024-05-12T10:58:27.477 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-05-12T10:58:27.478 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:58:27.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.654+0000 7fc7d9c00640 1 Processor -- start 2024-05-12T10:58:27.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.654+0000 7fc7d9c00640 1 -- start start 2024-05-12T10:58:27.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.654+0000 7fc7d9c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7d40c9080 0x7fc7d40c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:27.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d9c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc7d41523a0 0x7fc7d41527d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:27.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d9c00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7d4152d10 con 0x7fc7d40c9460 2024-05-12T10:58:27.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d9c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc7d4158a70 con 0x7fc7d41523a0 2024-05-12T10:58:27.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d9c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d4158d50 con 0x7fc7d40c9080 2024-05-12T10:58:27.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d3400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc7d40c9460 0x7fc7d40c9ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:39394/0 (socket says 172.21.15.115:39394) 2024-05-12T10:58:27.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d3400640 1 -- 172.21.15.115:0/1436339697 learned_addr learned my addr 172.21.15.115:0/1436339697 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:27.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d9200640 1 --2- 172.21.15.115:0/1436339697 >> v2:172.21.15.134:3300/0 conn(0x7fc7d41523a0 0x7fc7d41527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:27.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d3e00640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7d40c9080 0x7fc7d40c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:27.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219735769 0 0) 0x7fc7d4152d10 con 0x7fc7d40c9460 2024-05-12T10:58:27.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7b8003530 con 0x7fc7d40c9460 2024-05-12T10:58:27.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3311713591 0 0) 0x7fc7b8003530 con 0x7fc7d40c9460 2024-05-12T10:58:27.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7d40c9080 msgr2=0x7fc7d40c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:27.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7d40c9080 0x7fc7d40c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 >> v2:172.21.15.134:3300/0 conn(0x7fc7d41523a0 msgr2=0x7fc7d41527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:27.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 --2- 172.21.15.115:0/1436339697 >> v2:172.21.15.134:3300/0 conn(0x7fc7d41523a0 0x7fc7d41527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d4159030 con 0x7fc7d40c9460 2024-05-12T10:58:27.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fc7c0001700 con 0x7fc7d40c9460 2024-05-12T10:58:27.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 >> v1:172.21.15.115:6789/0 conn(0x7fc7d40c9460 legacy=0x7fc7d40c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7b8003a10 0x7fc7b8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7d40c9080 0x7fc7b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7b8004d50 0x7fc7b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4158a70 con 0x7fc7b8004d50 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4158d50 con 0x7fc7b8003a10 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b800dc70 con 0x7fc7d40c9080 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d9200640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7b8004d50 0x7fc7b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d3400640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7d40c9080 0x7fc7b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d3e00640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7b8003a10 0x7fc7b8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d9200640 1 -- 172.21.15.115:0/1436339697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7d40c9080 msgr2=0x7fc7b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d9200640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7d40c9080 0x7fc7b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d9200640 1 -- 172.21.15.115:0/1436339697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7b8003a10 msgr2=0x7fc7b8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d9200640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7b8003a10 0x7fc7b8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.658+0000 7fc7d9200640 1 -- 172.21.15.115:0/1436339697 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b8003530 con 0x7fc7b8004d50 2024-05-12T10:58:27.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d9200640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7b8004d50 0x7fc7b80051d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009fc0 tx=0x7fc7cc01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cbb5be22e3794c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:27.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0b2070 con 0x7fc7b8004d50 2024-05-12T10:58:27.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc0a5cd0 con 0x7fc7b8004d50 2024-05-12T10:58:27.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d2a00640 1 -- 172.21.15.115:0/1436339697 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc009c10 con 0x7fc7b8004d50 2024-05-12T10:58:27.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d9c00640 1 -- 172.21.15.115:0/1436339697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7b8004d50 msgr2=0x7fc7b80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:27.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d9c00640 1 --2- 172.21.15.115:0/1436339697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7b8004d50 0x7fc7b80051d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009fc0 tx=0x7fc7cc01ccc0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d9200640 1 -- 172.21.15.115:0/1436339697 reap_dead start 2024-05-12T10:58:27.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d9c00640 1 -- 172.21.15.115:0/1436339697 shutdown_connections 2024-05-12T10:58:27.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d9c00640 1 -- 172.21.15.115:0/1436339697 >> 172.21.15.115:0/1436339697 conn(0x7fc7d40681c0 msgr2=0x7fc7d40685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:27.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d9c00640 1 -- 172.21.15.115:0/1436339697 shutdown_connections 2024-05-12T10:58:27.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d9c00640 1 -- 172.21.15.115:0/1436339697 wait complete. 2024-05-12T10:58:27.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d9c00640 1 Processor -- start 2024-05-12T10:58:27.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.662+0000 7fc7d9c00640 1 -- start start 2024-05-12T10:58:27.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d9c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7b8004d50 0x7fc7d414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:27.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d9c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d41529f0 0x7fc7d40c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d9c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7d4145b70 0x7fc7d4146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d9c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d40ca2b0 con 0x7fc7d41529f0 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d9c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41595f0 con 0x7fc7d4145b70 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d9c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d40ca430 con 0x7fc7b8004d50 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d41529f0 0x7fc7d40c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d41529f0 0x7fc7d40c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54604/0 (socket says 172.21.15.115:54604) 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d3400640 1 -- 172.21.15.115:0/475759668 learned_addr learned my addr 172.21.15.115:0/475759668 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d3e00640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7b8004d50 0x7fc7d414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d9200640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7d4145b70 0x7fc7d4146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d3400640 1 -- 172.21.15.115:0/475759668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7b8004d50 msgr2=0x7fc7d414d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d3400640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7b8004d50 0x7fc7d414d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d3400640 1 -- 172.21.15.115:0/475759668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7d4145b70 msgr2=0x7fc7d4146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d3400640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7d4145b70 0x7fc7d4146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d3400640 1 -- 172.21.15.115:0/475759668 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d41f0910 con 0x7fc7d41529f0 2024-05-12T10:58:27.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d9200640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7d4145b70 0x7fc7d4146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:27.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d3400640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d41529f0 0x7fc7d40c4440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000e810 tx=0x7fc7c000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:27.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7cbe00640 1 -- 172.21.15.115:0/475759668 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000c8d0 con 0x7fc7d41529f0 2024-05-12T10:58:27.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7cbe00640 1 -- 172.21.15.115:0/475759668 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c0018070 con 0x7fc7d41529f0 2024-05-12T10:58:27.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7cbe00640 1 -- 172.21.15.115:0/475759668 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000cc90 con 0x7fc7d41529f0 2024-05-12T10:58:27.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d9c00640 1 -- 172.21.15.115:0/475759668 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d41f0bf0 con 0x7fc7d41529f0 2024-05-12T10:58:27.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d9c00640 1 -- 172.21.15.115:0/475759668 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d41f11b0 con 0x7fc7d41529f0 2024-05-12T10:58:27.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7d9c00640 1 -- 172.21.15.115:0/475759668 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d4050750 con 0x7fc7d41529f0 2024-05-12T10:58:27.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.666+0000 7fc7cbe00640 1 -- 172.21.15.115:0/475759668 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc7c001d460 con 0x7fc7d41529f0 2024-05-12T10:58:27.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.670+0000 7fc7cbe00640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc7b406f400 0x7fc7b40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:27.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.670+0000 7fc7cbe00640 1 -- 172.21.15.115:0/475759668 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc7c008f760 con 0x7fc7d41529f0 2024-05-12T10:58:27.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.670+0000 7fc7d3e00640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc7b406f400 0x7fc7b40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:27.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.670+0000 7fc7d3e00640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc7b406f400 0x7fc7b40718c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40099b0 tx=0x7fc7c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:27.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.674+0000 7fc7cbe00640 1 -- 172.21.15.115:0/475759668 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc7c005c1b0 con 0x7fc7d41529f0 2024-05-12T10:58:27.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 -- 172.21.15.115:0/475759668 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7d4070b30 con 0x7fc7d41529f0 2024-05-12T10:58:27.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7cbe00640 1 -- 172.21.15.115:0/475759668 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7fc7c0064230 con 0x7fc7d41529f0 2024-05-12T10:58:27.856 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:58:27.856 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:58:27.856 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:58:27.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 -- 172.21.15.115:0/475759668 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc7b406f400 msgr2=0x7fc7b40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:27.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc7b406f400 0x7fc7b40718c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40099b0 tx=0x7fc7c4008040 comp rx=0 tx=0).stop 2024-05-12T10:58:27.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 -- 172.21.15.115:0/475759668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d41529f0 msgr2=0x7fc7d40c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:27.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d41529f0 0x7fc7d40c4440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000e810 tx=0x7fc7c000ecd0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 -- 172.21.15.115:0/475759668 shutdown_connections 2024-05-12T10:58:27.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc7b406f400 0x7fc7b40718c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7d4145b70 0x7fc7d4146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d41529f0 0x7fc7d40c4440 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 --2- 172.21.15.115:0/475759668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7b8004d50 0x7fc7d414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:27.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 -- 172.21.15.115:0/475759668 >> 172.21.15.115:0/475759668 conn(0x7fc7d40681c0 msgr2=0x7fc7d4072ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:27.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 -- 172.21.15.115:0/475759668 shutdown_connections 2024-05-12T10:58:27.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:27.866+0000 7fc7d9c00640 1 -- 172.21.15.115:0/475759668 wait complete. 2024-05-12T10:58:27.878 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4321 quiesce db --cancel --all' 2024-05-12T10:58:27.878 DEBUG:teuthology.orchestra.run.smithi115:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4321 quiesce db --cancel --all 2024-05-12T10:58:28.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f5012a00640 1 Processor -- start 2024-05-12T10:58:28.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f5012a00640 1 -- start start 2024-05-12T10:58:28.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f5012a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f500c153a70 0x7f500c0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f5012a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f500c0c9900 0x7f500c0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f5012a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500c070d00 con 0x7f500c0ccf10 2024-05-12T10:58:28.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f5012a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f500c0c8420 con 0x7f500c153a70 2024-05-12T10:58:28.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f5012a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f500c070ab0 con 0x7f500c0c9900 2024-05-12T10:58:28.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f5010a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f500c0ccf10 0x7f500c06f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:39402/0 (socket says 172.21.15.115:39402) 2024-05-12T10:58:28.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f5010a00640 1 -- 172.21.15.115:0/1878972095 learned_addr learned my addr 172.21.15.115:0/1878972095 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:28.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f500be00640 1 --2- 172.21.15.115:0/1878972095 >> v2:172.21.15.134:3300/0 conn(0x7f500c153a70 0x7f500c0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f500b400640 1 --2- 172.21.15.115:0/1878972095 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f500c0c9900 0x7f500c0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f500aa00640 1 -- 172.21.15.115:0/1878972095 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160040886 0 0) 0x7f500c070d00 con 0x7f500c0ccf10 2024-05-12T10:58:28.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f500aa00640 1 -- 172.21.15.115:0/1878972095 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff0003530 con 0x7f500c0ccf10 2024-05-12T10:58:28.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f500be00640 1 -- 172.21.15.115:0/1878972095 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f500c0c9900 msgr2=0x7f500c0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:28.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f500be00640 1 --2- 172.21.15.115:0/1878972095 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f500c0c9900 0x7f500c0c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f500be00640 1 -- 172.21.15.115:0/1878972095 >> v1:172.21.15.115:6789/0 conn(0x7f500c0ccf10 legacy=0x7f500c06f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.030+0000 7f500be00640 1 -- 172.21.15.115:0/1878972095 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c0cb1c0 con 0x7f500c153a70 2024-05-12T10:58:28.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f500be00640 1 --2- 172.21.15.115:0/1878972095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f500c153a70 0x7f500c0c6a30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0097c0 tx=0x7f4ffc01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57a783e28eea677b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f500aa00640 1 -- 172.21.15.115:0/1878972095 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0b5070 con 0x7f500c153a70 2024-05-12T10:58:28.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f500aa00640 1 -- 172.21.15.115:0/1878972095 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc0a8990 con 0x7f500c153a70 2024-05-12T10:58:28.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f500aa00640 1 -- 172.21.15.115:0/1878972095 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0a8d40 con 0x7f500c153a70 2024-05-12T10:58:28.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f5012a00640 1 -- 172.21.15.115:0/1878972095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f500c153a70 msgr2=0x7f500c0c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f5012a00640 1 --2- 172.21.15.115:0/1878972095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f500c153a70 0x7f500c0c6a30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0097c0 tx=0x7f4ffc01ec90 comp rx=0 tx=0).stop 2024-05-12T10:58:28.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f5012a00640 1 -- 172.21.15.115:0/1878972095 shutdown_connections 2024-05-12T10:58:28.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f5012a00640 1 --2- 172.21.15.115:0/1878972095 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f500c0c9900 0x7f500c0c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f5012a00640 1 --2- 172.21.15.115:0/1878972095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f500c153a70 0x7f500c0c6a30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f5012a00640 1 -- 172.21.15.115:0/1878972095 >> 172.21.15.115:0/1878972095 conn(0x7f500c0cd320 msgr2=0x7f500c0cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:28.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f5012a00640 1 -- 172.21.15.115:0/1878972095 shutdown_connections 2024-05-12T10:58:28.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.034+0000 7f5012a00640 1 -- 172.21.15.115:0/1878972095 wait complete. 2024-05-12T10:58:28.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5012a00640 1 Processor -- start 2024-05-12T10:58:28.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5012a00640 1 -- start start 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5012a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f500c0c9900 0x7f500c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5012a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f500c0ccf10 0x7f500c0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5012a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f500c153a70 0x7f500c072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5012a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f500c0cde40 con 0x7f500c153a70 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5012a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f500c0c7f00 con 0x7f500c0ccf10 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5012a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f500c0cdfc0 con 0x7f500c0c9900 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5010a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f500c153a70 0x7f500c072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5010a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f500c153a70 0x7f500c072a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54610/0 (socket says 172.21.15.115:54610) 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5010a00640 1 -- 172.21.15.115:0/3087015657 learned_addr learned my addr 172.21.15.115:0/3087015657 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f500b400640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f500c0ccf10 0x7f500c0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f500be00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f500c0c9900 0x7f500c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5010a00640 1 -- 172.21.15.115:0/3087015657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f500c0c9900 msgr2=0x7f500c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5010a00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f500c0c9900 0x7f500c0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5010a00640 1 -- 172.21.15.115:0/3087015657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f500c0ccf10 msgr2=0x7f500c0c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5010a00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f500c0ccf10 0x7f500c0c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5010a00640 1 -- 172.21.15.115:0/3087015657 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c0c49a0 con 0x7f500c153a70 2024-05-12T10:58:28.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5010a00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f500c153a70 0x7f500c072a90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f500400cbb0 tx=0x7f500400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5003e00640 1 -- 172.21.15.115:0/3087015657 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500400ad40 con 0x7f500c153a70 2024-05-12T10:58:28.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5003e00640 1 -- 172.21.15.115:0/3087015657 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5004012400 con 0x7f500c153a70 2024-05-12T10:58:28.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5003e00640 1 -- 172.21.15.115:0/3087015657 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5004012810 con 0x7f500c153a70 2024-05-12T10:58:28.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5012a00640 1 -- 172.21.15.115:0/3087015657 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500c0c4c40 con 0x7f500c153a70 2024-05-12T10:58:28.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.038+0000 7f5012a00640 1 -- 172.21.15.115:0/3087015657 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f500c0c51e0 con 0x7f500c153a70 2024-05-12T10:58:28.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5003e00640 1 -- 172.21.15.115:0/3087015657 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f50040129b0 con 0x7f500c153a70 2024-05-12T10:58:28.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5003e00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4fec06f400 0x7f4fec0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5003e00640 1 -- 172.21.15.115:0/3087015657 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f500408fc30 con 0x7f500c153a70 2024-05-12T10:58:28.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500be00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4fec06f400 0x7f4fec0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5015df3000 1 Processor -- start 2024-05-12T10:58:28.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5015df3000 1 -- start start 2024-05-12T10:58:28.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500be00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4fec06f400 0x7f4fec0718c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0b2000 tx=0x7f4ffc0aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5015df3000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d152200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5015df3000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d18d500 0x55820d18d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5015df3000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18de20 0x55820d18e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5015df3000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55820d033330 con 0x55820d151e20 2024-05-12T10:58:28.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5015df3000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55820cf9af40 con 0x55820d18d500 2024-05-12T10:58:28.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5015df3000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55820cf53ae0 con 0x55820d18de20 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54620/0 (socket says 172.21.15.115:54620) 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500be00640 1 -- 172.21.15.115:0/1821984124 learned_addr learned my addr 172.21.15.115:0/1821984124 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500b400640 1 --2- 172.21.15.115:0/1821984124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d18d500 0x55820d18d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5010a00640 1 --2- 172.21.15.115:0/1821984124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18de20 0x55820d18e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500be00640 1 -- 172.21.15.115:0/1821984124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18de20 msgr2=0x55820d18e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500be00640 1 --2- 172.21.15.115:0/1821984124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18de20 0x55820d18e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500be00640 1 -- 172.21.15.115:0/1821984124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d18d500 msgr2=0x55820d18d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500be00640 1 --2- 172.21.15.115:0/1821984124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d18d500 0x55820d18d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500be00640 1 -- 172.21.15.115:0/1821984124 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55820cf73e20 con 0x55820d151e20 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f5010a00640 1 --2- 172.21.15.115:0/1821984124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18de20 0x55820d18e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.042+0000 7f500be00640 1 --2- 172.21.15.115:0/1821984124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d152200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc000c10 tx=0x7f4ffc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bbf605ff3c888f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5000c00640 1 -- 172.21.15.115:0/1821984124 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0b5040 con 0x55820d151e20 2024-05-12T10:58:28.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5000c00640 1 -- 172.21.15.115:0/1821984124 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc0a8990 con 0x55820d151e20 2024-05-12T10:58:28.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5000c00640 1 -- 172.21.15.115:0/1821984124 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0a8d40 con 0x55820d151e20 2024-05-12T10:58:28.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 -- 172.21.15.115:0/1821984124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 msgr2=0x55820d152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 --2- 172.21.15.115:0/1821984124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d152200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc000c10 tx=0x7f4ffc004740 comp rx=0 tx=0).stop 2024-05-12T10:58:28.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 -- 172.21.15.115:0/1821984124 shutdown_connections 2024-05-12T10:58:28.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 --2- 172.21.15.115:0/1821984124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18de20 0x55820d18e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 --2- 172.21.15.115:0/1821984124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d18d500 0x55820d18d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 --2- 172.21.15.115:0/1821984124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d152200 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 -- 172.21.15.115:0/1821984124 >> 172.21.15.115:0/1821984124 conn(0x55820d1892b0 msgr2=0x55820d18b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:28.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 -- 172.21.15.115:0/1821984124 shutdown_connections 2024-05-12T10:58:28.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 -- 172.21.15.115:0/1821984124 wait complete. 2024-05-12T10:58:28.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 -- start start 2024-05-12T10:58:28.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 Processor -- start 2024-05-12T10:58:28.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 0x55820d14cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18d500 0x55820d14d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d14d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55820cf4fe80 con 0x55820d18de20 2024-05-12T10:58:28.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55820d06ad50 con 0x55820d151e20 2024-05-12T10:58:28.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55820cf56ec0 con 0x55820d18d500 2024-05-12T10:58:28.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 10 client.0 _ll_register_callbacks cb 0x55820d04de60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5010a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d14d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5010a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d14d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54628/0 (socket says 172.21.15.115:54628) 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5010a00640 1 -- 172.21.15.115:0/3731460782 learned_addr learned my addr 172.21.15.115:0/3731460782 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f500be00640 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 0x55820d14cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f500b400640 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18d500 0x55820d14d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5010a00640 1 -- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18d500 msgr2=0x55820d14d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5010a00640 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18d500 0x55820d14d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5010a00640 1 -- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 msgr2=0x55820d14cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5010a00640 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 0x55820d14cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5010a00640 1 -- 172.21.15.115:0/3731460782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55820cfe0780 con 0x55820d18de20 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f500be00640 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 0x55820d14cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5010a00640 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d14d5d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f500405c030 tx=0x7f500405b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7308f002d3c228 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f4ff5600640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:58:28.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f4ff5600640 1 -- 172.21.15.115:0/3731460782 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5004064be0 con 0x55820d18de20 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f4ff5600640 1 -- 172.21.15.115:0/3731460782 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5004004b70 con 0x55820d18de20 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.046+0000 7f5015df3000 1 -- 172.21.15.115:0/3731460782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ffc0a8990 con 0x55820d18de20 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f4ff5600640 1 -- 172.21.15.115:0/3731460782 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f5004060450 con 0x55820d18de20 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 10 client.5280 fetch_fsmap learned FSMap version 14 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 -- 172.21.15.115:0/3731460782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55820cf53d30 con 0x55820d18de20 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f4ff5600640 1 -- 172.21.15.115:0/3731460782 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc0a8990 con 0x55820d18de20 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f4ff5600640 1 -- 172.21.15.115:0/3731460782 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f500405b300 con 0x55820d18de20 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 10 client.5280 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 10 client.5280 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 20 client.5280 populate_metadata read hostname 'smithi115' 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55820d1a15e0 0x55820d1a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 4 client.5280 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 -- 172.21.15.115:0/3731460782 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55820cf33df0 con 0x55820d1a15e0 2024-05-12T10:58:28.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f500be00640 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55820d1a15e0 0x55820d1a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f4ff5600640 10 client.5280 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:58:28.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f500be00640 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55820d1a15e0 0x55820d1a39d0 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=627f0d49fc8862ab server_cookie=9e39aff0c1b79c82 in_seq=0 out_seq=0 2024-05-12T10:58:28.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f4ff5600640 1 -- 172.21.15.115:0/3731460782 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55820cf33df0 con 0x55820d1a15e0 2024-05-12T10:58:28.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f4ff5600640 10 client.5280 handle_command_reply: tid=0 2024-05-12T10:58:28.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 client.5280 shutdown 2024-05-12T10:58:28.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 -- 172.21.15.115:0/3731460782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 msgr2=0x55820d14d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d14d5d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f500405c030 tx=0x7f500405b940 comp rx=0 tx=0).stop 2024-05-12T10:58:28.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 -- 172.21.15.115:0/3731460782 shutdown_connections 2024-05-12T10:58:28.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d14d5d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18d500 0x55820d14d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55820d1a15e0 0x55820d1a39d0 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 --2- 172.21.15.115:0/3731460782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 0x55820d14cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f4ff5600640 0 client.5280 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:58:28.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 -- 172.21.15.115:0/3731460782 >> 172.21.15.115:0/3731460782 conn(0x55820d1892b0 msgr2=0x55820d18cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:28.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 -- 172.21.15.115:0/3731460782 shutdown_connections 2024-05-12T10:58:28.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 1 -- 172.21.15.115:0/3731460782 wait complete. 2024-05-12T10:58:28.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.050+0000 7f5015df3000 20 client.5280 trim_cache size 0 max 16384 2024-05-12T10:58:28.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 Processor -- start 2024-05-12T10:58:28.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 -- start start 2024-05-12T10:58:28.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d1a7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d18d500 0x55820d150350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18de20 0x55820d150890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f500c1fe580 con 0x55820d151e20 2024-05-12T10:58:28.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f500c1f5aa0 con 0x55820d18d500 2024-05-12T10:58:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f500c1fdf00 con 0x55820d18de20 2024-05-12T10:58:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f500be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d1a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f500be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d1a7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54632/0 (socket says 172.21.15.115:54632) 2024-05-12T10:58:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f500be00640 1 -- 172.21.15.115:0/4048409168 learned_addr learned my addr 172.21.15.115:0/4048409168 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f500b400640 1 --2- 172.21.15.115:0/4048409168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d18d500 0x55820d150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5010a00640 1 --2- 172.21.15.115:0/4048409168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18de20 0x55820d150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f500be00640 1 -- 172.21.15.115:0/4048409168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18de20 msgr2=0x55820d150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f500be00640 1 --2- 172.21.15.115:0/4048409168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18de20 0x55820d150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f500be00640 1 -- 172.21.15.115:0/4048409168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d18d500 msgr2=0x55820d150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f500be00640 1 --2- 172.21.15.115:0/4048409168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d18d500 0x55820d150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f500be00640 1 -- 172.21.15.115:0/4048409168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55820d017500 con 0x55820d151e20 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f500be00640 1 --2- 172.21.15.115:0/4048409168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d1a7030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0c7040 tx=0x7f4ffc0b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd2fe4ead2310c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f4ff7e00640 1 -- 172.21.15.115:0/4048409168 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0038c0 con 0x55820d151e20 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f4ff7e00640 1 -- 172.21.15.115:0/4048409168 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc003a60 con 0x55820d151e20 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f4ff7e00640 1 -- 172.21.15.115:0/4048409168 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc003e10 con 0x55820d151e20 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 -- 172.21.15.115:0/4048409168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 msgr2=0x55820d1a7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 --2- 172.21.15.115:0/4048409168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d1a7030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0c7040 tx=0x7f4ffc0b8000 comp rx=0 tx=0).stop 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 -- 172.21.15.115:0/4048409168 shutdown_connections 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 --2- 172.21.15.115:0/4048409168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18de20 0x55820d150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 --2- 172.21.15.115:0/4048409168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d18d500 0x55820d150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 --2- 172.21.15.115:0/4048409168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d151e20 0x55820d1a7030 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 -- 172.21.15.115:0/4048409168 >> 172.21.15.115:0/4048409168 conn(0x55820d1892b0 msgr2=0x55820d150ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:28.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 -- 172.21.15.115:0/4048409168 shutdown_connections 2024-05-12T10:58:28.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 -- 172.21.15.115:0/4048409168 wait complete. 2024-05-12T10:58:28.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.070+0000 7f5015df3000 1 -- start start 2024-05-12T10:58:28.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 1 Processor -- start 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 0x55820d150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18d500 0x55820d2010d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d201610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55820cf9a250 con 0x55820d18de20 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55820cf3b680 con 0x55820d151e20 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55820cf9f570 con 0x55820d18d500 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 10 client.0 _ll_register_callbacks cb 0x7f5004001cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5010a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d201610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5010a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d201610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54646/0 (socket says 172.21.15.115:54646) 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5010a00640 1 -- 172.21.15.115:0/3118807380 learned_addr learned my addr 172.21.15.115:0/3118807380 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f500be00640 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 0x55820d150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f500b400640 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18d500 0x55820d2010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5010a00640 1 -- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18d500 msgr2=0x55820d2010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5010a00640 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18d500 0x55820d2010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5010a00640 1 -- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 msgr2=0x55820d150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5010a00640 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 0x55820d150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5010a00640 1 -- 172.21.15.115:0/3118807380 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55820cff36f0 con 0x55820d18de20 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f500be00640 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 0x55820d150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f500b400640 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18d500 0x55820d2010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5010a00640 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d201610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5004012fd0 tx=0x7f500408dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58a70f831d74d46 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f4ff5600640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f4ff5600640 1 -- 172.21.15.115:0/3118807380 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500405b9f0 con 0x55820d18de20 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f4ff5600640 1 -- 172.21.15.115:0/3118807380 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5004004d70 con 0x55820d18de20 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 1 -- 172.21.15.115:0/3118807380 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ffc003a60 con 0x55820d18de20 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f4ff5600640 1 -- 172.21.15.115:0/3118807380 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f5004064e70 con 0x55820d18de20 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 10 client.5286 fetch_fsmap learned FSMap version 14 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 1 -- 172.21.15.115:0/3118807380 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55820cc54400 con 0x55820d18de20 2024-05-12T10:58:28.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f4ff5600640 1 -- 172.21.15.115:0/3118807380 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc003a60 con 0x55820d18de20 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f4ff5600640 1 -- 172.21.15.115:0/3118807380 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f5004057a10 con 0x55820d18de20 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 10 client.5286 fetch_fsmap finished waiting for FSMap version 14 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 10 client.5286 resolve_mds: validated gid 4321 aka daemon mds.b 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 20 client.5286 populate_metadata read hostname 'smithi115' 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55820d1ffca0 0x55820d200080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 4 client.5286 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f5015df3000 1 -- 172.21.15.115:0/3118807380 --> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55820cfa8b50 con 0x55820d1ffca0 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f500be00640 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55820d1ffca0 0x55820d200080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f500be00640 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55820d1ffca0 0x55820d200080 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a2e57c2c84f8a78 server_cookie=daeaa90bdc597283 in_seq=0 out_seq=0 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.074+0000 7f4ff5600640 10 client.5286 ms_handle_connect on v2:172.21.15.134:6834/1447701149 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f4ff5600640 1 -- 172.21.15.115:0/3118807380 <== mds.0 v2:172.21.15.134:6834/1447701149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x55820cfa8b50 con 0x55820d1ffca0 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f4ff5600640 10 client.5286 handle_command_reply: tid=0 2024-05-12T10:58:28.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 1 client.5286 shutdown 2024-05-12T10:58:28.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 1 -- 172.21.15.115:0/3118807380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 msgr2=0x55820d201610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d201610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5004012fd0 tx=0x7f500408dc20 comp rx=0 tx=0).stop 2024-05-12T10:58:28.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 1 -- 172.21.15.115:0/3118807380 shutdown_connections 2024-05-12T10:58:28.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55820d18de20 0x55820d201610 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55820d18d500 0x55820d2010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:6834/1447701149,v1:172.21.15.134:6835/1447701149] conn(0x55820d1ffca0 0x55820d200080 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 1 --2- 172.21.15.115:0/3118807380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55820d151e20 0x55820d150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 1 -- 172.21.15.115:0/3118807380 >> 172.21.15.115:0/3118807380 conn(0x55820d1892b0 msgr2=0x55820d1a6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:28.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f4ff5600640 0 client.5286 ms_handle_reset on v2:172.21.15.134:6834/1447701149 2024-05-12T10:58:28.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 1 -- 172.21.15.115:0/3118807380 shutdown_connections 2024-05-12T10:58:28.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 1 -- 172.21.15.115:0/3118807380 wait complete. 2024-05-12T10:58:28.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5015df3000 20 client.5286 trim_cache size 0 max 16384 2024-05-12T10:58:28.072 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:58:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "epoch": 14, 2024-05-12T10:58:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "leader": 4321, 2024-05-12T10:58:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "set_version": 28, 2024-05-12T10:58:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "sets": {} 2024-05-12T10:58:28.073 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:58:28.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 -- 172.21.15.115:0/3087015657 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4fec06f400 msgr2=0x7f4fec0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4fec06f400 0x7f4fec0718c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0b2000 tx=0x7f4ffc0aa070 comp rx=0 tx=0).stop 2024-05-12T10:58:28.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 -- 172.21.15.115:0/3087015657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f500c153a70 msgr2=0x7f500c072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f500c153a70 0x7f500c072a90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f500400cbb0 tx=0x7f500400a430 comp rx=0 tx=0).stop 2024-05-12T10:58:28.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 -- 172.21.15.115:0/3087015657 shutdown_connections 2024-05-12T10:58:28.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f4fec06f400 0x7f4fec0718c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f500c153a70 0x7f500c072a90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f500c0ccf10 0x7f500c0c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 --2- 172.21.15.115:0/3087015657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f500c0c9900 0x7f500c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 -- 172.21.15.115:0/3087015657 >> 172.21.15.115:0/3087015657 conn(0x7f500c0cd320 msgr2=0x7f500c06fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:28.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 -- 172.21.15.115:0/3087015657 shutdown_connections 2024-05-12T10:58:28.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.078+0000 7f5012a00640 1 -- 172.21.15.115:0/3087015657 wait complete. 2024-05-12T10:58:28.087 INFO:tasks.quiescer:done joining Quiescers 2024-05-12T10:58:28.088 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-12T10:58:28.100 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-12T10:58:28.100 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:58:28.100 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-12T10:58:28.109 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-12T10:58:28.109 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-12T10:58:28.163 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-12T10:58:28.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.354+0000 7f6345600640 1 Processor -- start 2024-05-12T10:58:28.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f6345600640 1 -- start start 2024-05-12T10:58:28.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f6345600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63400c7780 0x7f63401599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f6345600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 0x7f63400c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f6345600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63400c9370 con 0x7f6340150310 2024-05-12T10:58:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f6345600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f63400c9610 con 0x7f63400c7780 2024-05-12T10:58:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f6345600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f63400c98d0 con 0x7f63401506f0 2024-05-12T10:58:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f633f400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 0x7f63400c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f6336000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63400c7780 0x7f63401599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f633f400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 0x7f63400c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:59758/0 (socket says 172.21.15.115:59758) 2024-05-12T10:58:28.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f633f400640 1 -- 172.21.15.115:0/2455205141 learned_addr learned my addr 172.21.15.115:0/2455205141 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:28.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f633ea00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6340150310 0x7f63400c4990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:42736/0 (socket says 172.21.15.115:42736) 2024-05-12T10:58:28.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f633f400640 1 -- 172.21.15.115:0/2455205141 >> v2:172.21.15.134:3300/0 conn(0x7f63400c7780 msgr2=0x7f63401599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:28.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f633f400640 1 --2- 172.21.15.115:0/2455205141 >> v2:172.21.15.134:3300/0 conn(0x7f63400c7780 0x7f63401599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f633f400640 1 -- 172.21.15.115:0/2455205141 >> v1:172.21.15.134:6789/0 conn(0x7f6340150310 legacy=0x7f63400c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.358+0000 7f633f400640 1 -- 172.21.15.115:0/2455205141 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63400c9bb0 con 0x7f63401506f0 2024-05-12T10:58:28.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f633f400640 1 --2- 172.21.15.115:0/2455205141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 0x7f63400c7e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63380098a0 tx=0x7f633801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc67a55fff99c2ca server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f633e000640 1 -- 172.21.15.115:0/2455205141 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63380aa670 con 0x7f63401506f0 2024-05-12T10:58:28.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f633e000640 1 -- 172.21.15.115:0/2455205141 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63380af070 con 0x7f63401506f0 2024-05-12T10:58:28.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f633e000640 1 -- 172.21.15.115:0/2455205141 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63380aaa30 con 0x7f63401506f0 2024-05-12T10:58:28.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f6345600640 1 -- 172.21.15.115:0/2455205141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 msgr2=0x7f63400c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f6345600640 1 --2- 172.21.15.115:0/2455205141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 0x7f63400c7e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63380098a0 tx=0x7f633801c510 comp rx=0 tx=0).stop 2024-05-12T10:58:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f6345600640 1 -- 172.21.15.115:0/2455205141 shutdown_connections 2024-05-12T10:58:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f6345600640 1 --2- 172.21.15.115:0/2455205141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 0x7f63400c7e90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f6345600640 1 --2- 172.21.15.115:0/2455205141 >> v2:172.21.15.134:3300/0 conn(0x7f63400c7780 0x7f63401599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f6345600640 1 -- 172.21.15.115:0/2455205141 >> 172.21.15.115:0/2455205141 conn(0x7f6340076830 msgr2=0x7f63400681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f6345600640 1 -- 172.21.15.115:0/2455205141 shutdown_connections 2024-05-12T10:58:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f6345600640 1 -- 172.21.15.115:0/2455205141 wait complete. 2024-05-12T10:58:28.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.362+0000 7f6345600640 1 Processor -- start 2024-05-12T10:58:28.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6345600640 1 -- start start 2024-05-12T10:58:28.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6345600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63400c7780 0x7f6340073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6345600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340150310 0x7f63401472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6345600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 0x7f6340142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6345600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f63400c60d0 con 0x7f6340150310 2024-05-12T10:58:28.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6345600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63400c52a0 con 0x7f63400c7780 2024-05-12T10:58:28.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6345600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f63400c6250 con 0x7f63401506f0 2024-05-12T10:58:28.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6336000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340150310 0x7f63401472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6336000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340150310 0x7f63401472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54662/0 (socket says 172.21.15.115:54662) 2024-05-12T10:58:28.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6336000640 1 -- 172.21.15.115:0/662602731 learned_addr learned my addr 172.21.15.115:0/662602731 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:28.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f633ea00640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63400c7780 0x7f6340073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f633f400640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 0x7f6340142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6336000640 1 -- 172.21.15.115:0/662602731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 msgr2=0x7f6340142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6336000640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 0x7f6340142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6336000640 1 -- 172.21.15.115:0/662602731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63400c7780 msgr2=0x7f6340073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6336000640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63400c7780 0x7f6340073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6336000640 1 -- 172.21.15.115:0/662602731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63401450f0 con 0x7f6340150310 2024-05-12T10:58:28.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6336000640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340150310 0x7f63401472b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6328009db0 tx=0x7f632800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6337400640 1 -- 172.21.15.115:0/662602731 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328018020 con 0x7f6340150310 2024-05-12T10:58:28.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6337400640 1 -- 172.21.15.115:0/662602731 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6328014480 con 0x7f6340150310 2024-05-12T10:58:28.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6345600640 1 -- 172.21.15.115:0/662602731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6340072fb0 con 0x7f6340150310 2024-05-12T10:58:28.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6337400640 1 -- 172.21.15.115:0/662602731 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328014850 con 0x7f6340150310 2024-05-12T10:58:28.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6345600640 1 -- 172.21.15.115:0/662602731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6340145670 con 0x7f6340150310 2024-05-12T10:58:28.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.366+0000 7f6345600640 1 -- 172.21.15.115:0/662602731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6340069730 con 0x7f6340150310 2024-05-12T10:58:28.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.370+0000 7f6337400640 1 -- 172.21.15.115:0/662602731 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f632801b020 con 0x7f6340150310 2024-05-12T10:58:28.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.370+0000 7f6337400640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 0x7f631c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.370+0000 7f6337400640 1 -- 172.21.15.115:0/662602731 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f632808ff30 con 0x7f6340150310 2024-05-12T10:58:28.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.370+0000 7f633ea00640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 0x7f631c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.370+0000 7f633ea00640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 0x7f631c0718f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6330000f70 tx=0x7f6330007e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.374+0000 7f6337400640 1 -- 172.21.15.115:0/662602731 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6328022070 con 0x7f6340150310 2024-05-12T10:58:28.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.546+0000 7f6345600640 1 -- 172.21.15.115:0/662602731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f63400c8940 con 0x7f6340150310 2024-05-12T10:58:28.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.546+0000 7f6337400640 1 -- 172.21.15.115:0/662602731 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f6328010040 con 0x7f6340150310 2024-05-12T10:58:28.538 INFO:teuthology.orchestra.run.smithi115.stderr:listed 0 entries 2024-05-12T10:58:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 -- 172.21.15.115:0/662602731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 msgr2=0x7f631c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 0x7f631c0718f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6330000f70 tx=0x7f6330007e90 comp rx=0 tx=0).stop 2024-05-12T10:58:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 -- 172.21.15.115:0/662602731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340150310 msgr2=0x7f63401472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340150310 0x7f63401472b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6328009db0 tx=0x7f632800c490 comp rx=0 tx=0).stop 2024-05-12T10:58:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 -- 172.21.15.115:0/662602731 shutdown_connections 2024-05-12T10:58:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f631c06f430 0x7f631c0718f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63401506f0 0x7f6340142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6340150310 0x7f63401472b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 --2- 172.21.15.115:0/662602731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63400c7780 0x7f6340073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 -- 172.21.15.115:0/662602731 >> 172.21.15.115:0/662602731 conn(0x7f6340076830 msgr2=0x7f634014ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:28.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 -- 172.21.15.115:0/662602731 shutdown_connections 2024-05-12T10:58:28.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:28.550+0000 7f6345600640 1 -- 172.21.15.115:0/662602731 wait complete. 2024-05-12T10:58:28.559 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-12T10:58:28.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:58:28.559 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-12T10:58:28.660 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:58:28.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:58:28.660 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-12T10:58:28.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:58:28.671 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-05-12T10:58:28.719 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-12T10:58:28.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:58:28.720 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T10:58:28.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T10:58:28.789 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2024-05-12T10:58:28.966 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-12T10:58:28.976 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-12T10:58:28.976 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:58:29.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.122+0000 7f2188600640 1 Processor -- start 2024-05-12T10:58:29.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.122+0000 7f2188600640 1 -- start start 2024-05-12T10:58:29.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2188600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2180159430 0x7f21800cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2188600640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f21800c9fd0 0x7f21800cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2188600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21800c45f0 0x7f218015f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2188600640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f21800c5c20 con 0x7f21800c9fd0 2024-05-12T10:58:29.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2188600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f21800c5050 con 0x7f2180159430 2024-05-12T10:58:29.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2188600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f21800c52f0 con 0x7f21800c45f0 2024-05-12T10:58:29.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2185200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f21800c9fd0 0x7f21800cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2185200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f21800c9fd0 0x7f21800cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54666/0 (socket says 172.21.15.115:54666) 2024-05-12T10:58:29.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2185200640 1 -- 172.21.15.115:0/3798755121 learned_addr learned my addr 172.21.15.115:0/3798755121 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:29.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2185c00640 1 --2- 172.21.15.115:0/3798755121 >> v2:172.21.15.134:3300/0 conn(0x7f2180159430 0x7f21800cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2186600640 1 --2- 172.21.15.115:0/3798755121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21800c45f0 0x7f218015f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2185200640 1 -- 172.21.15.115:0/3798755121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21800c45f0 msgr2=0x7f218015f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:29.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2185200640 1 --2- 172.21.15.115:0/3798755121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21800c45f0 0x7f218015f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2185200640 1 -- 172.21.15.115:0/3798755121 >> v2:172.21.15.134:3300/0 conn(0x7f2180159430 msgr2=0x7f21800cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:29.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2185200640 1 --2- 172.21.15.115:0/3798755121 >> v2:172.21.15.134:3300/0 conn(0x7f2180159430 0x7f21800cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2185200640 1 -- 172.21.15.115:0/3798755121 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21800c55d0 con 0x7f21800c9fd0 2024-05-12T10:58:29.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2185c00640 1 --2- 172.21.15.115:0/3798755121 >> v2:172.21.15.134:3300/0 conn(0x7f2180159430 0x7f21800cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:29.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.126+0000 7f2185200640 1 --2- 172.21.15.115:0/3798755121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21800c9fd0 0x7f21800cfaa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f21800740f0 tx=0x7f217401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dd3c9cd1f8357d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:29.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f217fe00640 1 -- 172.21.15.115:0/3798755121 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21740b5070 con 0x7f21800c9fd0 2024-05-12T10:58:29.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f217fe00640 1 -- 172.21.15.115:0/3798755121 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21740a89d0 con 0x7f21800c9fd0 2024-05-12T10:58:29.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f217fe00640 1 -- 172.21.15.115:0/3798755121 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21740a8da0 con 0x7f21800c9fd0 2024-05-12T10:58:29.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 -- 172.21.15.115:0/3798755121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21800c9fd0 msgr2=0x7f21800cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 --2- 172.21.15.115:0/3798755121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21800c9fd0 0x7f21800cfaa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f21800740f0 tx=0x7f217401ed10 comp rx=0 tx=0).stop 2024-05-12T10:58:29.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 -- 172.21.15.115:0/3798755121 shutdown_connections 2024-05-12T10:58:29.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 --2- 172.21.15.115:0/3798755121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21800c45f0 0x7f218015f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 --2- 172.21.15.115:0/3798755121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21800c9fd0 0x7f21800cfaa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 --2- 172.21.15.115:0/3798755121 >> v2:172.21.15.134:3300/0 conn(0x7f2180159430 0x7f21800cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 -- 172.21.15.115:0/3798755121 >> 172.21.15.115:0/3798755121 conn(0x7f218006c440 msgr2=0x7f218006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:29.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 -- 172.21.15.115:0/3798755121 shutdown_connections 2024-05-12T10:58:29.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 -- 172.21.15.115:0/3798755121 wait complete. 2024-05-12T10:58:29.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 Processor -- start 2024-05-12T10:58:29.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 -- start start 2024-05-12T10:58:29.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21800c45f0 0x7f21800c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21800c9fd0 0x7f218015e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2180159430 0x7f218014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f218006d180 con 0x7f21800c9fd0 2024-05-12T10:58:29.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21800ca580 con 0x7f21800c45f0 2024-05-12T10:58:29.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2188600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f21800cbcc0 con 0x7f2180159430 2024-05-12T10:58:29.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2185200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21800c9fd0 0x7f218015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2185200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21800c9fd0 0x7f218015e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54678/0 (socket says 172.21.15.115:54678) 2024-05-12T10:58:29.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2185200640 1 -- 172.21.15.115:0/3631673933 learned_addr learned my addr 172.21.15.115:0/3631673933 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:29.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2186600640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2180159430 0x7f218014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.130+0000 7f2185c00640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21800c45f0 0x7f21800c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f2185200640 1 -- 172.21.15.115:0/3631673933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2180159430 msgr2=0x7f218014bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f2185200640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2180159430 0x7f218014bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f2185200640 1 -- 172.21.15.115:0/3631673933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21800c45f0 msgr2=0x7f21800c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f2185200640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21800c45f0 0x7f21800c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f2185200640 1 -- 172.21.15.115:0/3631673933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2180150c50 con 0x7f21800c9fd0 2024-05-12T10:58:29.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f2185200640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21800c9fd0 0x7f218015e750 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f21740b3040 tx=0x7f217401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:29.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f217d600640 1 -- 172.21.15.115:0/3631673933 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21740b5070 con 0x7f21800c9fd0 2024-05-12T10:58:29.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f217d600640 1 -- 172.21.15.115:0/3631673933 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21740b0a70 con 0x7f21800c9fd0 2024-05-12T10:58:29.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f2188600640 1 -- 172.21.15.115:0/3631673933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2180150970 con 0x7f21800c9fd0 2024-05-12T10:58:29.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f217d600640 1 -- 172.21.15.115:0/3631673933 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21740b0e60 con 0x7f21800c9fd0 2024-05-12T10:58:29.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f2188600640 1 -- 172.21.15.115:0/3631673933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21800c8d20 con 0x7f21800c9fd0 2024-05-12T10:58:29.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f2188600640 1 -- 172.21.15.115:0/3631673933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2180069730 con 0x7f21800c9fd0 2024-05-12T10:58:29.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f217d600640 1 -- 172.21.15.115:0/3631673933 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f21740c2060 con 0x7f21800c9fd0 2024-05-12T10:58:29.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f217d600640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f216406f430 0x7f21640718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f217d600640 1 -- 172.21.15.115:0/3631673933 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f217412c840 con 0x7f21800c9fd0 2024-05-12T10:58:29.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.134+0000 7f2185c00640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f216406f430 0x7f21640718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.138+0000 7f2185c00640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f216406f430 0x7f21640718f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f217000c900 tx=0x7f2170008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:29.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.138+0000 7f217d600640 1 -- 172.21.15.115:0/3631673933 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2180150c50 con 0x7f21800c9fd0 2024-05-12T10:58:29.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.294+0000 7f2188600640 1 -- 172.21.15.115:0/3631673933 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2180074a40 con 0x7f216406f430 2024-05-12T10:58:29.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.306+0000 7f217d600640 1 -- 172.21.15.115:0/3631673933 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333410 (secure 0 0 0) 0x7f2180074a40 con 0x7f216406f430 2024-05-12T10:58:29.301 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:58:29.304 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:58:29.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 -- 172.21.15.115:0/3631673933 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f216406f430 msgr2=0x7f21640718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f216406f430 0x7f21640718f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f217000c900 tx=0x7f2170008040 comp rx=0 tx=0).stop 2024-05-12T10:58:29.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 -- 172.21.15.115:0/3631673933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21800c9fd0 msgr2=0x7f218015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21800c9fd0 0x7f218015e750 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f21740b3040 tx=0x7f217401bab0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 -- 172.21.15.115:0/3631673933 shutdown_connections 2024-05-12T10:58:29.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f216406f430 0x7f21640718f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2180159430 0x7f218014bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21800c9fd0 0x7f218015e750 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 --2- 172.21.15.115:0/3631673933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21800c45f0 0x7f21800c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 -- 172.21.15.115:0/3631673933 >> 172.21.15.115:0/3631673933 conn(0x7f218006c440 msgr2=0x7f2180156860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:29.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 -- 172.21.15.115:0/3631673933 shutdown_connections 2024-05-12T10:58:29.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.310+0000 7f2188600640 1 -- 172.21.15.115:0/3631673933 wait complete. 2024-05-12T10:58:29.322 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-05-12T10:58:27.925565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4421887,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":5197,"num_read_kb":21004346,"num_write":11414,"num_write_kb":25171456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11602,"ondisk_log_size":11602,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":518524,"kb_used_data":11132,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":754456196,"statfs":{"total":773094113280,"available":772563144704,"internally_reserved":0,"allocated":11399168,"data_stored":9837836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":519491121},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4346,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003104"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831179+0000","last_change":"2024-05-12T10:49:54.640093+0000","last_active":"2024-05-12T10:56:12.831179+0000","last_peered":"2024-05-12T10:56:12.831179+0000","last_clean":"2024-05-12T10:56:12.831179+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:56:12.831179+0000","last_undegraded":"2024-05-12T10:56:12.831179+0000","last_fullsized":"2024-05-12T10:56:12.831179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:07:41.639104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.839481+0000","last_change":"2024-05-12T10:49:55.635928+0000","last_active":"2024-05-12T10:55:57.839481+0000","last_peered":"2024-05-12T10:55:57.839481+0000","last_clean":"2024-05-12T10:55:57.839481+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:55:57.839481+0000","last_undegraded":"2024-05-12T10:55:57.839481+0000","last_fullsized":"2024-05-12T10:55:57.839481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:41:30.909036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'315","reported_seq":515,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.842369+0000","last_change":"2024-05-12T10:50:00.396417+0000","last_active":"2024-05-12T10:58:01.842369+0000","last_peered":"2024-05-12T10:58:01.842369+0000","last_clean":"2024-05-12T10:58:01.842369+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:58:01.842369+0000","last_undegraded":"2024-05-12T10:58:01.842369+0000","last_fullsized":"2024-05-12T10:58:01.842369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:27.287617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.839501+0000","last_change":"2024-05-12T10:49:54.619268+0000","last_active":"2024-05-12T10:55:57.839501+0000","last_peered":"2024-05-12T10:55:57.839501+0000","last_clean":"2024-05-12T10:55:57.839501+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:55:57.839501+0000","last_undegraded":"2024-05-12T10:55:57.839501+0000","last_fullsized":"2024-05-12T10:55:57.839501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:50:34.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831171+0000","last_change":"2024-05-12T10:49:55.624986+0000","last_active":"2024-05-12T10:56:12.831171+0000","last_peered":"2024-05-12T10:56:12.831171+0000","last_clean":"2024-05-12T10:56:12.831171+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:56:12.831171+0000","last_undegraded":"2024-05-12T10:56:12.831171+0000","last_fullsized":"2024-05-12T10:56:12.831171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:03:47.220979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'342","reported_seq":562,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.931276+0000","last_change":"2024-05-12T10:49:59.676139+0000","last_active":"2024-05-12T10:58:01.931276+0000","last_peered":"2024-05-12T10:58:01.931276+0000","last_clean":"2024-05-12T10:58:01.931276+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:58:01.931276+0000","last_undegraded":"2024-05-12T10:58:01.931276+0000","last_fullsized":"2024-05-12T10:58:01.931276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:24:15.396258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844325+0000","last_change":"2024-05-12T10:49:54.645331+0000","last_active":"2024-05-12T10:54:57.844325+0000","last_peered":"2024-05-12T10:54:57.844325+0000","last_clean":"2024-05-12T10:54:57.844325+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:54:57.844325+0000","last_undegraded":"2024-05-12T10:54:57.844325+0000","last_fullsized":"2024-05-12T10:54:57.844325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:38:29.023589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.839121+0000","last_change":"2024-05-12T10:49:55.642386+0000","last_active":"2024-05-12T10:54:57.839121+0000","last_peered":"2024-05-12T10:54:57.839121+0000","last_clean":"2024-05-12T10:54:57.839121+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:54:57.839121+0000","last_undegraded":"2024-05-12T10:54:57.839121+0000","last_fullsized":"2024-05-12T10:54:57.839121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:54:40.153070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'284","reported_seq":457,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.898022+0000","last_change":"2024-05-12T10:49:59.679887+0000","last_active":"2024-05-12T10:58:01.898022+0000","last_peered":"2024-05-12T10:58:01.898022+0000","last_clean":"2024-05-12T10:58:01.898022+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:58:01.898022+0000","last_undegraded":"2024-05-12T10:58:01.898022+0000","last_fullsized":"2024-05-12T10:58:01.898022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:25:43.004918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":274,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844272+0000","last_change":"2024-05-12T10:49:54.659229+0000","last_active":"2024-05-12T10:54:57.844272+0000","last_peered":"2024-05-12T10:54:57.844272+0000","last_clean":"2024-05-12T10:54:57.844272+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:54:57.844272+0000","last_undegraded":"2024-05-12T10:54:57.844272+0000","last_fullsized":"2024-05-12T10:54:57.844272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:54:54.658165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.839147+0000","last_change":"2024-05-12T10:49:55.642157+0000","last_active":"2024-05-12T10:54:57.839147+0000","last_peered":"2024-05-12T10:54:57.839147+0000","last_clean":"2024-05-12T10:54:57.839147+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:54:57.839147+0000","last_undegraded":"2024-05-12T10:54:57.839147+0000","last_fullsized":"2024-05-12T10:54:57.839147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:16.232731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'263","reported_seq":429,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.893300+0000","last_change":"2024-05-12T10:49:59.663411+0000","last_active":"2024-05-12T10:58:01.893300+0000","last_peered":"2024-05-12T10:58:01.893300+0000","last_clean":"2024-05-12T10:58:01.893300+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:58:01.893300+0000","last_undegraded":"2024-05-12T10:58:01.893300+0000","last_fullsized":"2024-05-12T10:58:01.893300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:59.136704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.836036+0000","last_change":"2024-05-12T10:49:55.646019+0000","last_active":"2024-05-12T10:54:17.836036+0000","last_peered":"2024-05-12T10:54:17.836036+0000","last_clean":"2024-05-12T10:54:17.836036+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:54:17.836036+0000","last_undegraded":"2024-05-12T10:54:17.836036+0000","last_fullsized":"2024-05-12T10:54:17.836036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:07.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835029+0000","last_change":"2024-05-12T10:49:54.642039+0000","last_active":"2024-05-12T10:54:27.835029+0000","last_peered":"2024-05-12T10:54:27.835029+0000","last_clean":"2024-05-12T10:54:27.835029+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:54:27.835029+0000","last_undegraded":"2024-05-12T10:54:27.835029+0000","last_fullsized":"2024-05-12T10:54:27.835029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:01.155569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'316","reported_seq":520,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.922676+0000","last_change":"2024-05-12T10:49:59.660274+0000","last_active":"2024-05-12T10:58:01.922676+0000","last_peered":"2024-05-12T10:58:01.922676+0000","last_clean":"2024-05-12T10:58:01.922676+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:58:01.922676+0000","last_undegraded":"2024-05-12T10:58:01.922676+0000","last_fullsized":"2024-05-12T10:58:01.922676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:55:12.579645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":737280,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.812386+0000","last_change":"2024-05-12T10:49:55.618128+0000","last_active":"2024-05-12T10:54:27.812386+0000","last_peered":"2024-05-12T10:54:27.812386+0000","last_clean":"2024-05-12T10:54:27.812386+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:54:27.812386+0000","last_undegraded":"2024-05-12T10:54:27.812386+0000","last_fullsized":"2024-05-12T10:54:27.812386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:45.205117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812560+0000","last_change":"2024-05-12T10:49:54.619967+0000","last_active":"2024-05-12T10:54:17.812560+0000","last_peered":"2024-05-12T10:54:17.812560+0000","last_clean":"2024-05-12T10:54:17.812560+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:54:17.812560+0000","last_undegraded":"2024-05-12T10:54:17.812560+0000","last_fullsized":"2024-05-12T10:54:17.812560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:37:10.799631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'296","reported_seq":488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.884554+0000","last_change":"2024-05-12T10:49:59.681931+0000","last_active":"2024-05-12T10:58:01.884554+0000","last_peered":"2024-05-12T10:58:01.884554+0000","last_clean":"2024-05-12T10:58:01.884554+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:58:01.884554+0000","last_undegraded":"2024-05-12T10:58:01.884554+0000","last_fullsized":"2024-05-12T10:58:01.884554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:45:01.542628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811343+0000","last_change":"2024-05-12T10:49:55.615095+0000","last_active":"2024-05-12T10:54:17.811343+0000","last_peered":"2024-05-12T10:54:17.811343+0000","last_clean":"2024-05-12T10:54:17.811343+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:54:17.811343+0000","last_undegraded":"2024-05-12T10:54:17.811343+0000","last_fullsized":"2024-05-12T10:54:17.811343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:51:19.659941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812526+0000","last_change":"2024-05-12T10:49:54.639976+0000","last_active":"2024-05-12T10:54:17.812526+0000","last_peered":"2024-05-12T10:54:17.812526+0000","last_clean":"2024-05-12T10:54:17.812526+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:54:17.812526+0000","last_undegraded":"2024-05-12T10:54:17.812526+0000","last_fullsized":"2024-05-12T10:54:17.812526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:28:37.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'273","reported_seq":446,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.859327+0000","last_change":"2024-05-12T10:50:36.857272+0000","last_active":"2024-05-12T10:58:01.859327+0000","last_peered":"2024-05-12T10:58:01.859327+0000","last_clean":"2024-05-12T10:58:01.859327+0000","last_became_active":"2024-05-12T10:50:36.856826+0000","last_became_peered":"2024-05-12T10:50:36.856826+0000","last_unstale":"2024-05-12T10:58:01.859327+0000","last_undegraded":"2024-05-12T10:58:01.859327+0000","last_fullsized":"2024-05-12T10:58:01.859327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:39:58.339959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.839725+0000","last_change":"2024-05-12T10:49:55.622729+0000","last_active":"2024-05-12T10:54:17.839725+0000","last_peered":"2024-05-12T10:54:17.839725+0000","last_clean":"2024-05-12T10:54:17.839725+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:54:17.839725+0000","last_undegraded":"2024-05-12T10:54:17.839725+0000","last_fullsized":"2024-05-12T10:54:17.839725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:08:29.460684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.833425+0000","last_change":"2024-05-12T10:49:54.639564+0000","last_active":"2024-05-12T10:54:17.833425+0000","last_peered":"2024-05-12T10:54:17.833425+0000","last_clean":"2024-05-12T10:54:17.833425+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:54:17.833425+0000","last_undegraded":"2024-05-12T10:54:17.833425+0000","last_fullsized":"2024-05-12T10:54:17.833425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:54:48.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'296","reported_seq":498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.952784+0000","last_change":"2024-05-12T10:50:36.858842+0000","last_active":"2024-05-12T10:58:01.952784+0000","last_peered":"2024-05-12T10:58:01.952784+0000","last_clean":"2024-05-12T10:58:01.952784+0000","last_became_active":"2024-05-12T10:50:36.857477+0000","last_became_peered":"2024-05-12T10:50:36.857477+0000","last_unstale":"2024-05-12T10:58:01.952784+0000","last_undegraded":"2024-05-12T10:58:01.952784+0000","last_fullsized":"2024-05-12T10:58:01.952784+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:08:55.931301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":700416,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812380+0000","last_change":"2024-05-12T10:49:55.612744+0000","last_active":"2024-05-12T10:54:17.812380+0000","last_peered":"2024-05-12T10:54:17.812380+0000","last_clean":"2024-05-12T10:54:17.812380+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:54:17.812380+0000","last_undegraded":"2024-05-12T10:54:17.812380+0000","last_fullsized":"2024-05-12T10:54:17.812380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:05:06.274277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.836166+0000","last_change":"2024-05-12T10:49:54.643375+0000","last_active":"2024-05-12T10:54:17.836166+0000","last_peered":"2024-05-12T10:54:17.836166+0000","last_clean":"2024-05-12T10:54:17.836166+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:54:17.836166+0000","last_undegraded":"2024-05-12T10:54:17.836166+0000","last_fullsized":"2024-05-12T10:54:17.836166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:56:43.086871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'259","reported_seq":414,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.958352+0000","last_change":"2024-05-12T10:50:00.393325+0000","last_active":"2024-05-12T10:58:01.958352+0000","last_peered":"2024-05-12T10:58:01.958352+0000","last_clean":"2024-05-12T10:58:01.958352+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:58:01.958352+0000","last_undegraded":"2024-05-12T10:58:01.958352+0000","last_fullsized":"2024-05-12T10:58:01.958352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:55.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":532480,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811404+0000","last_change":"2024-05-12T10:49:55.629693+0000","last_active":"2024-05-12T10:54:17.811404+0000","last_peered":"2024-05-12T10:54:17.811404+0000","last_clean":"2024-05-12T10:54:17.811404+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:54:17.811404+0000","last_undegraded":"2024-05-12T10:54:17.811404+0000","last_fullsized":"2024-05-12T10:54:17.811404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:04:13.325079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'33","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:58.766242+0000","last_change":"2024-05-12T10:49:54.629227+0000","last_active":"2024-05-12T10:57:58.766242+0000","last_peered":"2024-05-12T10:57:58.766242+0000","last_clean":"2024-05-12T10:57:58.766242+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:57:58.766242+0000","last_undegraded":"2024-05-12T10:57:58.766242+0000","last_fullsized":"2024-05-12T10:57:58.766242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:03.097527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'270","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:02.118119+0000","last_change":"2024-05-12T10:50:00.396371+0000","last_active":"2024-05-12T10:58:02.118119+0000","last_peered":"2024-05-12T10:58:02.118119+0000","last_clean":"2024-05-12T10:58:02.118119+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:58:02.118119+0000","last_undegraded":"2024-05-12T10:58:02.118119+0000","last_fullsized":"2024-05-12T10:58:02.118119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:41:09.157859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.852358+0000","last_change":"2024-05-12T10:49:55.612069+0000","last_active":"2024-05-12T10:56:12.852358+0000","last_peered":"2024-05-12T10:56:12.852358+0000","last_clean":"2024-05-12T10:56:12.852358+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:56:12.852358+0000","last_undegraded":"2024-05-12T10:56:12.852358+0000","last_fullsized":"2024-05-12T10:56:12.852358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:38.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.855055+0000","last_change":"2024-05-12T10:49:54.639928+0000","last_active":"2024-05-12T10:56:12.855055+0000","last_peered":"2024-05-12T10:56:12.855055+0000","last_clean":"2024-05-12T10:56:12.855055+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:56:12.855055+0000","last_undegraded":"2024-05-12T10:56:12.855055+0000","last_fullsized":"2024-05-12T10:56:12.855055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:59.215089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'261","reported_seq":422,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.956862+0000","last_change":"2024-05-12T10:50:00.383605+0000","last_active":"2024-05-12T10:58:01.956862+0000","last_peered":"2024-05-12T10:58:01.956862+0000","last_clean":"2024-05-12T10:58:01.956862+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:58:01.956862+0000","last_undegraded":"2024-05-12T10:58:01.956862+0000","last_fullsized":"2024-05-12T10:58:01.956862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:28.619988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856714+0000","last_change":"2024-05-12T10:49:55.621201+0000","last_active":"2024-05-12T10:56:12.856714+0000","last_peered":"2024-05-12T10:56:12.856714+0000","last_clean":"2024-05-12T10:56:12.856714+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:56:12.856714+0000","last_undegraded":"2024-05-12T10:56:12.856714+0000","last_fullsized":"2024-05-12T10:56:12.856714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:19:39.117790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.852384+0000","last_change":"2024-05-12T10:49:54.620329+0000","last_active":"2024-05-12T10:56:12.852384+0000","last_peered":"2024-05-12T10:56:12.852384+0000","last_clean":"2024-05-12T10:56:12.852384+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:56:12.852384+0000","last_undegraded":"2024-05-12T10:56:12.852384+0000","last_fullsized":"2024-05-12T10:56:12.852384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:21:10.386830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'282","reported_seq":465,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.960116+0000","last_change":"2024-05-12T10:49:59.655432+0000","last_active":"2024-05-12T10:58:01.960116+0000","last_peered":"2024-05-12T10:58:01.960116+0000","last_clean":"2024-05-12T10:58:01.960116+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:58:01.960116+0000","last_undegraded":"2024-05-12T10:58:01.960116+0000","last_fullsized":"2024-05-12T10:58:01.960116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:27:34.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.860789+0000","last_change":"2024-05-12T10:49:55.628221+0000","last_active":"2024-05-12T10:56:12.860789+0000","last_peered":"2024-05-12T10:56:12.860789+0000","last_clean":"2024-05-12T10:56:12.860789+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:56:12.860789+0000","last_undegraded":"2024-05-12T10:56:12.860789+0000","last_fullsized":"2024-05-12T10:56:12.860789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:54.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856655+0000","last_change":"2024-05-12T10:49:54.652499+0000","last_active":"2024-05-12T10:56:12.856655+0000","last_peered":"2024-05-12T10:56:12.856655+0000","last_clean":"2024-05-12T10:56:12.856655+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:56:12.856655+0000","last_undegraded":"2024-05-12T10:56:12.856655+0000","last_fullsized":"2024-05-12T10:56:12.856655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:14:35.180779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'269","reported_seq":442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.931250+0000","last_change":"2024-05-12T10:49:59.676676+0000","last_active":"2024-05-12T10:58:01.931250+0000","last_peered":"2024-05-12T10:58:01.931250+0000","last_clean":"2024-05-12T10:58:01.931250+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:58:01.931250+0000","last_undegraded":"2024-05-12T10:58:01.931250+0000","last_fullsized":"2024-05-12T10:58:01.931250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:03:13.485130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.837232+0000","last_change":"2024-05-12T10:49:55.610830+0000","last_active":"2024-05-12T10:55:57.837232+0000","last_peered":"2024-05-12T10:55:57.837232+0000","last_clean":"2024-05-12T10:55:57.837232+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:55:57.837232+0000","last_undegraded":"2024-05-12T10:55:57.837232+0000","last_fullsized":"2024-05-12T10:55:57.837232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:15.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'8","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:59.072730+0000","last_change":"2024-05-12T10:49:54.609239+0000","last_active":"2024-05-12T10:57:59.072730+0000","last_peered":"2024-05-12T10:57:59.072730+0000","last_clean":"2024-05-12T10:57:59.072730+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:57:59.072730+0000","last_undegraded":"2024-05-12T10:57:59.072730+0000","last_fullsized":"2024-05-12T10:57:59.072730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:12:54.169428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'281","reported_seq":447,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.933589+0000","last_change":"2024-05-12T10:49:59.656739+0000","last_active":"2024-05-12T10:58:01.933589+0000","last_peered":"2024-05-12T10:58:01.933589+0000","last_clean":"2024-05-12T10:58:01.933589+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:58:01.933589+0000","last_undegraded":"2024-05-12T10:58:01.933589+0000","last_fullsized":"2024-05-12T10:58:01.933589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:05.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831123+0000","last_change":"2024-05-12T10:49:55.626312+0000","last_active":"2024-05-12T10:56:12.831123+0000","last_peered":"2024-05-12T10:56:12.831123+0000","last_clean":"2024-05-12T10:56:12.831123+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:56:12.831123+0000","last_undegraded":"2024-05-12T10:56:12.831123+0000","last_fullsized":"2024-05-12T10:56:12.831123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:36.639971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.852660+0000","last_change":"2024-05-12T10:49:54.640819+0000","last_active":"2024-05-12T10:55:57.852660+0000","last_peered":"2024-05-12T10:55:57.852660+0000","last_clean":"2024-05-12T10:55:57.852660+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:55:57.852660+0000","last_undegraded":"2024-05-12T10:55:57.852660+0000","last_fullsized":"2024-05-12T10:55:57.852660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:01.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'345","reported_seq":555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.898435+0000","last_change":"2024-05-12T10:50:00.384347+0000","last_active":"2024-05-12T10:58:01.898435+0000","last_peered":"2024-05-12T10:58:01.898435+0000","last_clean":"2024-05-12T10:58:01.898435+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:58:01.898435+0000","last_undegraded":"2024-05-12T10:58:01.898435+0000","last_fullsized":"2024-05-12T10:58:01.898435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:30.794704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.894992+0000","last_change":"2024-05-12T10:50:36.847396+0000","last_active":"2024-05-12T10:54:47.894992+0000","last_peered":"2024-05-12T10:54:47.894992+0000","last_clean":"2024-05-12T10:54:47.894992+0000","last_became_active":"2024-05-12T10:50:36.847173+0000","last_became_peered":"2024-05-12T10:50:36.847173+0000","last_unstale":"2024-05-12T10:54:47.894992+0000","last_undegraded":"2024-05-12T10:54:47.894992+0000","last_fullsized":"2024-05-12T10:54:47.894992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:33:38.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856683+0000","last_change":"2024-05-12T10:49:54.648333+0000","last_active":"2024-05-12T10:56:12.856683+0000","last_peered":"2024-05-12T10:56:12.856683+0000","last_clean":"2024-05-12T10:56:12.856683+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:56:12.856683+0000","last_undegraded":"2024-05-12T10:56:12.856683+0000","last_fullsized":"2024-05-12T10:56:12.856683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:29.355444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:47.851335+0000","last_change":"2024-05-12T10:49:45.547469+0000","last_active":"2024-05-12T10:55:47.851335+0000","last_peered":"2024-05-12T10:55:47.851335+0000","last_clean":"2024-05-12T10:55:47.851335+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:55:47.851335+0000","last_undegraded":"2024-05-12T10:55:47.851335+0000","last_fullsized":"2024-05-12T10:55:47.851335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_clean_scrub_stamp":"2024-05-12T10:49:43.953472+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:44:15.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'290","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.940955+0000","last_change":"2024-05-12T10:50:00.399288+0000","last_active":"2024-05-12T10:58:01.940955+0000","last_peered":"2024-05-12T10:58:01.940955+0000","last_clean":"2024-05-12T10:58:01.940955+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:58:01.940955+0000","last_undegraded":"2024-05-12T10:58:01.940955+0000","last_fullsized":"2024-05-12T10:58:01.940955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:26.959086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835074+0000","last_change":"2024-05-12T10:49:55.639605+0000","last_active":"2024-05-12T10:54:27.835074+0000","last_peered":"2024-05-12T10:54:27.835074+0000","last_clean":"2024-05-12T10:54:27.835074+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:54:27.835074+0000","last_undegraded":"2024-05-12T10:54:27.835074+0000","last_fullsized":"2024-05-12T10:54:27.835074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:46:26.585195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.883531+0000","last_change":"2024-05-12T10:49:54.654999+0000","last_active":"2024-05-12T10:54:27.883531+0000","last_peered":"2024-05-12T10:54:27.883531+0000","last_clean":"2024-05-12T10:54:27.883531+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:54:27.883531+0000","last_undegraded":"2024-05-12T10:54:27.883531+0000","last_fullsized":"2024-05-12T10:54:27.883531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:00:20.115739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'291","reported_seq":475,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.907983+0000","last_change":"2024-05-12T10:50:00.393017+0000","last_active":"2024-05-12T10:58:01.907983+0000","last_peered":"2024-05-12T10:58:01.907983+0000","last_clean":"2024-05-12T10:58:01.907983+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:58:01.907983+0000","last_undegraded":"2024-05-12T10:58:01.907983+0000","last_fullsized":"2024-05-12T10:58:01.907983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:01:02.394572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:07.899725+0000","last_change":"2024-05-12T10:50:36.844615+0000","last_active":"2024-05-12T10:55:07.899725+0000","last_peered":"2024-05-12T10:55:07.899725+0000","last_clean":"2024-05-12T10:55:07.899725+0000","last_became_active":"2024-05-12T10:50:36.844312+0000","last_became_peered":"2024-05-12T10:50:36.844312+0000","last_unstale":"2024-05-12T10:55:07.899725+0000","last_undegraded":"2024-05-12T10:55:07.899725+0000","last_fullsized":"2024-05-12T10:55:07.899725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:54:38.598097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.813649+0000","last_change":"2024-05-12T10:49:54.628492+0000","last_active":"2024-05-12T10:54:27.813649+0000","last_peered":"2024-05-12T10:54:27.813649+0000","last_clean":"2024-05-12T10:54:27.813649+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:54:27.813649+0000","last_undegraded":"2024-05-12T10:54:27.813649+0000","last_fullsized":"2024-05-12T10:54:27.813649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:35:38.949401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'266","reported_seq":432,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.943209+0000","last_change":"2024-05-12T10:49:59.657783+0000","last_active":"2024-05-12T10:58:01.943209+0000","last_peered":"2024-05-12T10:58:01.943209+0000","last_clean":"2024-05-12T10:58:01.943209+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:58:01.943209+0000","last_undegraded":"2024-05-12T10:58:01.943209+0000","last_fullsized":"2024-05-12T10:58:01.943209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:51:21.103458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835147+0000","last_change":"2024-05-12T10:49:55.646246+0000","last_active":"2024-05-12T10:54:27.835147+0000","last_peered":"2024-05-12T10:54:27.835147+0000","last_clean":"2024-05-12T10:54:27.835147+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:54:27.835147+0000","last_undegraded":"2024-05-12T10:54:27.835147+0000","last_fullsized":"2024-05-12T10:54:27.835147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:32.142128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.883564+0000","last_change":"2024-05-12T10:49:54.610076+0000","last_active":"2024-05-12T10:54:27.883564+0000","last_peered":"2024-05-12T10:54:27.883564+0000","last_clean":"2024-05-12T10:54:27.883564+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:54:27.883564+0000","last_undegraded":"2024-05-12T10:54:27.883564+0000","last_fullsized":"2024-05-12T10:54:27.883564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:12:04.400894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'323","reported_seq":517,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.901879+0000","last_change":"2024-05-12T10:50:00.386172+0000","last_active":"2024-05-12T10:58:01.901879+0000","last_peered":"2024-05-12T10:58:01.901879+0000","last_clean":"2024-05-12T10:58:01.901879+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:58:01.901879+0000","last_undegraded":"2024-05-12T10:58:01.901879+0000","last_fullsized":"2024-05-12T10:58:01.901879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:06:17.550197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835124+0000","last_change":"2024-05-12T10:49:55.646249+0000","last_active":"2024-05-12T10:54:27.835124+0000","last_peered":"2024-05-12T10:54:27.835124+0000","last_clean":"2024-05-12T10:54:27.835124+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:54:27.835124+0000","last_undegraded":"2024-05-12T10:54:27.835124+0000","last_fullsized":"2024-05-12T10:54:27.835124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:15.036675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.841354+0000","last_change":"2024-05-12T10:49:54.621293+0000","last_active":"2024-05-12T10:54:27.841354+0000","last_peered":"2024-05-12T10:54:27.841354+0000","last_clean":"2024-05-12T10:54:27.841354+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:54:27.841354+0000","last_undegraded":"2024-05-12T10:54:27.841354+0000","last_fullsized":"2024-05-12T10:54:27.841354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:45:33.341215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'269","reported_seq":427,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.764286+0000","last_change":"2024-05-12T10:49:59.673656+0000","last_active":"2024-05-12T10:58:01.764286+0000","last_peered":"2024-05-12T10:58:01.764286+0000","last_clean":"2024-05-12T10:58:01.764286+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:58:01.764286+0000","last_undegraded":"2024-05-12T10:58:01.764286+0000","last_fullsized":"2024-05-12T10:58:01.764286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:38.364434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":548864,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836743+0000","last_change":"2024-05-12T10:49:55.646526+0000","last_active":"2024-05-12T10:54:37.836743+0000","last_peered":"2024-05-12T10:54:37.836743+0000","last_clean":"2024-05-12T10:54:37.836743+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:54:37.836743+0000","last_undegraded":"2024-05-12T10:54:37.836743+0000","last_fullsized":"2024-05-12T10:54:37.836743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:56:52.102442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.884467+0000","last_change":"2024-05-12T10:49:54.617906+0000","last_active":"2024-05-12T10:54:37.884467+0000","last_peered":"2024-05-12T10:54:37.884467+0000","last_clean":"2024-05-12T10:54:37.884467+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:54:37.884467+0000","last_undegraded":"2024-05-12T10:54:37.884467+0000","last_fullsized":"2024-05-12T10:54:37.884467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:26:35.150963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'374","reported_seq":598,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.957230+0000","last_change":"2024-05-12T10:49:59.671791+0000","last_active":"2024-05-12T10:58:01.957230+0000","last_peered":"2024-05-12T10:58:01.957230+0000","last_clean":"2024-05-12T10:58:01.957230+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:58:01.957230+0000","last_undegraded":"2024-05-12T10:58:01.957230+0000","last_fullsized":"2024-05-12T10:58:01.957230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:27.425708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":819200,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.839212+0000","last_change":"2024-05-12T10:49:55.637810+0000","last_active":"2024-05-12T10:54:37.839212+0000","last_peered":"2024-05-12T10:54:37.839212+0000","last_clean":"2024-05-12T10:54:37.839212+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:54:37.839212+0000","last_undegraded":"2024-05-12T10:54:37.839212+0000","last_fullsized":"2024-05-12T10:54:37.839212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:52.001497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.839247+0000","last_change":"2024-05-12T10:49:54.637728+0000","last_active":"2024-05-12T10:54:37.839247+0000","last_peered":"2024-05-12T10:54:37.839247+0000","last_clean":"2024-05-12T10:54:37.839247+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:54:37.839247+0000","last_undegraded":"2024-05-12T10:54:37.839247+0000","last_fullsized":"2024-05-12T10:54:37.839247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:39.996419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'283","reported_seq":453,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.948262+0000","last_change":"2024-05-12T10:50:00.383444+0000","last_active":"2024-05-12T10:58:01.948262+0000","last_peered":"2024-05-12T10:58:01.948262+0000","last_clean":"2024-05-12T10:58:01.948262+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:58:01.948262+0000","last_undegraded":"2024-05-12T10:58:01.948262+0000","last_fullsized":"2024-05-12T10:58:01.948262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:55:04.226848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836797+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:54:37.836797+0000","last_peered":"2024-05-12T10:54:37.836797+0000","last_clean":"2024-05-12T10:54:37.836797+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:54:37.836797+0000","last_undegraded":"2024-05-12T10:54:37.836797+0000","last_fullsized":"2024-05-12T10:54:37.836797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:15:58.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836051+0000","last_change":"2024-05-12T10:49:54.656814+0000","last_active":"2024-05-12T10:54:37.836051+0000","last_peered":"2024-05-12T10:54:37.836051+0000","last_clean":"2024-05-12T10:54:37.836051+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:54:37.836051+0000","last_undegraded":"2024-05-12T10:54:37.836051+0000","last_fullsized":"2024-05-12T10:54:37.836051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:26.660043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'279","reported_seq":450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.861231+0000","last_change":"2024-05-12T10:50:00.390308+0000","last_active":"2024-05-12T10:58:01.861231+0000","last_peered":"2024-05-12T10:58:01.861231+0000","last_clean":"2024-05-12T10:58:01.861231+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:58:01.861231+0000","last_undegraded":"2024-05-12T10:58:01.861231+0000","last_fullsized":"2024-05-12T10:58:01.861231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:43.650956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814290+0000","last_change":"2024-05-12T10:49:55.628907+0000","last_active":"2024-05-12T10:54:37.814290+0000","last_peered":"2024-05-12T10:54:37.814290+0000","last_clean":"2024-05-12T10:54:37.814290+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:54:37.814290+0000","last_undegraded":"2024-05-12T10:54:37.814290+0000","last_fullsized":"2024-05-12T10:54:37.814290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:13:50.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814322+0000","last_change":"2024-05-12T10:49:54.626002+0000","last_active":"2024-05-12T10:54:37.814322+0000","last_peered":"2024-05-12T10:54:37.814322+0000","last_clean":"2024-05-12T10:54:37.814322+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:54:37.814322+0000","last_undegraded":"2024-05-12T10:54:37.814322+0000","last_fullsized":"2024-05-12T10:54:37.814322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:19:19.976387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'329","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.813514+0000","last_change":"2024-05-12T10:50:00.387192+0000","last_active":"2024-05-12T10:58:01.813514+0000","last_peered":"2024-05-12T10:58:01.813514+0000","last_clean":"2024-05-12T10:58:01.813514+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:58:01.813514+0000","last_undegraded":"2024-05-12T10:58:01.813514+0000","last_fullsized":"2024-05-12T10:58:01.813514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:15:23.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.842525+0000","last_change":"2024-05-12T10:49:55.634551+0000","last_active":"2024-05-12T10:54:47.842525+0000","last_peered":"2024-05-12T10:54:47.842525+0000","last_clean":"2024-05-12T10:54:47.842525+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:54:47.842525+0000","last_undegraded":"2024-05-12T10:54:47.842525+0000","last_fullsized":"2024-05-12T10:54:47.842525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:10:52.477145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'1907","reported_seq":1938,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:27.469074+0000","last_change":"2024-05-12T10:49:54.634748+0000","last_active":"2024-05-12T10:58:27.469074+0000","last_peered":"2024-05-12T10:58:27.469074+0000","last_clean":"2024-05-12T10:58:27.469074+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:58:27.469074+0000","last_undegraded":"2024-05-12T10:58:27.469074+0000","last_fullsized":"2024-05-12T10:58:27.469074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1907,"log_dups_size":0,"ondisk_log_size":1907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:39:16.646133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3827324,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1907,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'296","reported_seq":480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.926093+0000","last_change":"2024-05-12T10:49:59.671405+0000","last_active":"2024-05-12T10:58:01.926093+0000","last_peered":"2024-05-12T10:58:01.926093+0000","last_clean":"2024-05-12T10:58:01.926093+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:58:01.926093+0000","last_undegraded":"2024-05-12T10:58:01.926093+0000","last_fullsized":"2024-05-12T10:58:01.926093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:06:34.170753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.842947+0000","last_change":"2024-05-12T10:49:55.634686+0000","last_active":"2024-05-12T10:54:37.842947+0000","last_peered":"2024-05-12T10:54:37.842947+0000","last_clean":"2024-05-12T10:54:37.842947+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:54:37.842947+0000","last_undegraded":"2024-05-12T10:54:37.842947+0000","last_fullsized":"2024-05-12T10:54:37.842947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:25:04.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'8","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:12.886479+0000","last_change":"2024-05-12T10:49:54.656012+0000","last_active":"2024-05-12T10:57:12.886479+0000","last_peered":"2024-05-12T10:57:12.886479+0000","last_clean":"2024-05-12T10:57:12.886479+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:57:12.886479+0000","last_undegraded":"2024-05-12T10:57:12.886479+0000","last_fullsized":"2024-05-12T10:57:12.886479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:29.253250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'304","reported_seq":503,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.906496+0000","last_change":"2024-05-12T10:49:59.672820+0000","last_active":"2024-05-12T10:58:01.906496+0000","last_peered":"2024-05-12T10:58:01.906496+0000","last_clean":"2024-05-12T10:58:01.906496+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:58:01.906496+0000","last_undegraded":"2024-05-12T10:58:01.906496+0000","last_fullsized":"2024-05-12T10:58:01.906496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:49:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":716800,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.815288+0000","last_change":"2024-05-12T10:49:55.620541+0000","last_active":"2024-05-12T10:54:47.815288+0000","last_peered":"2024-05-12T10:54:47.815288+0000","last_clean":"2024-05-12T10:54:47.815288+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:54:47.815288+0000","last_undegraded":"2024-05-12T10:54:47.815288+0000","last_fullsized":"2024-05-12T10:54:47.815288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:11.742829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.837479+0000","last_change":"2024-05-12T10:49:54.651289+0000","last_active":"2024-05-12T10:54:47.837479+0000","last_peered":"2024-05-12T10:54:47.837479+0000","last_clean":"2024-05-12T10:54:47.837479+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:54:47.837479+0000","last_undegraded":"2024-05-12T10:54:47.837479+0000","last_fullsized":"2024-05-12T10:54:47.837479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:33:24.087763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'307","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.889067+0000","last_change":"2024-05-12T10:50:36.855844+0000","last_active":"2024-05-12T10:58:01.889067+0000","last_peered":"2024-05-12T10:58:01.889067+0000","last_clean":"2024-05-12T10:58:01.889067+0000","last_became_active":"2024-05-12T10:50:36.855397+0000","last_became_peered":"2024-05-12T10:50:36.855397+0000","last_unstale":"2024-05-12T10:58:01.889067+0000","last_undegraded":"2024-05-12T10:58:01.889067+0000","last_fullsized":"2024-05-12T10:58:01.889067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:14:10.664926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.837469+0000","last_change":"2024-05-12T10:49:55.626645+0000","last_active":"2024-05-12T10:54:47.837469+0000","last_peered":"2024-05-12T10:54:47.837469+0000","last_clean":"2024-05-12T10:54:47.837469+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:54:47.837469+0000","last_undegraded":"2024-05-12T10:54:47.837469+0000","last_fullsized":"2024-05-12T10:54:47.837469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:41.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.850647+0000","last_change":"2024-05-12T10:49:54.654822+0000","last_active":"2024-05-12T10:54:47.850647+0000","last_peered":"2024-05-12T10:54:47.850647+0000","last_clean":"2024-05-12T10:54:47.850647+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:54:47.850647+0000","last_undegraded":"2024-05-12T10:54:47.850647+0000","last_fullsized":"2024-05-12T10:54:47.850647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:52:07.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'332","reported_seq":530,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.938963+0000","last_change":"2024-05-12T10:50:00.396453+0000","last_active":"2024-05-12T10:58:01.938963+0000","last_peered":"2024-05-12T10:58:01.938963+0000","last_clean":"2024-05-12T10:58:01.938963+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:58:01.938963+0000","last_undegraded":"2024-05-12T10:58:01.938963+0000","last_fullsized":"2024-05-12T10:58:01.938963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:40.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'283","reported_seq":465,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.940540+0000","last_change":"2024-05-12T10:50:00.390477+0000","last_active":"2024-05-12T10:58:01.940540+0000","last_peered":"2024-05-12T10:58:01.940540+0000","last_clean":"2024-05-12T10:58:01.940540+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:58:01.940540+0000","last_undegraded":"2024-05-12T10:58:01.940540+0000","last_fullsized":"2024-05-12T10:58:01.940540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:20:19.551216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":643072,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:12.886432+0000","last_change":"2024-05-12T10:49:55.619984+0000","last_active":"2024-05-12T10:57:12.886432+0000","last_peered":"2024-05-12T10:57:12.886432+0000","last_clean":"2024-05-12T10:57:12.886432+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:57:12.886432+0000","last_undegraded":"2024-05-12T10:57:12.886432+0000","last_fullsized":"2024-05-12T10:57:12.886432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:21:34.136203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.837419+0000","last_change":"2024-05-12T10:49:54.656580+0000","last_active":"2024-05-12T10:54:47.837419+0000","last_peered":"2024-05-12T10:54:47.837419+0000","last_clean":"2024-05-12T10:54:47.837419+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:54:47.837419+0000","last_undegraded":"2024-05-12T10:54:47.837419+0000","last_fullsized":"2024-05-12T10:54:47.837419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:43:32.603999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'272","reported_seq":449,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.950582+0000","last_change":"2024-05-12T10:49:59.681648+0000","last_active":"2024-05-12T10:58:01.950582+0000","last_peered":"2024-05-12T10:58:01.950582+0000","last_clean":"2024-05-12T10:58:01.950582+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:58:01.950582+0000","last_undegraded":"2024-05-12T10:58:01.950582+0000","last_fullsized":"2024-05-12T10:58:01.950582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:54.912836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.814669+0000","last_change":"2024-05-12T10:49:55.617393+0000","last_active":"2024-05-12T10:54:47.814669+0000","last_peered":"2024-05-12T10:54:47.814669+0000","last_clean":"2024-05-12T10:54:47.814669+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:54:47.814669+0000","last_undegraded":"2024-05-12T10:54:47.814669+0000","last_fullsized":"2024-05-12T10:54:47.814669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:51.584695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.814701+0000","last_change":"2024-05-12T10:49:54.637393+0000","last_active":"2024-05-12T10:54:47.814701+0000","last_peered":"2024-05-12T10:54:47.814701+0000","last_clean":"2024-05-12T10:54:47.814701+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:54:47.814701+0000","last_undegraded":"2024-05-12T10:54:47.814701+0000","last_fullsized":"2024-05-12T10:54:47.814701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:44:00.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.852132+0000","last_change":"2024-05-12T10:49:54.636945+0000","last_active":"2024-05-12T10:54:57.852132+0000","last_peered":"2024-05-12T10:54:57.852132+0000","last_clean":"2024-05-12T10:54:57.852132+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:54:57.852132+0000","last_undegraded":"2024-05-12T10:54:57.852132+0000","last_fullsized":"2024-05-12T10:54:57.852132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:34:25.927458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.816216+0000","last_change":"2024-05-12T10:49:55.627105+0000","last_active":"2024-05-12T10:54:57.816216+0000","last_peered":"2024-05-12T10:54:57.816216+0000","last_clean":"2024-05-12T10:54:57.816216+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:54:57.816216+0000","last_undegraded":"2024-05-12T10:54:57.816216+0000","last_fullsized":"2024-05-12T10:54:57.816216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:00:09.334541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'308","reported_seq":502,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.834536+0000","last_change":"2024-05-12T10:49:59.659142+0000","last_active":"2024-05-12T10:58:01.834536+0000","last_peered":"2024-05-12T10:58:01.834536+0000","last_clean":"2024-05-12T10:58:01.834536+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:58:01.834536+0000","last_undegraded":"2024-05-12T10:58:01.834536+0000","last_fullsized":"2024-05-12T10:58:01.834536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:40.443593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.815773+0000","last_change":"2024-05-12T10:49:54.632224+0000","last_active":"2024-05-12T10:54:57.815773+0000","last_peered":"2024-05-12T10:54:57.815773+0000","last_clean":"2024-05-12T10:54:57.815773+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:54:57.815773+0000","last_undegraded":"2024-05-12T10:54:57.815773+0000","last_fullsized":"2024-05-12T10:54:57.815773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:27:39.637678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.845878+0000","last_change":"2024-05-12T10:49:55.633243+0000","last_active":"2024-05-12T10:54:57.845878+0000","last_peered":"2024-05-12T10:54:57.845878+0000","last_clean":"2024-05-12T10:54:57.845878+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:54:57.845878+0000","last_undegraded":"2024-05-12T10:54:57.845878+0000","last_fullsized":"2024-05-12T10:54:57.845878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:14.239020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'317","reported_seq":514,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.897764+0000","last_change":"2024-05-12T10:49:59.655807+0000","last_active":"2024-05-12T10:58:01.897764+0000","last_peered":"2024-05-12T10:58:01.897764+0000","last_clean":"2024-05-12T10:58:01.897764+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:58:01.897764+0000","last_undegraded":"2024-05-12T10:58:01.897764+0000","last_fullsized":"2024-05-12T10:58:01.897764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:12.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.861868+0000","last_change":"2024-05-12T10:49:55.637106+0000","last_active":"2024-05-12T10:56:12.861868+0000","last_peered":"2024-05-12T10:56:12.861868+0000","last_clean":"2024-05-12T10:56:12.861868+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:56:12.861868+0000","last_undegraded":"2024-05-12T10:56:12.861868+0000","last_fullsized":"2024-05-12T10:56:12.861868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:22:07.477677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.908806+0000","last_change":"2024-05-12T10:49:55.618952+0000","last_active":"2024-05-12T10:56:12.908806+0000","last_peered":"2024-05-12T10:56:12.908806+0000","last_clean":"2024-05-12T10:56:12.908806+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:56:12.908806+0000","last_undegraded":"2024-05-12T10:56:12.908806+0000","last_fullsized":"2024-05-12T10:56:12.908806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:38:10.693066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856628+0000","last_change":"2024-05-12T10:49:55.623916+0000","last_active":"2024-05-12T10:56:12.856628+0000","last_peered":"2024-05-12T10:56:12.856628+0000","last_clean":"2024-05-12T10:56:12.856628+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:56:12.856628+0000","last_undegraded":"2024-05-12T10:56:12.856628+0000","last_fullsized":"2024-05-12T10:56:12.856628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:06:14.434631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831149+0000","last_change":"2024-05-12T10:49:55.620278+0000","last_active":"2024-05-12T10:56:12.831149+0000","last_peered":"2024-05-12T10:56:12.831149+0000","last_clean":"2024-05-12T10:56:12.831149+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:56:12.831149+0000","last_undegraded":"2024-05-12T10:56:12.831149+0000","last_fullsized":"2024-05-12T10:56:12.831149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:59.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811377+0000","last_change":"2024-05-12T10:49:55.626216+0000","last_active":"2024-05-12T10:54:17.811377+0000","last_peered":"2024-05-12T10:54:17.811377+0000","last_clean":"2024-05-12T10:54:17.811377+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:54:17.811377+0000","last_undegraded":"2024-05-12T10:54:17.811377+0000","last_fullsized":"2024-05-12T10:54:17.811377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:52:14.438331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812588+0000","last_change":"2024-05-12T10:49:55.622085+0000","last_active":"2024-05-12T10:54:17.812588+0000","last_peered":"2024-05-12T10:54:17.812588+0000","last_clean":"2024-05-12T10:54:17.812588+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:54:17.812588+0000","last_undegraded":"2024-05-12T10:54:17.812588+0000","last_fullsized":"2024-05-12T10:54:17.812588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:41:42.558506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.836134+0000","last_change":"2024-05-12T10:50:36.856467+0000","last_active":"2024-05-12T10:54:17.836134+0000","last_peered":"2024-05-12T10:54:17.836134+0000","last_clean":"2024-05-12T10:54:17.836134+0000","last_became_active":"2024-05-12T10:50:36.855517+0000","last_became_peered":"2024-05-12T10:50:36.855517+0000","last_unstale":"2024-05-12T10:54:17.836134+0000","last_undegraded":"2024-05-12T10:54:17.836134+0000","last_fullsized":"2024-05-12T10:54:17.836134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:35.215695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811397+0000","last_change":"2024-05-12T10:49:55.626353+0000","last_active":"2024-05-12T10:54:17.811397+0000","last_peered":"2024-05-12T10:54:17.811397+0000","last_clean":"2024-05-12T10:54:17.811397+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:54:17.811397+0000","last_undegraded":"2024-05-12T10:54:17.811397+0000","last_fullsized":"2024-05-12T10:54:17.811397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:58.905284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.832667+0000","last_change":"2024-05-12T10:49:55.621110+0000","last_active":"2024-05-12T10:54:17.832667+0000","last_peered":"2024-05-12T10:54:17.832667+0000","last_clean":"2024-05-12T10:54:17.832667+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:54:17.832667+0000","last_undegraded":"2024-05-12T10:54:17.832667+0000","last_fullsized":"2024-05-12T10:54:17.832667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:12:36.369923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.812357+0000","last_change":"2024-05-12T10:49:55.626913+0000","last_active":"2024-05-12T10:54:27.812357+0000","last_peered":"2024-05-12T10:54:27.812357+0000","last_clean":"2024-05-12T10:54:27.812357+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:54:27.812357+0000","last_undegraded":"2024-05-12T10:54:27.812357+0000","last_fullsized":"2024-05-12T10:54:27.812357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:27:08.492294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.834327+0000","last_change":"2024-05-12T10:49:55.629992+0000","last_active":"2024-05-12T10:54:27.834327+0000","last_peered":"2024-05-12T10:54:27.834327+0000","last_clean":"2024-05-12T10:54:27.834327+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:54:27.834327+0000","last_undegraded":"2024-05-12T10:54:27.834327+0000","last_fullsized":"2024-05-12T10:54:27.834327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:31.454363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.813293+0000","last_change":"2024-05-12T10:49:55.620821+0000","last_active":"2024-05-12T10:54:27.813293+0000","last_peered":"2024-05-12T10:54:27.813293+0000","last_clean":"2024-05-12T10:54:27.813293+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:54:27.813293+0000","last_undegraded":"2024-05-12T10:54:27.813293+0000","last_fullsized":"2024-05-12T10:54:27.813293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:53.597215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.837690+0000","last_change":"2024-05-12T10:49:55.646368+0000","last_active":"2024-05-12T10:54:27.837690+0000","last_peered":"2024-05-12T10:54:27.837690+0000","last_clean":"2024-05-12T10:54:27.837690+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:54:27.837690+0000","last_undegraded":"2024-05-12T10:54:27.837690+0000","last_fullsized":"2024-05-12T10:54:27.837690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:21:04.313921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835101+0000","last_change":"2024-05-12T10:49:55.633122+0000","last_active":"2024-05-12T10:54:27.835101+0000","last_peered":"2024-05-12T10:54:27.835101+0000","last_clean":"2024-05-12T10:54:27.835101+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:54:27.835101+0000","last_undegraded":"2024-05-12T10:54:27.835101+0000","last_fullsized":"2024-05-12T10:54:27.835101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:25:19.563648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.884507+0000","last_change":"2024-05-12T10:49:55.635394+0000","last_active":"2024-05-12T10:54:37.884507+0000","last_peered":"2024-05-12T10:54:37.884507+0000","last_clean":"2024-05-12T10:54:37.884507+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:54:37.884507+0000","last_undegraded":"2024-05-12T10:54:37.884507+0000","last_fullsized":"2024-05-12T10:54:37.884507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:41:58.478292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836122+0000","last_change":"2024-05-12T10:49:55.626485+0000","last_active":"2024-05-12T10:54:37.836122+0000","last_peered":"2024-05-12T10:54:37.836122+0000","last_clean":"2024-05-12T10:54:37.836122+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:54:37.836122+0000","last_undegraded":"2024-05-12T10:54:37.836122+0000","last_fullsized":"2024-05-12T10:54:37.836122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:17.942339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.835959+0000","last_change":"2024-05-12T10:49:55.618820+0000","last_active":"2024-05-12T10:54:37.835959+0000","last_peered":"2024-05-12T10:54:37.835959+0000","last_clean":"2024-05-12T10:54:37.835959+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:54:37.835959+0000","last_undegraded":"2024-05-12T10:54:37.835959+0000","last_fullsized":"2024-05-12T10:54:37.835959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:23:00.474438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814505+0000","last_change":"2024-05-12T10:49:55.626429+0000","last_active":"2024-05-12T10:54:37.814505+0000","last_peered":"2024-05-12T10:54:37.814505+0000","last_clean":"2024-05-12T10:54:37.814505+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:54:37.814505+0000","last_undegraded":"2024-05-12T10:54:37.814505+0000","last_fullsized":"2024-05-12T10:54:37.814505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:40:02.709729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814258+0000","last_change":"2024-05-12T10:49:55.612139+0000","last_active":"2024-05-12T10:54:37.814258+0000","last_peered":"2024-05-12T10:54:37.814258+0000","last_clean":"2024-05-12T10:54:37.814258+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:54:37.814258+0000","last_undegraded":"2024-05-12T10:54:37.814258+0000","last_fullsized":"2024-05-12T10:54:37.814258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:57:34.138392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.814715+0000","last_change":"2024-05-12T10:49:55.631137+0000","last_active":"2024-05-12T10:54:47.814715+0000","last_peered":"2024-05-12T10:54:47.814715+0000","last_clean":"2024-05-12T10:54:47.814715+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:54:47.814715+0000","last_undegraded":"2024-05-12T10:54:47.814715+0000","last_fullsized":"2024-05-12T10:54:47.814715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:04.390314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.844400+0000","last_change":"2024-05-12T10:49:55.643416+0000","last_active":"2024-05-12T10:54:47.844400+0000","last_peered":"2024-05-12T10:54:47.844400+0000","last_clean":"2024-05-12T10:54:47.844400+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:54:47.844400+0000","last_undegraded":"2024-05-12T10:54:47.844400+0000","last_fullsized":"2024-05-12T10:54:47.844400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:58.632966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.850612+0000","last_change":"2024-05-12T10:49:55.635847+0000","last_active":"2024-05-12T10:54:47.850612+0000","last_peered":"2024-05-12T10:54:47.850612+0000","last_clean":"2024-05-12T10:54:47.850612+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:54:47.850612+0000","last_undegraded":"2024-05-12T10:54:47.850612+0000","last_fullsized":"2024-05-12T10:54:47.850612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:57:51.222099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:04.930755+0000","last_change":"2024-05-12T10:49:55.641921+0000","last_active":"2024-05-12T10:55:04.930755+0000","last_peered":"2024-05-12T10:55:04.930755+0000","last_clean":"2024-05-12T10:55:04.930755+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:55:04.930755+0000","last_undegraded":"2024-05-12T10:55:04.930755+0000","last_fullsized":"2024-05-12T10:55:04.930755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:44:57.787358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.842584+0000","last_change":"2024-05-12T10:49:55.635853+0000","last_active":"2024-05-12T10:54:47.842584+0000","last_peered":"2024-05-12T10:54:47.842584+0000","last_clean":"2024-05-12T10:54:47.842584+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:54:47.842584+0000","last_undegraded":"2024-05-12T10:54:47.842584+0000","last_fullsized":"2024-05-12T10:54:47.842584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:04:39.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.815740+0000","last_change":"2024-05-12T10:50:36.914559+0000","last_active":"2024-05-12T10:54:57.815740+0000","last_peered":"2024-05-12T10:54:57.815740+0000","last_clean":"2024-05-12T10:54:57.815740+0000","last_became_active":"2024-05-12T10:50:36.914327+0000","last_became_peered":"2024-05-12T10:50:36.914327+0000","last_unstale":"2024-05-12T10:54:57.815740+0000","last_undegraded":"2024-05-12T10:54:57.815740+0000","last_fullsized":"2024-05-12T10:54:57.815740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:47:16.693858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844166+0000","last_change":"2024-05-12T10:49:55.629001+0000","last_active":"2024-05-12T10:54:57.844166+0000","last_peered":"2024-05-12T10:54:57.844166+0000","last_clean":"2024-05-12T10:54:57.844166+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:54:57.844166+0000","last_undegraded":"2024-05-12T10:54:57.844166+0000","last_fullsized":"2024-05-12T10:54:57.844166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:42:39.042271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.839062+0000","last_change":"2024-05-12T10:49:55.625540+0000","last_active":"2024-05-12T10:54:57.839062+0000","last_peered":"2024-05-12T10:54:57.839062+0000","last_clean":"2024-05-12T10:54:57.839062+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:54:57.839062+0000","last_undegraded":"2024-05-12T10:54:57.839062+0000","last_fullsized":"2024-05-12T10:54:57.839062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:35.621918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844222+0000","last_change":"2024-05-12T10:49:55.633576+0000","last_active":"2024-05-12T10:54:57.844222+0000","last_peered":"2024-05-12T10:54:57.844222+0000","last_clean":"2024-05-12T10:54:57.844222+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:54:57.844222+0000","last_undegraded":"2024-05-12T10:54:57.844222+0000","last_fullsized":"2024-05-12T10:54:57.844222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:06:16.255147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.850758+0000","last_change":"2024-05-12T10:49:55.624205+0000","last_active":"2024-05-12T10:55:57.850758+0000","last_peered":"2024-05-12T10:55:57.850758+0000","last_clean":"2024-05-12T10:55:57.850758+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:55:57.850758+0000","last_undegraded":"2024-05-12T10:55:57.850758+0000","last_fullsized":"2024-05-12T10:55:57.850758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:21.895269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831159+0000","last_change":"2024-05-12T10:49:55.610461+0000","last_active":"2024-05-12T10:56:12.831159+0000","last_peered":"2024-05-12T10:56:12.831159+0000","last_clean":"2024-05-12T10:56:12.831159+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:56:12.831159+0000","last_undegraded":"2024-05-12T10:56:12.831159+0000","last_fullsized":"2024-05-12T10:56:12.831159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:44.511895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.852448+0000","last_change":"2024-05-12T10:49:55.608434+0000","last_active":"2024-05-12T10:56:12.852448+0000","last_peered":"2024-05-12T10:56:12.852448+0000","last_clean":"2024-05-12T10:56:12.852448+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:56:12.852448+0000","last_undegraded":"2024-05-12T10:56:12.852448+0000","last_fullsized":"2024-05-12T10:56:12.852448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:17.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.855119+0000","last_change":"2024-05-12T10:49:55.639296+0000","last_active":"2024-05-12T10:56:12.855119+0000","last_peered":"2024-05-12T10:56:12.855119+0000","last_clean":"2024-05-12T10:56:12.855119+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:56:12.855119+0000","last_undegraded":"2024-05-12T10:56:12.855119+0000","last_fullsized":"2024-05-12T10:56:12.855119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:47:15.862328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9475,"ondisk_log_size":9475,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3831519,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2096,"num_write_kb":4004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7823360,"data_stored":7663038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2052,"ondisk_log_size":2052,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542251,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58436,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313404,"statfs":{"total":96636764160,"available":96576925696,"internally_reserved":0,"allocated":913408,"data_stored":716485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542252,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79576,"kb_used_data":4048,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94292264,"statfs":{"total":96636764160,"available":96555278336,"internally_reserved":0,"allocated":4145152,"data_stored":3953061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542252,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53696,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318144,"statfs":{"total":96636764160,"available":96581779456,"internally_reserved":0,"allocated":319488,"data_stored":126179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542254,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45372,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326468,"statfs":{"total":96636764160,"available":96590303232,"internally_reserved":0,"allocated":315392,"data_stored":125773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542252,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97628,"kb_used_data":4052,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94274212,"statfs":{"total":96636764160,"available":96536793088,"internally_reserved":0,"allocated":4149248,"data_stored":3948818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542251,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57860,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313980,"statfs":{"total":96636764160,"available":96577515520,"internally_reserved":0,"allocated":323584,"data_stored":125946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542252,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67524,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94304316,"statfs":{"total":96636764160,"available":96567619584,"internally_reserved":0,"allocated":323584,"data_stored":125745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542252,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58432,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313408,"statfs":{"total":96636764160,"available":96576929792,"internally_reserved":0,"allocated":909312,"data_stored":715829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3854336,"data_stored":3828363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3846144,"data_stored":3828260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:58:29.328 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:58:29.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.506+0000 7f23d3800640 1 Processor -- start 2024-05-12T10:58:29.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.506+0000 7f23d3800640 1 -- start start 2024-05-12T10:58:29.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d3800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23cc152a90 0x7f23cc15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d3800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f23cc0c4920 0x7f23cc0c6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d3800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23cc1593b0 0x7f23cc0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d3800640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f23cc0c4f80 con 0x7f23cc1593b0 2024-05-12T10:58:29.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d3800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f23cc0c4d40 con 0x7f23cc0c4920 2024-05-12T10:58:29.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d3800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f23cc0cae10 con 0x7f23cc152a90 2024-05-12T10:58:29.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d1800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23cc1593b0 0x7f23cc0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d1800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23cc1593b0 0x7f23cc0c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54680/0 (socket says 172.21.15.115:54680) 2024-05-12T10:58:29.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d1800640 1 -- 172.21.15.115:0/303150292 learned_addr learned my addr 172.21.15.115:0/303150292 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:29.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23c3e00640 1 --2- 172.21.15.115:0/303150292 >> v2:172.21.15.134:3300/0 conn(0x7f23cc0c4920 0x7f23cc0c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d0e00640 1 --2- 172.21.15.115:0/303150292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23cc152a90 0x7f23cc15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d1800640 1 -- 172.21.15.115:0/303150292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23cc152a90 msgr2=0x7f23cc15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:29.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d1800640 1 --2- 172.21.15.115:0/303150292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23cc152a90 0x7f23cc15cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d1800640 1 -- 172.21.15.115:0/303150292 >> v2:172.21.15.134:3300/0 conn(0x7f23cc0c4920 msgr2=0x7f23cc0c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:29.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d1800640 1 --2- 172.21.15.115:0/303150292 >> v2:172.21.15.134:3300/0 conn(0x7f23cc0c4920 0x7f23cc0c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.510+0000 7f23d1800640 1 -- 172.21.15.115:0/303150292 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc0ca850 con 0x7f23cc1593b0 2024-05-12T10:58:29.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d1800640 1 --2- 172.21.15.115:0/303150292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23cc1593b0 0x7f23cc0c8f30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f23cc06efc0 tx=0x7f23c401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827bb9d187dc3c72 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:29.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23cbe00640 1 -- 172.21.15.115:0/303150292 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c40a5670 con 0x7f23cc1593b0 2024-05-12T10:58:29.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23cbe00640 1 -- 172.21.15.115:0/303150292 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c40a5810 con 0x7f23cc1593b0 2024-05-12T10:58:29.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23cbe00640 1 -- 172.21.15.115:0/303150292 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c40a5be0 con 0x7f23cc1593b0 2024-05-12T10:58:29.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d3800640 1 -- 172.21.15.115:0/303150292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23cc1593b0 msgr2=0x7f23cc0c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d3800640 1 --2- 172.21.15.115:0/303150292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23cc1593b0 0x7f23cc0c8f30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f23cc06efc0 tx=0x7f23c401c9f0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d3800640 1 -- 172.21.15.115:0/303150292 shutdown_connections 2024-05-12T10:58:29.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d3800640 1 --2- 172.21.15.115:0/303150292 >> v2:172.21.15.134:3300/0 conn(0x7f23cc0c4920 0x7f23cc0c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d3800640 1 --2- 172.21.15.115:0/303150292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23cc1593b0 0x7f23cc0c8f30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d3800640 1 --2- 172.21.15.115:0/303150292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23cc152a90 0x7f23cc15cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d3800640 1 -- 172.21.15.115:0/303150292 >> 172.21.15.115:0/303150292 conn(0x7f23cc0681c0 msgr2=0x7f23cc0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:29.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d3800640 1 -- 172.21.15.115:0/303150292 shutdown_connections 2024-05-12T10:58:29.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d3800640 1 -- 172.21.15.115:0/303150292 wait complete. 2024-05-12T10:58:29.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d3800640 1 Processor -- start 2024-05-12T10:58:29.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.514+0000 7f23d3800640 1 -- start start 2024-05-12T10:58:29.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d3800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23cc0c4920 0x7f23cc14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d3800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23cc152a90 0x7f23cc14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d3800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23cc1593b0 0x7f23cc149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d3800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc159800 con 0x7f23cc0c4920 2024-05-12T10:58:29.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d3800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc15c6a0 con 0x7f23cc152a90 2024-05-12T10:58:29.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d3800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f23cc152e70 con 0x7f23cc1593b0 2024-05-12T10:58:29.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d0e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23cc0c4920 0x7f23cc14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d0e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23cc0c4920 0x7f23cc14fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54684/0 (socket says 172.21.15.115:54684) 2024-05-12T10:58:29.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d0e00640 1 -- 172.21.15.115:0/3326382944 learned_addr learned my addr 172.21.15.115:0/3326382944 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:29.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d1800640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23cc1593b0 0x7f23cc149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23c3e00640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23cc152a90 0x7f23cc14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d0e00640 1 -- 172.21.15.115:0/3326382944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23cc1593b0 msgr2=0x7f23cc149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d0e00640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23cc1593b0 0x7f23cc149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d0e00640 1 -- 172.21.15.115:0/3326382944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23cc152a90 msgr2=0x7f23cc14ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d0e00640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23cc152a90 0x7f23cc14ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d0e00640 1 -- 172.21.15.115:0/3326382944 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc0c5fa0 con 0x7f23cc0c4920 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d0e00640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23cc0c4920 0x7f23cc14fa00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00d800 tx=0x7f23bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23c9600640 1 -- 172.21.15.115:0/3326382944 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc00b6c0 con 0x7f23cc0c4920 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23c9600640 1 -- 172.21.15.115:0/3326382944 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc019070 con 0x7f23cc0c4920 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23c9600640 1 -- 172.21.15.115:0/3326382944 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc00ba60 con 0x7f23cc0c4920 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d3800640 1 -- 172.21.15.115:0/3326382944 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23cc0c4520 con 0x7f23cc0c4920 2024-05-12T10:58:29.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d3800640 1 -- 172.21.15.115:0/3326382944 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23cc155bd0 con 0x7f23cc0c4920 2024-05-12T10:58:29.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23d3800640 1 -- 172.21.15.115:0/3326382944 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23cc069730 con 0x7f23cc0c4920 2024-05-12T10:58:29.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.518+0000 7f23c9600640 1 -- 172.21.15.115:0/3326382944 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f23bc00bc00 con 0x7f23cc0c4920 2024-05-12T10:58:29.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.522+0000 7f23c9600640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f23a806f430 0x7f23a80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.522+0000 7f23c9600640 1 -- 172.21.15.115:0/3326382944 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f23bc08fa90 con 0x7f23cc0c4920 2024-05-12T10:58:29.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.522+0000 7f23c3e00640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f23a806f430 0x7f23a80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.522+0000 7f23c3e00640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f23a806f430 0x7f23a80718f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23cc152760 tx=0x7f23b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:29.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.526+0000 7f23c9600640 1 -- 172.21.15.115:0/3326382944 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f23bc05c610 con 0x7f23cc0c4920 2024-05-12T10:58:29.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.686+0000 7f23d3800640 1 -- 172.21.15.115:0/3326382944 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23cc150fd0 con 0x7f23a806f430 2024-05-12T10:58:29.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.694+0000 7f23c9600640 1 -- 172.21.15.115:0/3326382944 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333410 (secure 0 0 0) 0x7f23cc150fd0 con 0x7f23a806f430 2024-05-12T10:58:29.688 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:58:29.689 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:58:29.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 -- 172.21.15.115:0/3326382944 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f23a806f430 msgr2=0x7f23a80718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f23a806f430 0x7f23a80718f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23cc152760 tx=0x7f23b4008040 comp rx=0 tx=0).stop 2024-05-12T10:58:29.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 -- 172.21.15.115:0/3326382944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23cc0c4920 msgr2=0x7f23cc14fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23cc0c4920 0x7f23cc14fa00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00d800 tx=0x7f23bc00dcc0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 -- 172.21.15.115:0/3326382944 shutdown_connections 2024-05-12T10:58:29.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f23a806f430 0x7f23a80718f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23cc1593b0 0x7f23cc149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23cc152a90 0x7f23cc14ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 --2- 172.21.15.115:0/3326382944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23cc0c4920 0x7f23cc14fa00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 -- 172.21.15.115:0/3326382944 >> 172.21.15.115:0/3326382944 conn(0x7f23cc0681c0 msgr2=0x7f23cc0cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:29.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 -- 172.21.15.115:0/3326382944 shutdown_connections 2024-05-12T10:58:29.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.698+0000 7f23d3800640 1 -- 172.21.15.115:0/3326382944 wait complete. 2024-05-12T10:58:29.708 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-05-12T10:58:27.925565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4421887,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":5197,"num_read_kb":21004346,"num_write":11414,"num_write_kb":25171456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11602,"ondisk_log_size":11602,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":518524,"kb_used_data":11132,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":754456196,"statfs":{"total":773094113280,"available":772563144704,"internally_reserved":0,"allocated":11399168,"data_stored":9837836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":519491121},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4346,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003104"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831179+0000","last_change":"2024-05-12T10:49:54.640093+0000","last_active":"2024-05-12T10:56:12.831179+0000","last_peered":"2024-05-12T10:56:12.831179+0000","last_clean":"2024-05-12T10:56:12.831179+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:56:12.831179+0000","last_undegraded":"2024-05-12T10:56:12.831179+0000","last_fullsized":"2024-05-12T10:56:12.831179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:07:41.639104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.839481+0000","last_change":"2024-05-12T10:49:55.635928+0000","last_active":"2024-05-12T10:55:57.839481+0000","last_peered":"2024-05-12T10:55:57.839481+0000","last_clean":"2024-05-12T10:55:57.839481+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:55:57.839481+0000","last_undegraded":"2024-05-12T10:55:57.839481+0000","last_fullsized":"2024-05-12T10:55:57.839481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:41:30.909036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'315","reported_seq":515,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.842369+0000","last_change":"2024-05-12T10:50:00.396417+0000","last_active":"2024-05-12T10:58:01.842369+0000","last_peered":"2024-05-12T10:58:01.842369+0000","last_clean":"2024-05-12T10:58:01.842369+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:58:01.842369+0000","last_undegraded":"2024-05-12T10:58:01.842369+0000","last_fullsized":"2024-05-12T10:58:01.842369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:27.287617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.839501+0000","last_change":"2024-05-12T10:49:54.619268+0000","last_active":"2024-05-12T10:55:57.839501+0000","last_peered":"2024-05-12T10:55:57.839501+0000","last_clean":"2024-05-12T10:55:57.839501+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:55:57.839501+0000","last_undegraded":"2024-05-12T10:55:57.839501+0000","last_fullsized":"2024-05-12T10:55:57.839501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:50:34.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831171+0000","last_change":"2024-05-12T10:49:55.624986+0000","last_active":"2024-05-12T10:56:12.831171+0000","last_peered":"2024-05-12T10:56:12.831171+0000","last_clean":"2024-05-12T10:56:12.831171+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:56:12.831171+0000","last_undegraded":"2024-05-12T10:56:12.831171+0000","last_fullsized":"2024-05-12T10:56:12.831171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:03:47.220979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'342","reported_seq":562,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.931276+0000","last_change":"2024-05-12T10:49:59.676139+0000","last_active":"2024-05-12T10:58:01.931276+0000","last_peered":"2024-05-12T10:58:01.931276+0000","last_clean":"2024-05-12T10:58:01.931276+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:58:01.931276+0000","last_undegraded":"2024-05-12T10:58:01.931276+0000","last_fullsized":"2024-05-12T10:58:01.931276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:24:15.396258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844325+0000","last_change":"2024-05-12T10:49:54.645331+0000","last_active":"2024-05-12T10:54:57.844325+0000","last_peered":"2024-05-12T10:54:57.844325+0000","last_clean":"2024-05-12T10:54:57.844325+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:54:57.844325+0000","last_undegraded":"2024-05-12T10:54:57.844325+0000","last_fullsized":"2024-05-12T10:54:57.844325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:38:29.023589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.839121+0000","last_change":"2024-05-12T10:49:55.642386+0000","last_active":"2024-05-12T10:54:57.839121+0000","last_peered":"2024-05-12T10:54:57.839121+0000","last_clean":"2024-05-12T10:54:57.839121+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:54:57.839121+0000","last_undegraded":"2024-05-12T10:54:57.839121+0000","last_fullsized":"2024-05-12T10:54:57.839121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:54:40.153070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'284","reported_seq":457,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.898022+0000","last_change":"2024-05-12T10:49:59.679887+0000","last_active":"2024-05-12T10:58:01.898022+0000","last_peered":"2024-05-12T10:58:01.898022+0000","last_clean":"2024-05-12T10:58:01.898022+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:58:01.898022+0000","last_undegraded":"2024-05-12T10:58:01.898022+0000","last_fullsized":"2024-05-12T10:58:01.898022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:25:43.004918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":274,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844272+0000","last_change":"2024-05-12T10:49:54.659229+0000","last_active":"2024-05-12T10:54:57.844272+0000","last_peered":"2024-05-12T10:54:57.844272+0000","last_clean":"2024-05-12T10:54:57.844272+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:54:57.844272+0000","last_undegraded":"2024-05-12T10:54:57.844272+0000","last_fullsized":"2024-05-12T10:54:57.844272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:54:54.658165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.839147+0000","last_change":"2024-05-12T10:49:55.642157+0000","last_active":"2024-05-12T10:54:57.839147+0000","last_peered":"2024-05-12T10:54:57.839147+0000","last_clean":"2024-05-12T10:54:57.839147+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:54:57.839147+0000","last_undegraded":"2024-05-12T10:54:57.839147+0000","last_fullsized":"2024-05-12T10:54:57.839147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:16.232731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'263","reported_seq":429,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.893300+0000","last_change":"2024-05-12T10:49:59.663411+0000","last_active":"2024-05-12T10:58:01.893300+0000","last_peered":"2024-05-12T10:58:01.893300+0000","last_clean":"2024-05-12T10:58:01.893300+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:58:01.893300+0000","last_undegraded":"2024-05-12T10:58:01.893300+0000","last_fullsized":"2024-05-12T10:58:01.893300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:59.136704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.836036+0000","last_change":"2024-05-12T10:49:55.646019+0000","last_active":"2024-05-12T10:54:17.836036+0000","last_peered":"2024-05-12T10:54:17.836036+0000","last_clean":"2024-05-12T10:54:17.836036+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:54:17.836036+0000","last_undegraded":"2024-05-12T10:54:17.836036+0000","last_fullsized":"2024-05-12T10:54:17.836036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:07.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835029+0000","last_change":"2024-05-12T10:49:54.642039+0000","last_active":"2024-05-12T10:54:27.835029+0000","last_peered":"2024-05-12T10:54:27.835029+0000","last_clean":"2024-05-12T10:54:27.835029+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:54:27.835029+0000","last_undegraded":"2024-05-12T10:54:27.835029+0000","last_fullsized":"2024-05-12T10:54:27.835029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:01.155569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'316","reported_seq":520,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.922676+0000","last_change":"2024-05-12T10:49:59.660274+0000","last_active":"2024-05-12T10:58:01.922676+0000","last_peered":"2024-05-12T10:58:01.922676+0000","last_clean":"2024-05-12T10:58:01.922676+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:58:01.922676+0000","last_undegraded":"2024-05-12T10:58:01.922676+0000","last_fullsized":"2024-05-12T10:58:01.922676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:55:12.579645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":737280,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.812386+0000","last_change":"2024-05-12T10:49:55.618128+0000","last_active":"2024-05-12T10:54:27.812386+0000","last_peered":"2024-05-12T10:54:27.812386+0000","last_clean":"2024-05-12T10:54:27.812386+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:54:27.812386+0000","last_undegraded":"2024-05-12T10:54:27.812386+0000","last_fullsized":"2024-05-12T10:54:27.812386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:45.205117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812560+0000","last_change":"2024-05-12T10:49:54.619967+0000","last_active":"2024-05-12T10:54:17.812560+0000","last_peered":"2024-05-12T10:54:17.812560+0000","last_clean":"2024-05-12T10:54:17.812560+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:54:17.812560+0000","last_undegraded":"2024-05-12T10:54:17.812560+0000","last_fullsized":"2024-05-12T10:54:17.812560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:37:10.799631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'296","reported_seq":488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.884554+0000","last_change":"2024-05-12T10:49:59.681931+0000","last_active":"2024-05-12T10:58:01.884554+0000","last_peered":"2024-05-12T10:58:01.884554+0000","last_clean":"2024-05-12T10:58:01.884554+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:58:01.884554+0000","last_undegraded":"2024-05-12T10:58:01.884554+0000","last_fullsized":"2024-05-12T10:58:01.884554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:45:01.542628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811343+0000","last_change":"2024-05-12T10:49:55.615095+0000","last_active":"2024-05-12T10:54:17.811343+0000","last_peered":"2024-05-12T10:54:17.811343+0000","last_clean":"2024-05-12T10:54:17.811343+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:54:17.811343+0000","last_undegraded":"2024-05-12T10:54:17.811343+0000","last_fullsized":"2024-05-12T10:54:17.811343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:51:19.659941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812526+0000","last_change":"2024-05-12T10:49:54.639976+0000","last_active":"2024-05-12T10:54:17.812526+0000","last_peered":"2024-05-12T10:54:17.812526+0000","last_clean":"2024-05-12T10:54:17.812526+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:54:17.812526+0000","last_undegraded":"2024-05-12T10:54:17.812526+0000","last_fullsized":"2024-05-12T10:54:17.812526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:28:37.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'273","reported_seq":446,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.859327+0000","last_change":"2024-05-12T10:50:36.857272+0000","last_active":"2024-05-12T10:58:01.859327+0000","last_peered":"2024-05-12T10:58:01.859327+0000","last_clean":"2024-05-12T10:58:01.859327+0000","last_became_active":"2024-05-12T10:50:36.856826+0000","last_became_peered":"2024-05-12T10:50:36.856826+0000","last_unstale":"2024-05-12T10:58:01.859327+0000","last_undegraded":"2024-05-12T10:58:01.859327+0000","last_fullsized":"2024-05-12T10:58:01.859327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:39:58.339959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.839725+0000","last_change":"2024-05-12T10:49:55.622729+0000","last_active":"2024-05-12T10:54:17.839725+0000","last_peered":"2024-05-12T10:54:17.839725+0000","last_clean":"2024-05-12T10:54:17.839725+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:54:17.839725+0000","last_undegraded":"2024-05-12T10:54:17.839725+0000","last_fullsized":"2024-05-12T10:54:17.839725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:08:29.460684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.833425+0000","last_change":"2024-05-12T10:49:54.639564+0000","last_active":"2024-05-12T10:54:17.833425+0000","last_peered":"2024-05-12T10:54:17.833425+0000","last_clean":"2024-05-12T10:54:17.833425+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:54:17.833425+0000","last_undegraded":"2024-05-12T10:54:17.833425+0000","last_fullsized":"2024-05-12T10:54:17.833425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:54:48.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'296","reported_seq":498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.952784+0000","last_change":"2024-05-12T10:50:36.858842+0000","last_active":"2024-05-12T10:58:01.952784+0000","last_peered":"2024-05-12T10:58:01.952784+0000","last_clean":"2024-05-12T10:58:01.952784+0000","last_became_active":"2024-05-12T10:50:36.857477+0000","last_became_peered":"2024-05-12T10:50:36.857477+0000","last_unstale":"2024-05-12T10:58:01.952784+0000","last_undegraded":"2024-05-12T10:58:01.952784+0000","last_fullsized":"2024-05-12T10:58:01.952784+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:08:55.931301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":700416,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812380+0000","last_change":"2024-05-12T10:49:55.612744+0000","last_active":"2024-05-12T10:54:17.812380+0000","last_peered":"2024-05-12T10:54:17.812380+0000","last_clean":"2024-05-12T10:54:17.812380+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:54:17.812380+0000","last_undegraded":"2024-05-12T10:54:17.812380+0000","last_fullsized":"2024-05-12T10:54:17.812380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:05:06.274277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.836166+0000","last_change":"2024-05-12T10:49:54.643375+0000","last_active":"2024-05-12T10:54:17.836166+0000","last_peered":"2024-05-12T10:54:17.836166+0000","last_clean":"2024-05-12T10:54:17.836166+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:54:17.836166+0000","last_undegraded":"2024-05-12T10:54:17.836166+0000","last_fullsized":"2024-05-12T10:54:17.836166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:56:43.086871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'259","reported_seq":414,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.958352+0000","last_change":"2024-05-12T10:50:00.393325+0000","last_active":"2024-05-12T10:58:01.958352+0000","last_peered":"2024-05-12T10:58:01.958352+0000","last_clean":"2024-05-12T10:58:01.958352+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:58:01.958352+0000","last_undegraded":"2024-05-12T10:58:01.958352+0000","last_fullsized":"2024-05-12T10:58:01.958352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:55.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":532480,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811404+0000","last_change":"2024-05-12T10:49:55.629693+0000","last_active":"2024-05-12T10:54:17.811404+0000","last_peered":"2024-05-12T10:54:17.811404+0000","last_clean":"2024-05-12T10:54:17.811404+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:54:17.811404+0000","last_undegraded":"2024-05-12T10:54:17.811404+0000","last_fullsized":"2024-05-12T10:54:17.811404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:04:13.325079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'33","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:58.766242+0000","last_change":"2024-05-12T10:49:54.629227+0000","last_active":"2024-05-12T10:57:58.766242+0000","last_peered":"2024-05-12T10:57:58.766242+0000","last_clean":"2024-05-12T10:57:58.766242+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:57:58.766242+0000","last_undegraded":"2024-05-12T10:57:58.766242+0000","last_fullsized":"2024-05-12T10:57:58.766242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:03.097527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'270","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:02.118119+0000","last_change":"2024-05-12T10:50:00.396371+0000","last_active":"2024-05-12T10:58:02.118119+0000","last_peered":"2024-05-12T10:58:02.118119+0000","last_clean":"2024-05-12T10:58:02.118119+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:58:02.118119+0000","last_undegraded":"2024-05-12T10:58:02.118119+0000","last_fullsized":"2024-05-12T10:58:02.118119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:41:09.157859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.852358+0000","last_change":"2024-05-12T10:49:55.612069+0000","last_active":"2024-05-12T10:56:12.852358+0000","last_peered":"2024-05-12T10:56:12.852358+0000","last_clean":"2024-05-12T10:56:12.852358+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:56:12.852358+0000","last_undegraded":"2024-05-12T10:56:12.852358+0000","last_fullsized":"2024-05-12T10:56:12.852358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:38.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.855055+0000","last_change":"2024-05-12T10:49:54.639928+0000","last_active":"2024-05-12T10:56:12.855055+0000","last_peered":"2024-05-12T10:56:12.855055+0000","last_clean":"2024-05-12T10:56:12.855055+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:56:12.855055+0000","last_undegraded":"2024-05-12T10:56:12.855055+0000","last_fullsized":"2024-05-12T10:56:12.855055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:59.215089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'261","reported_seq":422,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.956862+0000","last_change":"2024-05-12T10:50:00.383605+0000","last_active":"2024-05-12T10:58:01.956862+0000","last_peered":"2024-05-12T10:58:01.956862+0000","last_clean":"2024-05-12T10:58:01.956862+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:58:01.956862+0000","last_undegraded":"2024-05-12T10:58:01.956862+0000","last_fullsized":"2024-05-12T10:58:01.956862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:28.619988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856714+0000","last_change":"2024-05-12T10:49:55.621201+0000","last_active":"2024-05-12T10:56:12.856714+0000","last_peered":"2024-05-12T10:56:12.856714+0000","last_clean":"2024-05-12T10:56:12.856714+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:56:12.856714+0000","last_undegraded":"2024-05-12T10:56:12.856714+0000","last_fullsized":"2024-05-12T10:56:12.856714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:19:39.117790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.852384+0000","last_change":"2024-05-12T10:49:54.620329+0000","last_active":"2024-05-12T10:56:12.852384+0000","last_peered":"2024-05-12T10:56:12.852384+0000","last_clean":"2024-05-12T10:56:12.852384+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:56:12.852384+0000","last_undegraded":"2024-05-12T10:56:12.852384+0000","last_fullsized":"2024-05-12T10:56:12.852384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:21:10.386830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'282","reported_seq":465,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.960116+0000","last_change":"2024-05-12T10:49:59.655432+0000","last_active":"2024-05-12T10:58:01.960116+0000","last_peered":"2024-05-12T10:58:01.960116+0000","last_clean":"2024-05-12T10:58:01.960116+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:58:01.960116+0000","last_undegraded":"2024-05-12T10:58:01.960116+0000","last_fullsized":"2024-05-12T10:58:01.960116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:27:34.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.860789+0000","last_change":"2024-05-12T10:49:55.628221+0000","last_active":"2024-05-12T10:56:12.860789+0000","last_peered":"2024-05-12T10:56:12.860789+0000","last_clean":"2024-05-12T10:56:12.860789+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:56:12.860789+0000","last_undegraded":"2024-05-12T10:56:12.860789+0000","last_fullsized":"2024-05-12T10:56:12.860789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:54.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856655+0000","last_change":"2024-05-12T10:49:54.652499+0000","last_active":"2024-05-12T10:56:12.856655+0000","last_peered":"2024-05-12T10:56:12.856655+0000","last_clean":"2024-05-12T10:56:12.856655+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:56:12.856655+0000","last_undegraded":"2024-05-12T10:56:12.856655+0000","last_fullsized":"2024-05-12T10:56:12.856655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:14:35.180779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'269","reported_seq":442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.931250+0000","last_change":"2024-05-12T10:49:59.676676+0000","last_active":"2024-05-12T10:58:01.931250+0000","last_peered":"2024-05-12T10:58:01.931250+0000","last_clean":"2024-05-12T10:58:01.931250+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:58:01.931250+0000","last_undegraded":"2024-05-12T10:58:01.931250+0000","last_fullsized":"2024-05-12T10:58:01.931250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:03:13.485130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.837232+0000","last_change":"2024-05-12T10:49:55.610830+0000","last_active":"2024-05-12T10:55:57.837232+0000","last_peered":"2024-05-12T10:55:57.837232+0000","last_clean":"2024-05-12T10:55:57.837232+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:55:57.837232+0000","last_undegraded":"2024-05-12T10:55:57.837232+0000","last_fullsized":"2024-05-12T10:55:57.837232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:15.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'8","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:59.072730+0000","last_change":"2024-05-12T10:49:54.609239+0000","last_active":"2024-05-12T10:57:59.072730+0000","last_peered":"2024-05-12T10:57:59.072730+0000","last_clean":"2024-05-12T10:57:59.072730+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:57:59.072730+0000","last_undegraded":"2024-05-12T10:57:59.072730+0000","last_fullsized":"2024-05-12T10:57:59.072730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:12:54.169428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'281","reported_seq":447,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.933589+0000","last_change":"2024-05-12T10:49:59.656739+0000","last_active":"2024-05-12T10:58:01.933589+0000","last_peered":"2024-05-12T10:58:01.933589+0000","last_clean":"2024-05-12T10:58:01.933589+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:58:01.933589+0000","last_undegraded":"2024-05-12T10:58:01.933589+0000","last_fullsized":"2024-05-12T10:58:01.933589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:05.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831123+0000","last_change":"2024-05-12T10:49:55.626312+0000","last_active":"2024-05-12T10:56:12.831123+0000","last_peered":"2024-05-12T10:56:12.831123+0000","last_clean":"2024-05-12T10:56:12.831123+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:56:12.831123+0000","last_undegraded":"2024-05-12T10:56:12.831123+0000","last_fullsized":"2024-05-12T10:56:12.831123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:36.639971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.852660+0000","last_change":"2024-05-12T10:49:54.640819+0000","last_active":"2024-05-12T10:55:57.852660+0000","last_peered":"2024-05-12T10:55:57.852660+0000","last_clean":"2024-05-12T10:55:57.852660+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:55:57.852660+0000","last_undegraded":"2024-05-12T10:55:57.852660+0000","last_fullsized":"2024-05-12T10:55:57.852660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:01.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'345","reported_seq":555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.898435+0000","last_change":"2024-05-12T10:50:00.384347+0000","last_active":"2024-05-12T10:58:01.898435+0000","last_peered":"2024-05-12T10:58:01.898435+0000","last_clean":"2024-05-12T10:58:01.898435+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:58:01.898435+0000","last_undegraded":"2024-05-12T10:58:01.898435+0000","last_fullsized":"2024-05-12T10:58:01.898435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:30.794704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.894992+0000","last_change":"2024-05-12T10:50:36.847396+0000","last_active":"2024-05-12T10:54:47.894992+0000","last_peered":"2024-05-12T10:54:47.894992+0000","last_clean":"2024-05-12T10:54:47.894992+0000","last_became_active":"2024-05-12T10:50:36.847173+0000","last_became_peered":"2024-05-12T10:50:36.847173+0000","last_unstale":"2024-05-12T10:54:47.894992+0000","last_undegraded":"2024-05-12T10:54:47.894992+0000","last_fullsized":"2024-05-12T10:54:47.894992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:33:38.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856683+0000","last_change":"2024-05-12T10:49:54.648333+0000","last_active":"2024-05-12T10:56:12.856683+0000","last_peered":"2024-05-12T10:56:12.856683+0000","last_clean":"2024-05-12T10:56:12.856683+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:56:12.856683+0000","last_undegraded":"2024-05-12T10:56:12.856683+0000","last_fullsized":"2024-05-12T10:56:12.856683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:29.355444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:47.851335+0000","last_change":"2024-05-12T10:49:45.547469+0000","last_active":"2024-05-12T10:55:47.851335+0000","last_peered":"2024-05-12T10:55:47.851335+0000","last_clean":"2024-05-12T10:55:47.851335+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:55:47.851335+0000","last_undegraded":"2024-05-12T10:55:47.851335+0000","last_fullsized":"2024-05-12T10:55:47.851335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_clean_scrub_stamp":"2024-05-12T10:49:43.953472+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:44:15.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'290","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.940955+0000","last_change":"2024-05-12T10:50:00.399288+0000","last_active":"2024-05-12T10:58:01.940955+0000","last_peered":"2024-05-12T10:58:01.940955+0000","last_clean":"2024-05-12T10:58:01.940955+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:58:01.940955+0000","last_undegraded":"2024-05-12T10:58:01.940955+0000","last_fullsized":"2024-05-12T10:58:01.940955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:26.959086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835074+0000","last_change":"2024-05-12T10:49:55.639605+0000","last_active":"2024-05-12T10:54:27.835074+0000","last_peered":"2024-05-12T10:54:27.835074+0000","last_clean":"2024-05-12T10:54:27.835074+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:54:27.835074+0000","last_undegraded":"2024-05-12T10:54:27.835074+0000","last_fullsized":"2024-05-12T10:54:27.835074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:46:26.585195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.883531+0000","last_change":"2024-05-12T10:49:54.654999+0000","last_active":"2024-05-12T10:54:27.883531+0000","last_peered":"2024-05-12T10:54:27.883531+0000","last_clean":"2024-05-12T10:54:27.883531+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:54:27.883531+0000","last_undegraded":"2024-05-12T10:54:27.883531+0000","last_fullsized":"2024-05-12T10:54:27.883531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:00:20.115739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'291","reported_seq":475,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.907983+0000","last_change":"2024-05-12T10:50:00.393017+0000","last_active":"2024-05-12T10:58:01.907983+0000","last_peered":"2024-05-12T10:58:01.907983+0000","last_clean":"2024-05-12T10:58:01.907983+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:58:01.907983+0000","last_undegraded":"2024-05-12T10:58:01.907983+0000","last_fullsized":"2024-05-12T10:58:01.907983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:01:02.394572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:07.899725+0000","last_change":"2024-05-12T10:50:36.844615+0000","last_active":"2024-05-12T10:55:07.899725+0000","last_peered":"2024-05-12T10:55:07.899725+0000","last_clean":"2024-05-12T10:55:07.899725+0000","last_became_active":"2024-05-12T10:50:36.844312+0000","last_became_peered":"2024-05-12T10:50:36.844312+0000","last_unstale":"2024-05-12T10:55:07.899725+0000","last_undegraded":"2024-05-12T10:55:07.899725+0000","last_fullsized":"2024-05-12T10:55:07.899725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:54:38.598097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.813649+0000","last_change":"2024-05-12T10:49:54.628492+0000","last_active":"2024-05-12T10:54:27.813649+0000","last_peered":"2024-05-12T10:54:27.813649+0000","last_clean":"2024-05-12T10:54:27.813649+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:54:27.813649+0000","last_undegraded":"2024-05-12T10:54:27.813649+0000","last_fullsized":"2024-05-12T10:54:27.813649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:35:38.949401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'266","reported_seq":432,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.943209+0000","last_change":"2024-05-12T10:49:59.657783+0000","last_active":"2024-05-12T10:58:01.943209+0000","last_peered":"2024-05-12T10:58:01.943209+0000","last_clean":"2024-05-12T10:58:01.943209+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:58:01.943209+0000","last_undegraded":"2024-05-12T10:58:01.943209+0000","last_fullsized":"2024-05-12T10:58:01.943209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:51:21.103458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835147+0000","last_change":"2024-05-12T10:49:55.646246+0000","last_active":"2024-05-12T10:54:27.835147+0000","last_peered":"2024-05-12T10:54:27.835147+0000","last_clean":"2024-05-12T10:54:27.835147+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:54:27.835147+0000","last_undegraded":"2024-05-12T10:54:27.835147+0000","last_fullsized":"2024-05-12T10:54:27.835147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:32.142128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.883564+0000","last_change":"2024-05-12T10:49:54.610076+0000","last_active":"2024-05-12T10:54:27.883564+0000","last_peered":"2024-05-12T10:54:27.883564+0000","last_clean":"2024-05-12T10:54:27.883564+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:54:27.883564+0000","last_undegraded":"2024-05-12T10:54:27.883564+0000","last_fullsized":"2024-05-12T10:54:27.883564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:12:04.400894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'323","reported_seq":517,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.901879+0000","last_change":"2024-05-12T10:50:00.386172+0000","last_active":"2024-05-12T10:58:01.901879+0000","last_peered":"2024-05-12T10:58:01.901879+0000","last_clean":"2024-05-12T10:58:01.901879+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:58:01.901879+0000","last_undegraded":"2024-05-12T10:58:01.901879+0000","last_fullsized":"2024-05-12T10:58:01.901879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:06:17.550197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835124+0000","last_change":"2024-05-12T10:49:55.646249+0000","last_active":"2024-05-12T10:54:27.835124+0000","last_peered":"2024-05-12T10:54:27.835124+0000","last_clean":"2024-05-12T10:54:27.835124+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:54:27.835124+0000","last_undegraded":"2024-05-12T10:54:27.835124+0000","last_fullsized":"2024-05-12T10:54:27.835124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:15.036675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.841354+0000","last_change":"2024-05-12T10:49:54.621293+0000","last_active":"2024-05-12T10:54:27.841354+0000","last_peered":"2024-05-12T10:54:27.841354+0000","last_clean":"2024-05-12T10:54:27.841354+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:54:27.841354+0000","last_undegraded":"2024-05-12T10:54:27.841354+0000","last_fullsized":"2024-05-12T10:54:27.841354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:45:33.341215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'269","reported_seq":427,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.764286+0000","last_change":"2024-05-12T10:49:59.673656+0000","last_active":"2024-05-12T10:58:01.764286+0000","last_peered":"2024-05-12T10:58:01.764286+0000","last_clean":"2024-05-12T10:58:01.764286+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:58:01.764286+0000","last_undegraded":"2024-05-12T10:58:01.764286+0000","last_fullsized":"2024-05-12T10:58:01.764286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:38.364434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":548864,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836743+0000","last_change":"2024-05-12T10:49:55.646526+0000","last_active":"2024-05-12T10:54:37.836743+0000","last_peered":"2024-05-12T10:54:37.836743+0000","last_clean":"2024-05-12T10:54:37.836743+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:54:37.836743+0000","last_undegraded":"2024-05-12T10:54:37.836743+0000","last_fullsized":"2024-05-12T10:54:37.836743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:56:52.102442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.884467+0000","last_change":"2024-05-12T10:49:54.617906+0000","last_active":"2024-05-12T10:54:37.884467+0000","last_peered":"2024-05-12T10:54:37.884467+0000","last_clean":"2024-05-12T10:54:37.884467+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:54:37.884467+0000","last_undegraded":"2024-05-12T10:54:37.884467+0000","last_fullsized":"2024-05-12T10:54:37.884467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:26:35.150963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'374","reported_seq":598,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.957230+0000","last_change":"2024-05-12T10:49:59.671791+0000","last_active":"2024-05-12T10:58:01.957230+0000","last_peered":"2024-05-12T10:58:01.957230+0000","last_clean":"2024-05-12T10:58:01.957230+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:58:01.957230+0000","last_undegraded":"2024-05-12T10:58:01.957230+0000","last_fullsized":"2024-05-12T10:58:01.957230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:27.425708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":819200,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.839212+0000","last_change":"2024-05-12T10:49:55.637810+0000","last_active":"2024-05-12T10:54:37.839212+0000","last_peered":"2024-05-12T10:54:37.839212+0000","last_clean":"2024-05-12T10:54:37.839212+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:54:37.839212+0000","last_undegraded":"2024-05-12T10:54:37.839212+0000","last_fullsized":"2024-05-12T10:54:37.839212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:52.001497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.839247+0000","last_change":"2024-05-12T10:49:54.637728+0000","last_active":"2024-05-12T10:54:37.839247+0000","last_peered":"2024-05-12T10:54:37.839247+0000","last_clean":"2024-05-12T10:54:37.839247+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:54:37.839247+0000","last_undegraded":"2024-05-12T10:54:37.839247+0000","last_fullsized":"2024-05-12T10:54:37.839247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:39.996419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'283","reported_seq":453,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.948262+0000","last_change":"2024-05-12T10:50:00.383444+0000","last_active":"2024-05-12T10:58:01.948262+0000","last_peered":"2024-05-12T10:58:01.948262+0000","last_clean":"2024-05-12T10:58:01.948262+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:58:01.948262+0000","last_undegraded":"2024-05-12T10:58:01.948262+0000","last_fullsized":"2024-05-12T10:58:01.948262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:55:04.226848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836797+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:54:37.836797+0000","last_peered":"2024-05-12T10:54:37.836797+0000","last_clean":"2024-05-12T10:54:37.836797+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:54:37.836797+0000","last_undegraded":"2024-05-12T10:54:37.836797+0000","last_fullsized":"2024-05-12T10:54:37.836797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:15:58.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836051+0000","last_change":"2024-05-12T10:49:54.656814+0000","last_active":"2024-05-12T10:54:37.836051+0000","last_peered":"2024-05-12T10:54:37.836051+0000","last_clean":"2024-05-12T10:54:37.836051+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:54:37.836051+0000","last_undegraded":"2024-05-12T10:54:37.836051+0000","last_fullsized":"2024-05-12T10:54:37.836051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:26.660043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'279","reported_seq":450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.861231+0000","last_change":"2024-05-12T10:50:00.390308+0000","last_active":"2024-05-12T10:58:01.861231+0000","last_peered":"2024-05-12T10:58:01.861231+0000","last_clean":"2024-05-12T10:58:01.861231+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:58:01.861231+0000","last_undegraded":"2024-05-12T10:58:01.861231+0000","last_fullsized":"2024-05-12T10:58:01.861231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:43.650956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814290+0000","last_change":"2024-05-12T10:49:55.628907+0000","last_active":"2024-05-12T10:54:37.814290+0000","last_peered":"2024-05-12T10:54:37.814290+0000","last_clean":"2024-05-12T10:54:37.814290+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:54:37.814290+0000","last_undegraded":"2024-05-12T10:54:37.814290+0000","last_fullsized":"2024-05-12T10:54:37.814290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:13:50.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814322+0000","last_change":"2024-05-12T10:49:54.626002+0000","last_active":"2024-05-12T10:54:37.814322+0000","last_peered":"2024-05-12T10:54:37.814322+0000","last_clean":"2024-05-12T10:54:37.814322+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:54:37.814322+0000","last_undegraded":"2024-05-12T10:54:37.814322+0000","last_fullsized":"2024-05-12T10:54:37.814322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:19:19.976387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'329","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.813514+0000","last_change":"2024-05-12T10:50:00.387192+0000","last_active":"2024-05-12T10:58:01.813514+0000","last_peered":"2024-05-12T10:58:01.813514+0000","last_clean":"2024-05-12T10:58:01.813514+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:58:01.813514+0000","last_undegraded":"2024-05-12T10:58:01.813514+0000","last_fullsized":"2024-05-12T10:58:01.813514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:15:23.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.842525+0000","last_change":"2024-05-12T10:49:55.634551+0000","last_active":"2024-05-12T10:54:47.842525+0000","last_peered":"2024-05-12T10:54:47.842525+0000","last_clean":"2024-05-12T10:54:47.842525+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:54:47.842525+0000","last_undegraded":"2024-05-12T10:54:47.842525+0000","last_fullsized":"2024-05-12T10:54:47.842525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:10:52.477145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'1907","reported_seq":1938,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:27.469074+0000","last_change":"2024-05-12T10:49:54.634748+0000","last_active":"2024-05-12T10:58:27.469074+0000","last_peered":"2024-05-12T10:58:27.469074+0000","last_clean":"2024-05-12T10:58:27.469074+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:58:27.469074+0000","last_undegraded":"2024-05-12T10:58:27.469074+0000","last_fullsized":"2024-05-12T10:58:27.469074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1907,"log_dups_size":0,"ondisk_log_size":1907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:39:16.646133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3827324,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1907,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'296","reported_seq":480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.926093+0000","last_change":"2024-05-12T10:49:59.671405+0000","last_active":"2024-05-12T10:58:01.926093+0000","last_peered":"2024-05-12T10:58:01.926093+0000","last_clean":"2024-05-12T10:58:01.926093+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:58:01.926093+0000","last_undegraded":"2024-05-12T10:58:01.926093+0000","last_fullsized":"2024-05-12T10:58:01.926093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:06:34.170753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.842947+0000","last_change":"2024-05-12T10:49:55.634686+0000","last_active":"2024-05-12T10:54:37.842947+0000","last_peered":"2024-05-12T10:54:37.842947+0000","last_clean":"2024-05-12T10:54:37.842947+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:54:37.842947+0000","last_undegraded":"2024-05-12T10:54:37.842947+0000","last_fullsized":"2024-05-12T10:54:37.842947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:25:04.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'8","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:12.886479+0000","last_change":"2024-05-12T10:49:54.656012+0000","last_active":"2024-05-12T10:57:12.886479+0000","last_peered":"2024-05-12T10:57:12.886479+0000","last_clean":"2024-05-12T10:57:12.886479+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:57:12.886479+0000","last_undegraded":"2024-05-12T10:57:12.886479+0000","last_fullsized":"2024-05-12T10:57:12.886479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:29.253250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'304","reported_seq":503,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.906496+0000","last_change":"2024-05-12T10:49:59.672820+0000","last_active":"2024-05-12T10:58:01.906496+0000","last_peered":"2024-05-12T10:58:01.906496+0000","last_clean":"2024-05-12T10:58:01.906496+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:58:01.906496+0000","last_undegraded":"2024-05-12T10:58:01.906496+0000","last_fullsized":"2024-05-12T10:58:01.906496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:49:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":716800,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.815288+0000","last_change":"2024-05-12T10:49:55.620541+0000","last_active":"2024-05-12T10:54:47.815288+0000","last_peered":"2024-05-12T10:54:47.815288+0000","last_clean":"2024-05-12T10:54:47.815288+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:54:47.815288+0000","last_undegraded":"2024-05-12T10:54:47.815288+0000","last_fullsized":"2024-05-12T10:54:47.815288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:11.742829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.837479+0000","last_change":"2024-05-12T10:49:54.651289+0000","last_active":"2024-05-12T10:54:47.837479+0000","last_peered":"2024-05-12T10:54:47.837479+0000","last_clean":"2024-05-12T10:54:47.837479+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:54:47.837479+0000","last_undegraded":"2024-05-12T10:54:47.837479+0000","last_fullsized":"2024-05-12T10:54:47.837479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:33:24.087763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'307","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.889067+0000","last_change":"2024-05-12T10:50:36.855844+0000","last_active":"2024-05-12T10:58:01.889067+0000","last_peered":"2024-05-12T10:58:01.889067+0000","last_clean":"2024-05-12T10:58:01.889067+0000","last_became_active":"2024-05-12T10:50:36.855397+0000","last_became_peered":"2024-05-12T10:50:36.855397+0000","last_unstale":"2024-05-12T10:58:01.889067+0000","last_undegraded":"2024-05-12T10:58:01.889067+0000","last_fullsized":"2024-05-12T10:58:01.889067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:14:10.664926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.837469+0000","last_change":"2024-05-12T10:49:55.626645+0000","last_active":"2024-05-12T10:54:47.837469+0000","last_peered":"2024-05-12T10:54:47.837469+0000","last_clean":"2024-05-12T10:54:47.837469+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:54:47.837469+0000","last_undegraded":"2024-05-12T10:54:47.837469+0000","last_fullsized":"2024-05-12T10:54:47.837469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:41.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.850647+0000","last_change":"2024-05-12T10:49:54.654822+0000","last_active":"2024-05-12T10:54:47.850647+0000","last_peered":"2024-05-12T10:54:47.850647+0000","last_clean":"2024-05-12T10:54:47.850647+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:54:47.850647+0000","last_undegraded":"2024-05-12T10:54:47.850647+0000","last_fullsized":"2024-05-12T10:54:47.850647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:52:07.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'332","reported_seq":530,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.938963+0000","last_change":"2024-05-12T10:50:00.396453+0000","last_active":"2024-05-12T10:58:01.938963+0000","last_peered":"2024-05-12T10:58:01.938963+0000","last_clean":"2024-05-12T10:58:01.938963+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:58:01.938963+0000","last_undegraded":"2024-05-12T10:58:01.938963+0000","last_fullsized":"2024-05-12T10:58:01.938963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:40.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'283","reported_seq":465,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.940540+0000","last_change":"2024-05-12T10:50:00.390477+0000","last_active":"2024-05-12T10:58:01.940540+0000","last_peered":"2024-05-12T10:58:01.940540+0000","last_clean":"2024-05-12T10:58:01.940540+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:58:01.940540+0000","last_undegraded":"2024-05-12T10:58:01.940540+0000","last_fullsized":"2024-05-12T10:58:01.940540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:20:19.551216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":643072,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:12.886432+0000","last_change":"2024-05-12T10:49:55.619984+0000","last_active":"2024-05-12T10:57:12.886432+0000","last_peered":"2024-05-12T10:57:12.886432+0000","last_clean":"2024-05-12T10:57:12.886432+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:57:12.886432+0000","last_undegraded":"2024-05-12T10:57:12.886432+0000","last_fullsized":"2024-05-12T10:57:12.886432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:21:34.136203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.837419+0000","last_change":"2024-05-12T10:49:54.656580+0000","last_active":"2024-05-12T10:54:47.837419+0000","last_peered":"2024-05-12T10:54:47.837419+0000","last_clean":"2024-05-12T10:54:47.837419+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:54:47.837419+0000","last_undegraded":"2024-05-12T10:54:47.837419+0000","last_fullsized":"2024-05-12T10:54:47.837419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:43:32.603999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'272","reported_seq":449,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.950582+0000","last_change":"2024-05-12T10:49:59.681648+0000","last_active":"2024-05-12T10:58:01.950582+0000","last_peered":"2024-05-12T10:58:01.950582+0000","last_clean":"2024-05-12T10:58:01.950582+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:58:01.950582+0000","last_undegraded":"2024-05-12T10:58:01.950582+0000","last_fullsized":"2024-05-12T10:58:01.950582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:54.912836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.814669+0000","last_change":"2024-05-12T10:49:55.617393+0000","last_active":"2024-05-12T10:54:47.814669+0000","last_peered":"2024-05-12T10:54:47.814669+0000","last_clean":"2024-05-12T10:54:47.814669+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:54:47.814669+0000","last_undegraded":"2024-05-12T10:54:47.814669+0000","last_fullsized":"2024-05-12T10:54:47.814669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:51.584695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.814701+0000","last_change":"2024-05-12T10:49:54.637393+0000","last_active":"2024-05-12T10:54:47.814701+0000","last_peered":"2024-05-12T10:54:47.814701+0000","last_clean":"2024-05-12T10:54:47.814701+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:54:47.814701+0000","last_undegraded":"2024-05-12T10:54:47.814701+0000","last_fullsized":"2024-05-12T10:54:47.814701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:44:00.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.852132+0000","last_change":"2024-05-12T10:49:54.636945+0000","last_active":"2024-05-12T10:54:57.852132+0000","last_peered":"2024-05-12T10:54:57.852132+0000","last_clean":"2024-05-12T10:54:57.852132+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:54:57.852132+0000","last_undegraded":"2024-05-12T10:54:57.852132+0000","last_fullsized":"2024-05-12T10:54:57.852132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:34:25.927458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.816216+0000","last_change":"2024-05-12T10:49:55.627105+0000","last_active":"2024-05-12T10:54:57.816216+0000","last_peered":"2024-05-12T10:54:57.816216+0000","last_clean":"2024-05-12T10:54:57.816216+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:54:57.816216+0000","last_undegraded":"2024-05-12T10:54:57.816216+0000","last_fullsized":"2024-05-12T10:54:57.816216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:00:09.334541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'308","reported_seq":502,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.834536+0000","last_change":"2024-05-12T10:49:59.659142+0000","last_active":"2024-05-12T10:58:01.834536+0000","last_peered":"2024-05-12T10:58:01.834536+0000","last_clean":"2024-05-12T10:58:01.834536+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:58:01.834536+0000","last_undegraded":"2024-05-12T10:58:01.834536+0000","last_fullsized":"2024-05-12T10:58:01.834536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:40.443593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.815773+0000","last_change":"2024-05-12T10:49:54.632224+0000","last_active":"2024-05-12T10:54:57.815773+0000","last_peered":"2024-05-12T10:54:57.815773+0000","last_clean":"2024-05-12T10:54:57.815773+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:54:57.815773+0000","last_undegraded":"2024-05-12T10:54:57.815773+0000","last_fullsized":"2024-05-12T10:54:57.815773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:27:39.637678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.845878+0000","last_change":"2024-05-12T10:49:55.633243+0000","last_active":"2024-05-12T10:54:57.845878+0000","last_peered":"2024-05-12T10:54:57.845878+0000","last_clean":"2024-05-12T10:54:57.845878+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:54:57.845878+0000","last_undegraded":"2024-05-12T10:54:57.845878+0000","last_fullsized":"2024-05-12T10:54:57.845878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:14.239020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'317","reported_seq":514,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.897764+0000","last_change":"2024-05-12T10:49:59.655807+0000","last_active":"2024-05-12T10:58:01.897764+0000","last_peered":"2024-05-12T10:58:01.897764+0000","last_clean":"2024-05-12T10:58:01.897764+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:58:01.897764+0000","last_undegraded":"2024-05-12T10:58:01.897764+0000","last_fullsized":"2024-05-12T10:58:01.897764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:12.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.861868+0000","last_change":"2024-05-12T10:49:55.637106+0000","last_active":"2024-05-12T10:56:12.861868+0000","last_peered":"2024-05-12T10:56:12.861868+0000","last_clean":"2024-05-12T10:56:12.861868+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:56:12.861868+0000","last_undegraded":"2024-05-12T10:56:12.861868+0000","last_fullsized":"2024-05-12T10:56:12.861868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:22:07.477677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.908806+0000","last_change":"2024-05-12T10:49:55.618952+0000","last_active":"2024-05-12T10:56:12.908806+0000","last_peered":"2024-05-12T10:56:12.908806+0000","last_clean":"2024-05-12T10:56:12.908806+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:56:12.908806+0000","last_undegraded":"2024-05-12T10:56:12.908806+0000","last_fullsized":"2024-05-12T10:56:12.908806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:38:10.693066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856628+0000","last_change":"2024-05-12T10:49:55.623916+0000","last_active":"2024-05-12T10:56:12.856628+0000","last_peered":"2024-05-12T10:56:12.856628+0000","last_clean":"2024-05-12T10:56:12.856628+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:56:12.856628+0000","last_undegraded":"2024-05-12T10:56:12.856628+0000","last_fullsized":"2024-05-12T10:56:12.856628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:06:14.434631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831149+0000","last_change":"2024-05-12T10:49:55.620278+0000","last_active":"2024-05-12T10:56:12.831149+0000","last_peered":"2024-05-12T10:56:12.831149+0000","last_clean":"2024-05-12T10:56:12.831149+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:56:12.831149+0000","last_undegraded":"2024-05-12T10:56:12.831149+0000","last_fullsized":"2024-05-12T10:56:12.831149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:59.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811377+0000","last_change":"2024-05-12T10:49:55.626216+0000","last_active":"2024-05-12T10:54:17.811377+0000","last_peered":"2024-05-12T10:54:17.811377+0000","last_clean":"2024-05-12T10:54:17.811377+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:54:17.811377+0000","last_undegraded":"2024-05-12T10:54:17.811377+0000","last_fullsized":"2024-05-12T10:54:17.811377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:52:14.438331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812588+0000","last_change":"2024-05-12T10:49:55.622085+0000","last_active":"2024-05-12T10:54:17.812588+0000","last_peered":"2024-05-12T10:54:17.812588+0000","last_clean":"2024-05-12T10:54:17.812588+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:54:17.812588+0000","last_undegraded":"2024-05-12T10:54:17.812588+0000","last_fullsized":"2024-05-12T10:54:17.812588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:41:42.558506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.836134+0000","last_change":"2024-05-12T10:50:36.856467+0000","last_active":"2024-05-12T10:54:17.836134+0000","last_peered":"2024-05-12T10:54:17.836134+0000","last_clean":"2024-05-12T10:54:17.836134+0000","last_became_active":"2024-05-12T10:50:36.855517+0000","last_became_peered":"2024-05-12T10:50:36.855517+0000","last_unstale":"2024-05-12T10:54:17.836134+0000","last_undegraded":"2024-05-12T10:54:17.836134+0000","last_fullsized":"2024-05-12T10:54:17.836134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:35.215695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811397+0000","last_change":"2024-05-12T10:49:55.626353+0000","last_active":"2024-05-12T10:54:17.811397+0000","last_peered":"2024-05-12T10:54:17.811397+0000","last_clean":"2024-05-12T10:54:17.811397+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:54:17.811397+0000","last_undegraded":"2024-05-12T10:54:17.811397+0000","last_fullsized":"2024-05-12T10:54:17.811397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:58.905284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.832667+0000","last_change":"2024-05-12T10:49:55.621110+0000","last_active":"2024-05-12T10:54:17.832667+0000","last_peered":"2024-05-12T10:54:17.832667+0000","last_clean":"2024-05-12T10:54:17.832667+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:54:17.832667+0000","last_undegraded":"2024-05-12T10:54:17.832667+0000","last_fullsized":"2024-05-12T10:54:17.832667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:12:36.369923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.812357+0000","last_change":"2024-05-12T10:49:55.626913+0000","last_active":"2024-05-12T10:54:27.812357+0000","last_peered":"2024-05-12T10:54:27.812357+0000","last_clean":"2024-05-12T10:54:27.812357+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:54:27.812357+0000","last_undegraded":"2024-05-12T10:54:27.812357+0000","last_fullsized":"2024-05-12T10:54:27.812357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:27:08.492294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.834327+0000","last_change":"2024-05-12T10:49:55.629992+0000","last_active":"2024-05-12T10:54:27.834327+0000","last_peered":"2024-05-12T10:54:27.834327+0000","last_clean":"2024-05-12T10:54:27.834327+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:54:27.834327+0000","last_undegraded":"2024-05-12T10:54:27.834327+0000","last_fullsized":"2024-05-12T10:54:27.834327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:31.454363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.813293+0000","last_change":"2024-05-12T10:49:55.620821+0000","last_active":"2024-05-12T10:54:27.813293+0000","last_peered":"2024-05-12T10:54:27.813293+0000","last_clean":"2024-05-12T10:54:27.813293+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:54:27.813293+0000","last_undegraded":"2024-05-12T10:54:27.813293+0000","last_fullsized":"2024-05-12T10:54:27.813293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:53.597215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.837690+0000","last_change":"2024-05-12T10:49:55.646368+0000","last_active":"2024-05-12T10:54:27.837690+0000","last_peered":"2024-05-12T10:54:27.837690+0000","last_clean":"2024-05-12T10:54:27.837690+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:54:27.837690+0000","last_undegraded":"2024-05-12T10:54:27.837690+0000","last_fullsized":"2024-05-12T10:54:27.837690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:21:04.313921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835101+0000","last_change":"2024-05-12T10:49:55.633122+0000","last_active":"2024-05-12T10:54:27.835101+0000","last_peered":"2024-05-12T10:54:27.835101+0000","last_clean":"2024-05-12T10:54:27.835101+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:54:27.835101+0000","last_undegraded":"2024-05-12T10:54:27.835101+0000","last_fullsized":"2024-05-12T10:54:27.835101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:25:19.563648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.884507+0000","last_change":"2024-05-12T10:49:55.635394+0000","last_active":"2024-05-12T10:54:37.884507+0000","last_peered":"2024-05-12T10:54:37.884507+0000","last_clean":"2024-05-12T10:54:37.884507+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:54:37.884507+0000","last_undegraded":"2024-05-12T10:54:37.884507+0000","last_fullsized":"2024-05-12T10:54:37.884507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:41:58.478292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836122+0000","last_change":"2024-05-12T10:49:55.626485+0000","last_active":"2024-05-12T10:54:37.836122+0000","last_peered":"2024-05-12T10:54:37.836122+0000","last_clean":"2024-05-12T10:54:37.836122+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:54:37.836122+0000","last_undegraded":"2024-05-12T10:54:37.836122+0000","last_fullsized":"2024-05-12T10:54:37.836122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:17.942339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.835959+0000","last_change":"2024-05-12T10:49:55.618820+0000","last_active":"2024-05-12T10:54:37.835959+0000","last_peered":"2024-05-12T10:54:37.835959+0000","last_clean":"2024-05-12T10:54:37.835959+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:54:37.835959+0000","last_undegraded":"2024-05-12T10:54:37.835959+0000","last_fullsized":"2024-05-12T10:54:37.835959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:23:00.474438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814505+0000","last_change":"2024-05-12T10:49:55.626429+0000","last_active":"2024-05-12T10:54:37.814505+0000","last_peered":"2024-05-12T10:54:37.814505+0000","last_clean":"2024-05-12T10:54:37.814505+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:54:37.814505+0000","last_undegraded":"2024-05-12T10:54:37.814505+0000","last_fullsized":"2024-05-12T10:54:37.814505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:40:02.709729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814258+0000","last_change":"2024-05-12T10:49:55.612139+0000","last_active":"2024-05-12T10:54:37.814258+0000","last_peered":"2024-05-12T10:54:37.814258+0000","last_clean":"2024-05-12T10:54:37.814258+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:54:37.814258+0000","last_undegraded":"2024-05-12T10:54:37.814258+0000","last_fullsized":"2024-05-12T10:54:37.814258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:57:34.138392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.814715+0000","last_change":"2024-05-12T10:49:55.631137+0000","last_active":"2024-05-12T10:54:47.814715+0000","last_peered":"2024-05-12T10:54:47.814715+0000","last_clean":"2024-05-12T10:54:47.814715+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:54:47.814715+0000","last_undegraded":"2024-05-12T10:54:47.814715+0000","last_fullsized":"2024-05-12T10:54:47.814715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:04.390314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.844400+0000","last_change":"2024-05-12T10:49:55.643416+0000","last_active":"2024-05-12T10:54:47.844400+0000","last_peered":"2024-05-12T10:54:47.844400+0000","last_clean":"2024-05-12T10:54:47.844400+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:54:47.844400+0000","last_undegraded":"2024-05-12T10:54:47.844400+0000","last_fullsized":"2024-05-12T10:54:47.844400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:58.632966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.850612+0000","last_change":"2024-05-12T10:49:55.635847+0000","last_active":"2024-05-12T10:54:47.850612+0000","last_peered":"2024-05-12T10:54:47.850612+0000","last_clean":"2024-05-12T10:54:47.850612+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:54:47.850612+0000","last_undegraded":"2024-05-12T10:54:47.850612+0000","last_fullsized":"2024-05-12T10:54:47.850612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:57:51.222099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:04.930755+0000","last_change":"2024-05-12T10:49:55.641921+0000","last_active":"2024-05-12T10:55:04.930755+0000","last_peered":"2024-05-12T10:55:04.930755+0000","last_clean":"2024-05-12T10:55:04.930755+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:55:04.930755+0000","last_undegraded":"2024-05-12T10:55:04.930755+0000","last_fullsized":"2024-05-12T10:55:04.930755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:44:57.787358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.842584+0000","last_change":"2024-05-12T10:49:55.635853+0000","last_active":"2024-05-12T10:54:47.842584+0000","last_peered":"2024-05-12T10:54:47.842584+0000","last_clean":"2024-05-12T10:54:47.842584+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:54:47.842584+0000","last_undegraded":"2024-05-12T10:54:47.842584+0000","last_fullsized":"2024-05-12T10:54:47.842584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:04:39.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.815740+0000","last_change":"2024-05-12T10:50:36.914559+0000","last_active":"2024-05-12T10:54:57.815740+0000","last_peered":"2024-05-12T10:54:57.815740+0000","last_clean":"2024-05-12T10:54:57.815740+0000","last_became_active":"2024-05-12T10:50:36.914327+0000","last_became_peered":"2024-05-12T10:50:36.914327+0000","last_unstale":"2024-05-12T10:54:57.815740+0000","last_undegraded":"2024-05-12T10:54:57.815740+0000","last_fullsized":"2024-05-12T10:54:57.815740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:47:16.693858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844166+0000","last_change":"2024-05-12T10:49:55.629001+0000","last_active":"2024-05-12T10:54:57.844166+0000","last_peered":"2024-05-12T10:54:57.844166+0000","last_clean":"2024-05-12T10:54:57.844166+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:54:57.844166+0000","last_undegraded":"2024-05-12T10:54:57.844166+0000","last_fullsized":"2024-05-12T10:54:57.844166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:42:39.042271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.839062+0000","last_change":"2024-05-12T10:49:55.625540+0000","last_active":"2024-05-12T10:54:57.839062+0000","last_peered":"2024-05-12T10:54:57.839062+0000","last_clean":"2024-05-12T10:54:57.839062+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:54:57.839062+0000","last_undegraded":"2024-05-12T10:54:57.839062+0000","last_fullsized":"2024-05-12T10:54:57.839062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:35.621918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844222+0000","last_change":"2024-05-12T10:49:55.633576+0000","last_active":"2024-05-12T10:54:57.844222+0000","last_peered":"2024-05-12T10:54:57.844222+0000","last_clean":"2024-05-12T10:54:57.844222+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:54:57.844222+0000","last_undegraded":"2024-05-12T10:54:57.844222+0000","last_fullsized":"2024-05-12T10:54:57.844222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:06:16.255147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.850758+0000","last_change":"2024-05-12T10:49:55.624205+0000","last_active":"2024-05-12T10:55:57.850758+0000","last_peered":"2024-05-12T10:55:57.850758+0000","last_clean":"2024-05-12T10:55:57.850758+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:55:57.850758+0000","last_undegraded":"2024-05-12T10:55:57.850758+0000","last_fullsized":"2024-05-12T10:55:57.850758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:21.895269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831159+0000","last_change":"2024-05-12T10:49:55.610461+0000","last_active":"2024-05-12T10:56:12.831159+0000","last_peered":"2024-05-12T10:56:12.831159+0000","last_clean":"2024-05-12T10:56:12.831159+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:56:12.831159+0000","last_undegraded":"2024-05-12T10:56:12.831159+0000","last_fullsized":"2024-05-12T10:56:12.831159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:44.511895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.852448+0000","last_change":"2024-05-12T10:49:55.608434+0000","last_active":"2024-05-12T10:56:12.852448+0000","last_peered":"2024-05-12T10:56:12.852448+0000","last_clean":"2024-05-12T10:56:12.852448+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:56:12.852448+0000","last_undegraded":"2024-05-12T10:56:12.852448+0000","last_fullsized":"2024-05-12T10:56:12.852448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:17.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.855119+0000","last_change":"2024-05-12T10:49:55.639296+0000","last_active":"2024-05-12T10:56:12.855119+0000","last_peered":"2024-05-12T10:56:12.855119+0000","last_clean":"2024-05-12T10:56:12.855119+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:56:12.855119+0000","last_undegraded":"2024-05-12T10:56:12.855119+0000","last_fullsized":"2024-05-12T10:56:12.855119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:47:15.862328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9475,"ondisk_log_size":9475,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3831519,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2096,"num_write_kb":4004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7823360,"data_stored":7663038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2052,"ondisk_log_size":2052,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542251,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58436,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313404,"statfs":{"total":96636764160,"available":96576925696,"internally_reserved":0,"allocated":913408,"data_stored":716485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542252,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79576,"kb_used_data":4048,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94292264,"statfs":{"total":96636764160,"available":96555278336,"internally_reserved":0,"allocated":4145152,"data_stored":3953061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542252,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53696,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318144,"statfs":{"total":96636764160,"available":96581779456,"internally_reserved":0,"allocated":319488,"data_stored":126179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542254,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45372,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326468,"statfs":{"total":96636764160,"available":96590303232,"internally_reserved":0,"allocated":315392,"data_stored":125773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542252,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97628,"kb_used_data":4052,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94274212,"statfs":{"total":96636764160,"available":96536793088,"internally_reserved":0,"allocated":4149248,"data_stored":3948818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542251,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57860,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313980,"statfs":{"total":96636764160,"available":96577515520,"internally_reserved":0,"allocated":323584,"data_stored":125946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542252,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67524,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94304316,"statfs":{"total":96636764160,"available":96567619584,"internally_reserved":0,"allocated":323584,"data_stored":125745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542252,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58432,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313408,"statfs":{"total":96636764160,"available":96576929792,"internally_reserved":0,"allocated":909312,"data_stored":715829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3854336,"data_stored":3828363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3846144,"data_stored":3828260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:58:29.713 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-12T10:58:29.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:58:29.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f7017200640 1 Processor -- start 2024-05-12T10:58:29.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f7017200640 1 -- start start 2024-05-12T10:58:29.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f7017200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7010152a90 0x7f701015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f7017200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70100c6560 0x7f70100c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f7017200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70100ca850 con 0x7f70100c4920 2024-05-12T10:58:29.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f7017200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f70100c4f80 con 0x7f7010152a90 2024-05-12T10:58:29.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f7017200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f70100cae10 con 0x7f70100c6560 2024-05-12T10:58:29.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f700fe00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7010152a90 0x7f701015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f700fe00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7010152a90 0x7f701015cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54698/0 (socket says 172.21.15.115:54698) 2024-05-12T10:58:29.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f700fe00640 1 -- 172.21.15.115:0/2969640418 learned_addr learned my addr 172.21.15.115:0/2969640418 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:29.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f700f400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f70100c4920 0x7f70101593b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:39406/0 (socket says 172.21.15.115:39406) 2024-05-12T10:58:29.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f7015200640 1 --2- 172.21.15.115:0/2969640418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70100c6560 0x7f70100c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f700fe00640 1 -- 172.21.15.115:0/2969640418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70100c6560 msgr2=0x7f70100c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:29.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f700fe00640 1 --2- 172.21.15.115:0/2969640418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70100c6560 0x7f70100c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f700fe00640 1 -- 172.21.15.115:0/2969640418 >> v1:172.21.15.115:6789/0 conn(0x7f70100c4920 legacy=0x7f70101593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.898+0000 7f700fe00640 1 -- 172.21.15.115:0/2969640418 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70100cab30 con 0x7f7010152a90 2024-05-12T10:58:29.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f700fe00640 1 --2- 172.21.15.115:0/2969640418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7010152a90 0x7f701015cb30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7000009870 tx=0x7f700001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4449e6c98ea068d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:29.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f700ea00640 1 -- 172.21.15.115:0/2969640418 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70000b0070 con 0x7f7010152a90 2024-05-12T10:58:29.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f700ea00640 1 -- 172.21.15.115:0/2969640418 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70000ab600 con 0x7f7010152a90 2024-05-12T10:58:29.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f700ea00640 1 -- 172.21.15.115:0/2969640418 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70000ab9d0 con 0x7f7010152a90 2024-05-12T10:58:29.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f7017200640 1 -- 172.21.15.115:0/2969640418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7010152a90 msgr2=0x7f701015cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f7017200640 1 --2- 172.21.15.115:0/2969640418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7010152a90 0x7f701015cb30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7000009870 tx=0x7f700001c500 comp rx=0 tx=0).stop 2024-05-12T10:58:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f7017200640 1 -- 172.21.15.115:0/2969640418 shutdown_connections 2024-05-12T10:58:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f7017200640 1 --2- 172.21.15.115:0/2969640418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70100c6560 0x7f70100c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f7017200640 1 --2- 172.21.15.115:0/2969640418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7010152a90 0x7f701015cb30 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f7017200640 1 -- 172.21.15.115:0/2969640418 >> 172.21.15.115:0/2969640418 conn(0x7f70100681c0 msgr2=0x7f70100685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f7017200640 1 -- 172.21.15.115:0/2969640418 shutdown_connections 2024-05-12T10:58:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.902+0000 7f7017200640 1 -- 172.21.15.115:0/2969640418 wait complete. 2024-05-12T10:58:29.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7017200640 1 Processor -- start 2024-05-12T10:58:29.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7017200640 1 -- start start 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7017200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70100c4920 0x7f701014c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7017200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70100c6560 0x7f7010158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7017200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7010152a90 0x7f7010158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7017200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7010152e70 con 0x7f70100c4920 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7017200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f701015c6a0 con 0x7f7010152a90 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7017200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7010152ff0 con 0x7f70100c6560 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f700fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70100c4920 0x7f701014c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f700fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70100c4920 0x7f701014c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54712/0 (socket says 172.21.15.115:54712) 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f700fe00640 1 -- 172.21.15.115:0/3247431902 learned_addr learned my addr 172.21.15.115:0/3247431902 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f700f400640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70100c6560 0x7f7010158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7015200640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7010152a90 0x7f7010158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f700fe00640 1 -- 172.21.15.115:0/3247431902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70100c6560 msgr2=0x7f7010158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f700fe00640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70100c6560 0x7f7010158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f700fe00640 1 -- 172.21.15.115:0/3247431902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7010152a90 msgr2=0x7f7010158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:29.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f700fe00640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7010152a90 0x7f7010158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:29.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f700fe00640 1 -- 172.21.15.115:0/3247431902 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701015bb70 con 0x7f70100c4920 2024-05-12T10:58:29.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f700fe00640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70100c4920 0x7f701014c7b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f700001a190 tx=0x7f7000019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:29.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7007e00640 1 -- 172.21.15.115:0/3247431902 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70000ba070 con 0x7f70100c4920 2024-05-12T10:58:29.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7007e00640 1 -- 172.21.15.115:0/3247431902 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70000b4420 con 0x7f70100c4920 2024-05-12T10:58:29.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7007e00640 1 -- 172.21.15.115:0/3247431902 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70000b0040 con 0x7f70100c4920 2024-05-12T10:58:29.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7017200640 1 -- 172.21.15.115:0/3247431902 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70101f5400 con 0x7f70100c4920 2024-05-12T10:58:29.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.906+0000 7f7017200640 1 -- 172.21.15.115:0/3247431902 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7010159c70 con 0x7f70100c4920 2024-05-12T10:58:29.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.910+0000 7f7017200640 1 -- 172.21.15.115:0/3247431902 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7010069730 con 0x7f70100c4920 2024-05-12T10:58:29.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.910+0000 7f7007e00640 1 -- 172.21.15.115:0/3247431902 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f70000b4810 con 0x7f70100c4920 2024-05-12T10:58:29.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.910+0000 7f7007e00640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6ff006f430 0x7f6ff00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:29.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.910+0000 7f7007e00640 1 -- 172.21.15.115:0/3247431902 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f7000128760 con 0x7f70100c4920 2024-05-12T10:58:29.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.910+0000 7f700f400640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6ff006f430 0x7f6ff00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:29.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.910+0000 7f700f400640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6ff006f430 0x7f6ff00718f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7010159780 tx=0x7f6ffc007c90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:29.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:29.914+0000 7f7007e00640 1 -- 172.21.15.115:0/3247431902 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f70000eef50 con 0x7f70100c4920 2024-05-12T10:58:30.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.070+0000 7f7017200640 1 -- 172.21.15.115:0/3247431902 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70101f5920 con 0x7f6ff006f430 2024-05-12T10:58:30.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.078+0000 7f7007e00640 1 -- 172.21.15.115:0/3247431902 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333410 (secure 0 0 0) 0x7f6ffc005a60 con 0x7f6ff006f430 2024-05-12T10:58:30.073 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:58:30.074 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 -- 172.21.15.115:0/3247431902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6ff006f430 msgr2=0x7f6ff00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6ff006f430 0x7f6ff00718f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7010159780 tx=0x7f6ffc007c90 comp rx=0 tx=0).stop 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 -- 172.21.15.115:0/3247431902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70100c4920 msgr2=0x7f701014c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70100c4920 0x7f701014c7b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f700001a190 tx=0x7f7000019300 comp rx=0 tx=0).stop 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 -- 172.21.15.115:0/3247431902 shutdown_connections 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f6ff006f430 0x7f6ff00718f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7010152a90 0x7f7010158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70100c6560 0x7f7010158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 --2- 172.21.15.115:0/3247431902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70100c4920 0x7f701014c7b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 -- 172.21.15.115:0/3247431902 >> 172.21.15.115:0/3247431902 conn(0x7f70100681c0 msgr2=0x7f70100ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 -- 172.21.15.115:0/3247431902 shutdown_connections 2024-05-12T10:58:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.082+0000 7f7017200640 1 -- 172.21.15.115:0/3247431902 wait complete. 2024-05-12T10:58:30.093 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-05-12T10:58:29.926125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4421887,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":5197,"num_read_kb":21004346,"num_write":11414,"num_write_kb":25171456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11602,"ondisk_log_size":11602,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":518524,"kb_used_data":11132,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":754456196,"statfs":{"total":773094113280,"available":772563144704,"internally_reserved":0,"allocated":11399168,"data_stored":9837836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":519491121},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4346,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003137"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831179+0000","last_change":"2024-05-12T10:49:54.640093+0000","last_active":"2024-05-12T10:56:12.831179+0000","last_peered":"2024-05-12T10:56:12.831179+0000","last_clean":"2024-05-12T10:56:12.831179+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:56:12.831179+0000","last_undegraded":"2024-05-12T10:56:12.831179+0000","last_fullsized":"2024-05-12T10:56:12.831179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:07:41.639104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.839481+0000","last_change":"2024-05-12T10:49:55.635928+0000","last_active":"2024-05-12T10:55:57.839481+0000","last_peered":"2024-05-12T10:55:57.839481+0000","last_clean":"2024-05-12T10:55:57.839481+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:55:57.839481+0000","last_undegraded":"2024-05-12T10:55:57.839481+0000","last_fullsized":"2024-05-12T10:55:57.839481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:41:30.909036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'315","reported_seq":515,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.842369+0000","last_change":"2024-05-12T10:50:00.396417+0000","last_active":"2024-05-12T10:58:01.842369+0000","last_peered":"2024-05-12T10:58:01.842369+0000","last_clean":"2024-05-12T10:58:01.842369+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:58:01.842369+0000","last_undegraded":"2024-05-12T10:58:01.842369+0000","last_fullsized":"2024-05-12T10:58:01.842369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:27.287617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.839501+0000","last_change":"2024-05-12T10:49:54.619268+0000","last_active":"2024-05-12T10:55:57.839501+0000","last_peered":"2024-05-12T10:55:57.839501+0000","last_clean":"2024-05-12T10:55:57.839501+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:55:57.839501+0000","last_undegraded":"2024-05-12T10:55:57.839501+0000","last_fullsized":"2024-05-12T10:55:57.839501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:50:34.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831171+0000","last_change":"2024-05-12T10:49:55.624986+0000","last_active":"2024-05-12T10:56:12.831171+0000","last_peered":"2024-05-12T10:56:12.831171+0000","last_clean":"2024-05-12T10:56:12.831171+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:56:12.831171+0000","last_undegraded":"2024-05-12T10:56:12.831171+0000","last_fullsized":"2024-05-12T10:56:12.831171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:03:47.220979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'342","reported_seq":562,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.931276+0000","last_change":"2024-05-12T10:49:59.676139+0000","last_active":"2024-05-12T10:58:01.931276+0000","last_peered":"2024-05-12T10:58:01.931276+0000","last_clean":"2024-05-12T10:58:01.931276+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:58:01.931276+0000","last_undegraded":"2024-05-12T10:58:01.931276+0000","last_fullsized":"2024-05-12T10:58:01.931276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:24:15.396258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844325+0000","last_change":"2024-05-12T10:49:54.645331+0000","last_active":"2024-05-12T10:54:57.844325+0000","last_peered":"2024-05-12T10:54:57.844325+0000","last_clean":"2024-05-12T10:54:57.844325+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:54:57.844325+0000","last_undegraded":"2024-05-12T10:54:57.844325+0000","last_fullsized":"2024-05-12T10:54:57.844325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:38:29.023589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.839121+0000","last_change":"2024-05-12T10:49:55.642386+0000","last_active":"2024-05-12T10:54:57.839121+0000","last_peered":"2024-05-12T10:54:57.839121+0000","last_clean":"2024-05-12T10:54:57.839121+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:54:57.839121+0000","last_undegraded":"2024-05-12T10:54:57.839121+0000","last_fullsized":"2024-05-12T10:54:57.839121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:54:40.153070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'284","reported_seq":457,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.898022+0000","last_change":"2024-05-12T10:49:59.679887+0000","last_active":"2024-05-12T10:58:01.898022+0000","last_peered":"2024-05-12T10:58:01.898022+0000","last_clean":"2024-05-12T10:58:01.898022+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:58:01.898022+0000","last_undegraded":"2024-05-12T10:58:01.898022+0000","last_fullsized":"2024-05-12T10:58:01.898022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:25:43.004918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":274,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844272+0000","last_change":"2024-05-12T10:49:54.659229+0000","last_active":"2024-05-12T10:54:57.844272+0000","last_peered":"2024-05-12T10:54:57.844272+0000","last_clean":"2024-05-12T10:54:57.844272+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:54:57.844272+0000","last_undegraded":"2024-05-12T10:54:57.844272+0000","last_fullsized":"2024-05-12T10:54:57.844272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:54:54.658165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.839147+0000","last_change":"2024-05-12T10:49:55.642157+0000","last_active":"2024-05-12T10:54:57.839147+0000","last_peered":"2024-05-12T10:54:57.839147+0000","last_clean":"2024-05-12T10:54:57.839147+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:54:57.839147+0000","last_undegraded":"2024-05-12T10:54:57.839147+0000","last_fullsized":"2024-05-12T10:54:57.839147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:16.232731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'263","reported_seq":429,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.893300+0000","last_change":"2024-05-12T10:49:59.663411+0000","last_active":"2024-05-12T10:58:01.893300+0000","last_peered":"2024-05-12T10:58:01.893300+0000","last_clean":"2024-05-12T10:58:01.893300+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:58:01.893300+0000","last_undegraded":"2024-05-12T10:58:01.893300+0000","last_fullsized":"2024-05-12T10:58:01.893300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:59.136704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.836036+0000","last_change":"2024-05-12T10:49:55.646019+0000","last_active":"2024-05-12T10:54:17.836036+0000","last_peered":"2024-05-12T10:54:17.836036+0000","last_clean":"2024-05-12T10:54:17.836036+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:54:17.836036+0000","last_undegraded":"2024-05-12T10:54:17.836036+0000","last_fullsized":"2024-05-12T10:54:17.836036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:07.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835029+0000","last_change":"2024-05-12T10:49:54.642039+0000","last_active":"2024-05-12T10:54:27.835029+0000","last_peered":"2024-05-12T10:54:27.835029+0000","last_clean":"2024-05-12T10:54:27.835029+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:54:27.835029+0000","last_undegraded":"2024-05-12T10:54:27.835029+0000","last_fullsized":"2024-05-12T10:54:27.835029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:01.155569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'316","reported_seq":520,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.922676+0000","last_change":"2024-05-12T10:49:59.660274+0000","last_active":"2024-05-12T10:58:01.922676+0000","last_peered":"2024-05-12T10:58:01.922676+0000","last_clean":"2024-05-12T10:58:01.922676+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:58:01.922676+0000","last_undegraded":"2024-05-12T10:58:01.922676+0000","last_fullsized":"2024-05-12T10:58:01.922676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:55:12.579645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":737280,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.812386+0000","last_change":"2024-05-12T10:49:55.618128+0000","last_active":"2024-05-12T10:54:27.812386+0000","last_peered":"2024-05-12T10:54:27.812386+0000","last_clean":"2024-05-12T10:54:27.812386+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:54:27.812386+0000","last_undegraded":"2024-05-12T10:54:27.812386+0000","last_fullsized":"2024-05-12T10:54:27.812386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:45.205117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812560+0000","last_change":"2024-05-12T10:49:54.619967+0000","last_active":"2024-05-12T10:54:17.812560+0000","last_peered":"2024-05-12T10:54:17.812560+0000","last_clean":"2024-05-12T10:54:17.812560+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:54:17.812560+0000","last_undegraded":"2024-05-12T10:54:17.812560+0000","last_fullsized":"2024-05-12T10:54:17.812560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:37:10.799631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'296","reported_seq":488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.884554+0000","last_change":"2024-05-12T10:49:59.681931+0000","last_active":"2024-05-12T10:58:01.884554+0000","last_peered":"2024-05-12T10:58:01.884554+0000","last_clean":"2024-05-12T10:58:01.884554+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:58:01.884554+0000","last_undegraded":"2024-05-12T10:58:01.884554+0000","last_fullsized":"2024-05-12T10:58:01.884554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:45:01.542628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811343+0000","last_change":"2024-05-12T10:49:55.615095+0000","last_active":"2024-05-12T10:54:17.811343+0000","last_peered":"2024-05-12T10:54:17.811343+0000","last_clean":"2024-05-12T10:54:17.811343+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:54:17.811343+0000","last_undegraded":"2024-05-12T10:54:17.811343+0000","last_fullsized":"2024-05-12T10:54:17.811343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:51:19.659941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812526+0000","last_change":"2024-05-12T10:49:54.639976+0000","last_active":"2024-05-12T10:54:17.812526+0000","last_peered":"2024-05-12T10:54:17.812526+0000","last_clean":"2024-05-12T10:54:17.812526+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:54:17.812526+0000","last_undegraded":"2024-05-12T10:54:17.812526+0000","last_fullsized":"2024-05-12T10:54:17.812526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:28:37.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'273","reported_seq":446,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.859327+0000","last_change":"2024-05-12T10:50:36.857272+0000","last_active":"2024-05-12T10:58:01.859327+0000","last_peered":"2024-05-12T10:58:01.859327+0000","last_clean":"2024-05-12T10:58:01.859327+0000","last_became_active":"2024-05-12T10:50:36.856826+0000","last_became_peered":"2024-05-12T10:50:36.856826+0000","last_unstale":"2024-05-12T10:58:01.859327+0000","last_undegraded":"2024-05-12T10:58:01.859327+0000","last_fullsized":"2024-05-12T10:58:01.859327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:39:58.339959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.839725+0000","last_change":"2024-05-12T10:49:55.622729+0000","last_active":"2024-05-12T10:54:17.839725+0000","last_peered":"2024-05-12T10:54:17.839725+0000","last_clean":"2024-05-12T10:54:17.839725+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:54:17.839725+0000","last_undegraded":"2024-05-12T10:54:17.839725+0000","last_fullsized":"2024-05-12T10:54:17.839725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:08:29.460684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.833425+0000","last_change":"2024-05-12T10:49:54.639564+0000","last_active":"2024-05-12T10:54:17.833425+0000","last_peered":"2024-05-12T10:54:17.833425+0000","last_clean":"2024-05-12T10:54:17.833425+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:54:17.833425+0000","last_undegraded":"2024-05-12T10:54:17.833425+0000","last_fullsized":"2024-05-12T10:54:17.833425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:54:48.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'296","reported_seq":498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.952784+0000","last_change":"2024-05-12T10:50:36.858842+0000","last_active":"2024-05-12T10:58:01.952784+0000","last_peered":"2024-05-12T10:58:01.952784+0000","last_clean":"2024-05-12T10:58:01.952784+0000","last_became_active":"2024-05-12T10:50:36.857477+0000","last_became_peered":"2024-05-12T10:50:36.857477+0000","last_unstale":"2024-05-12T10:58:01.952784+0000","last_undegraded":"2024-05-12T10:58:01.952784+0000","last_fullsized":"2024-05-12T10:58:01.952784+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:08:55.931301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":700416,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812380+0000","last_change":"2024-05-12T10:49:55.612744+0000","last_active":"2024-05-12T10:54:17.812380+0000","last_peered":"2024-05-12T10:54:17.812380+0000","last_clean":"2024-05-12T10:54:17.812380+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:54:17.812380+0000","last_undegraded":"2024-05-12T10:54:17.812380+0000","last_fullsized":"2024-05-12T10:54:17.812380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:05:06.274277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.836166+0000","last_change":"2024-05-12T10:49:54.643375+0000","last_active":"2024-05-12T10:54:17.836166+0000","last_peered":"2024-05-12T10:54:17.836166+0000","last_clean":"2024-05-12T10:54:17.836166+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:54:17.836166+0000","last_undegraded":"2024-05-12T10:54:17.836166+0000","last_fullsized":"2024-05-12T10:54:17.836166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:56:43.086871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'259","reported_seq":414,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.958352+0000","last_change":"2024-05-12T10:50:00.393325+0000","last_active":"2024-05-12T10:58:01.958352+0000","last_peered":"2024-05-12T10:58:01.958352+0000","last_clean":"2024-05-12T10:58:01.958352+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:58:01.958352+0000","last_undegraded":"2024-05-12T10:58:01.958352+0000","last_fullsized":"2024-05-12T10:58:01.958352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:55.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":532480,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811404+0000","last_change":"2024-05-12T10:49:55.629693+0000","last_active":"2024-05-12T10:54:17.811404+0000","last_peered":"2024-05-12T10:54:17.811404+0000","last_clean":"2024-05-12T10:54:17.811404+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:54:17.811404+0000","last_undegraded":"2024-05-12T10:54:17.811404+0000","last_fullsized":"2024-05-12T10:54:17.811404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:04:13.325079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'33","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:58.766242+0000","last_change":"2024-05-12T10:49:54.629227+0000","last_active":"2024-05-12T10:57:58.766242+0000","last_peered":"2024-05-12T10:57:58.766242+0000","last_clean":"2024-05-12T10:57:58.766242+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:57:58.766242+0000","last_undegraded":"2024-05-12T10:57:58.766242+0000","last_fullsized":"2024-05-12T10:57:58.766242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:03.097527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'270","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:02.118119+0000","last_change":"2024-05-12T10:50:00.396371+0000","last_active":"2024-05-12T10:58:02.118119+0000","last_peered":"2024-05-12T10:58:02.118119+0000","last_clean":"2024-05-12T10:58:02.118119+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:58:02.118119+0000","last_undegraded":"2024-05-12T10:58:02.118119+0000","last_fullsized":"2024-05-12T10:58:02.118119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:41:09.157859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.852358+0000","last_change":"2024-05-12T10:49:55.612069+0000","last_active":"2024-05-12T10:56:12.852358+0000","last_peered":"2024-05-12T10:56:12.852358+0000","last_clean":"2024-05-12T10:56:12.852358+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:56:12.852358+0000","last_undegraded":"2024-05-12T10:56:12.852358+0000","last_fullsized":"2024-05-12T10:56:12.852358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:38.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.855055+0000","last_change":"2024-05-12T10:49:54.639928+0000","last_active":"2024-05-12T10:56:12.855055+0000","last_peered":"2024-05-12T10:56:12.855055+0000","last_clean":"2024-05-12T10:56:12.855055+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:56:12.855055+0000","last_undegraded":"2024-05-12T10:56:12.855055+0000","last_fullsized":"2024-05-12T10:56:12.855055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:59.215089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'261","reported_seq":422,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.956862+0000","last_change":"2024-05-12T10:50:00.383605+0000","last_active":"2024-05-12T10:58:01.956862+0000","last_peered":"2024-05-12T10:58:01.956862+0000","last_clean":"2024-05-12T10:58:01.956862+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:58:01.956862+0000","last_undegraded":"2024-05-12T10:58:01.956862+0000","last_fullsized":"2024-05-12T10:58:01.956862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:28.619988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856714+0000","last_change":"2024-05-12T10:49:55.621201+0000","last_active":"2024-05-12T10:56:12.856714+0000","last_peered":"2024-05-12T10:56:12.856714+0000","last_clean":"2024-05-12T10:56:12.856714+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:56:12.856714+0000","last_undegraded":"2024-05-12T10:56:12.856714+0000","last_fullsized":"2024-05-12T10:56:12.856714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:19:39.117790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.852384+0000","last_change":"2024-05-12T10:49:54.620329+0000","last_active":"2024-05-12T10:56:12.852384+0000","last_peered":"2024-05-12T10:56:12.852384+0000","last_clean":"2024-05-12T10:56:12.852384+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:56:12.852384+0000","last_undegraded":"2024-05-12T10:56:12.852384+0000","last_fullsized":"2024-05-12T10:56:12.852384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:21:10.386830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'282","reported_seq":465,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.960116+0000","last_change":"2024-05-12T10:49:59.655432+0000","last_active":"2024-05-12T10:58:01.960116+0000","last_peered":"2024-05-12T10:58:01.960116+0000","last_clean":"2024-05-12T10:58:01.960116+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:58:01.960116+0000","last_undegraded":"2024-05-12T10:58:01.960116+0000","last_fullsized":"2024-05-12T10:58:01.960116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:27:34.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.860789+0000","last_change":"2024-05-12T10:49:55.628221+0000","last_active":"2024-05-12T10:56:12.860789+0000","last_peered":"2024-05-12T10:56:12.860789+0000","last_clean":"2024-05-12T10:56:12.860789+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:56:12.860789+0000","last_undegraded":"2024-05-12T10:56:12.860789+0000","last_fullsized":"2024-05-12T10:56:12.860789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:54.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856655+0000","last_change":"2024-05-12T10:49:54.652499+0000","last_active":"2024-05-12T10:56:12.856655+0000","last_peered":"2024-05-12T10:56:12.856655+0000","last_clean":"2024-05-12T10:56:12.856655+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:56:12.856655+0000","last_undegraded":"2024-05-12T10:56:12.856655+0000","last_fullsized":"2024-05-12T10:56:12.856655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:14:35.180779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'269","reported_seq":442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.931250+0000","last_change":"2024-05-12T10:49:59.676676+0000","last_active":"2024-05-12T10:58:01.931250+0000","last_peered":"2024-05-12T10:58:01.931250+0000","last_clean":"2024-05-12T10:58:01.931250+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:58:01.931250+0000","last_undegraded":"2024-05-12T10:58:01.931250+0000","last_fullsized":"2024-05-12T10:58:01.931250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:03:13.485130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.837232+0000","last_change":"2024-05-12T10:49:55.610830+0000","last_active":"2024-05-12T10:55:57.837232+0000","last_peered":"2024-05-12T10:55:57.837232+0000","last_clean":"2024-05-12T10:55:57.837232+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:55:57.837232+0000","last_undegraded":"2024-05-12T10:55:57.837232+0000","last_fullsized":"2024-05-12T10:55:57.837232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:15.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'8","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:59.072730+0000","last_change":"2024-05-12T10:49:54.609239+0000","last_active":"2024-05-12T10:57:59.072730+0000","last_peered":"2024-05-12T10:57:59.072730+0000","last_clean":"2024-05-12T10:57:59.072730+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:57:59.072730+0000","last_undegraded":"2024-05-12T10:57:59.072730+0000","last_fullsized":"2024-05-12T10:57:59.072730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:12:54.169428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'281","reported_seq":447,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.933589+0000","last_change":"2024-05-12T10:49:59.656739+0000","last_active":"2024-05-12T10:58:01.933589+0000","last_peered":"2024-05-12T10:58:01.933589+0000","last_clean":"2024-05-12T10:58:01.933589+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:58:01.933589+0000","last_undegraded":"2024-05-12T10:58:01.933589+0000","last_fullsized":"2024-05-12T10:58:01.933589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:05.204757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831123+0000","last_change":"2024-05-12T10:49:55.626312+0000","last_active":"2024-05-12T10:56:12.831123+0000","last_peered":"2024-05-12T10:56:12.831123+0000","last_clean":"2024-05-12T10:56:12.831123+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:56:12.831123+0000","last_undegraded":"2024-05-12T10:56:12.831123+0000","last_fullsized":"2024-05-12T10:56:12.831123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:36.639971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.852660+0000","last_change":"2024-05-12T10:49:54.640819+0000","last_active":"2024-05-12T10:55:57.852660+0000","last_peered":"2024-05-12T10:55:57.852660+0000","last_clean":"2024-05-12T10:55:57.852660+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:55:57.852660+0000","last_undegraded":"2024-05-12T10:55:57.852660+0000","last_fullsized":"2024-05-12T10:55:57.852660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:01.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'345","reported_seq":555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.898435+0000","last_change":"2024-05-12T10:50:00.384347+0000","last_active":"2024-05-12T10:58:01.898435+0000","last_peered":"2024-05-12T10:58:01.898435+0000","last_clean":"2024-05-12T10:58:01.898435+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:58:01.898435+0000","last_undegraded":"2024-05-12T10:58:01.898435+0000","last_fullsized":"2024-05-12T10:58:01.898435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:30.794704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.894992+0000","last_change":"2024-05-12T10:50:36.847396+0000","last_active":"2024-05-12T10:54:47.894992+0000","last_peered":"2024-05-12T10:54:47.894992+0000","last_clean":"2024-05-12T10:54:47.894992+0000","last_became_active":"2024-05-12T10:50:36.847173+0000","last_became_peered":"2024-05-12T10:50:36.847173+0000","last_unstale":"2024-05-12T10:54:47.894992+0000","last_undegraded":"2024-05-12T10:54:47.894992+0000","last_fullsized":"2024-05-12T10:54:47.894992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:33:38.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856683+0000","last_change":"2024-05-12T10:49:54.648333+0000","last_active":"2024-05-12T10:56:12.856683+0000","last_peered":"2024-05-12T10:56:12.856683+0000","last_clean":"2024-05-12T10:56:12.856683+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:56:12.856683+0000","last_undegraded":"2024-05-12T10:56:12.856683+0000","last_fullsized":"2024-05-12T10:56:12.856683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:29.355444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:47.851335+0000","last_change":"2024-05-12T10:49:45.547469+0000","last_active":"2024-05-12T10:55:47.851335+0000","last_peered":"2024-05-12T10:55:47.851335+0000","last_clean":"2024-05-12T10:55:47.851335+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:55:47.851335+0000","last_undegraded":"2024-05-12T10:55:47.851335+0000","last_fullsized":"2024-05-12T10:55:47.851335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_clean_scrub_stamp":"2024-05-12T10:49:43.953472+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:44:15.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'290","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.940955+0000","last_change":"2024-05-12T10:50:00.399288+0000","last_active":"2024-05-12T10:58:01.940955+0000","last_peered":"2024-05-12T10:58:01.940955+0000","last_clean":"2024-05-12T10:58:01.940955+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:58:01.940955+0000","last_undegraded":"2024-05-12T10:58:01.940955+0000","last_fullsized":"2024-05-12T10:58:01.940955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:26.959086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835074+0000","last_change":"2024-05-12T10:49:55.639605+0000","last_active":"2024-05-12T10:54:27.835074+0000","last_peered":"2024-05-12T10:54:27.835074+0000","last_clean":"2024-05-12T10:54:27.835074+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:54:27.835074+0000","last_undegraded":"2024-05-12T10:54:27.835074+0000","last_fullsized":"2024-05-12T10:54:27.835074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:46:26.585195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.883531+0000","last_change":"2024-05-12T10:49:54.654999+0000","last_active":"2024-05-12T10:54:27.883531+0000","last_peered":"2024-05-12T10:54:27.883531+0000","last_clean":"2024-05-12T10:54:27.883531+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:54:27.883531+0000","last_undegraded":"2024-05-12T10:54:27.883531+0000","last_fullsized":"2024-05-12T10:54:27.883531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:00:20.115739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'291","reported_seq":475,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.907983+0000","last_change":"2024-05-12T10:50:00.393017+0000","last_active":"2024-05-12T10:58:01.907983+0000","last_peered":"2024-05-12T10:58:01.907983+0000","last_clean":"2024-05-12T10:58:01.907983+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:58:01.907983+0000","last_undegraded":"2024-05-12T10:58:01.907983+0000","last_fullsized":"2024-05-12T10:58:01.907983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:01:02.394572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:07.899725+0000","last_change":"2024-05-12T10:50:36.844615+0000","last_active":"2024-05-12T10:55:07.899725+0000","last_peered":"2024-05-12T10:55:07.899725+0000","last_clean":"2024-05-12T10:55:07.899725+0000","last_became_active":"2024-05-12T10:50:36.844312+0000","last_became_peered":"2024-05-12T10:50:36.844312+0000","last_unstale":"2024-05-12T10:55:07.899725+0000","last_undegraded":"2024-05-12T10:55:07.899725+0000","last_fullsized":"2024-05-12T10:55:07.899725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:54:38.598097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.813649+0000","last_change":"2024-05-12T10:49:54.628492+0000","last_active":"2024-05-12T10:54:27.813649+0000","last_peered":"2024-05-12T10:54:27.813649+0000","last_clean":"2024-05-12T10:54:27.813649+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:54:27.813649+0000","last_undegraded":"2024-05-12T10:54:27.813649+0000","last_fullsized":"2024-05-12T10:54:27.813649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:35:38.949401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'266","reported_seq":432,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.943209+0000","last_change":"2024-05-12T10:49:59.657783+0000","last_active":"2024-05-12T10:58:01.943209+0000","last_peered":"2024-05-12T10:58:01.943209+0000","last_clean":"2024-05-12T10:58:01.943209+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:58:01.943209+0000","last_undegraded":"2024-05-12T10:58:01.943209+0000","last_fullsized":"2024-05-12T10:58:01.943209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:51:21.103458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835147+0000","last_change":"2024-05-12T10:49:55.646246+0000","last_active":"2024-05-12T10:54:27.835147+0000","last_peered":"2024-05-12T10:54:27.835147+0000","last_clean":"2024-05-12T10:54:27.835147+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:54:27.835147+0000","last_undegraded":"2024-05-12T10:54:27.835147+0000","last_fullsized":"2024-05-12T10:54:27.835147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:32.142128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.883564+0000","last_change":"2024-05-12T10:49:54.610076+0000","last_active":"2024-05-12T10:54:27.883564+0000","last_peered":"2024-05-12T10:54:27.883564+0000","last_clean":"2024-05-12T10:54:27.883564+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:54:27.883564+0000","last_undegraded":"2024-05-12T10:54:27.883564+0000","last_fullsized":"2024-05-12T10:54:27.883564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:12:04.400894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'323","reported_seq":517,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.901879+0000","last_change":"2024-05-12T10:50:00.386172+0000","last_active":"2024-05-12T10:58:01.901879+0000","last_peered":"2024-05-12T10:58:01.901879+0000","last_clean":"2024-05-12T10:58:01.901879+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:58:01.901879+0000","last_undegraded":"2024-05-12T10:58:01.901879+0000","last_fullsized":"2024-05-12T10:58:01.901879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:06:17.550197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835124+0000","last_change":"2024-05-12T10:49:55.646249+0000","last_active":"2024-05-12T10:54:27.835124+0000","last_peered":"2024-05-12T10:54:27.835124+0000","last_clean":"2024-05-12T10:54:27.835124+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:54:27.835124+0000","last_undegraded":"2024-05-12T10:54:27.835124+0000","last_fullsized":"2024-05-12T10:54:27.835124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:15.036675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.841354+0000","last_change":"2024-05-12T10:49:54.621293+0000","last_active":"2024-05-12T10:54:27.841354+0000","last_peered":"2024-05-12T10:54:27.841354+0000","last_clean":"2024-05-12T10:54:27.841354+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:54:27.841354+0000","last_undegraded":"2024-05-12T10:54:27.841354+0000","last_fullsized":"2024-05-12T10:54:27.841354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:45:33.341215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'269","reported_seq":427,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.764286+0000","last_change":"2024-05-12T10:49:59.673656+0000","last_active":"2024-05-12T10:58:01.764286+0000","last_peered":"2024-05-12T10:58:01.764286+0000","last_clean":"2024-05-12T10:58:01.764286+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:58:01.764286+0000","last_undegraded":"2024-05-12T10:58:01.764286+0000","last_fullsized":"2024-05-12T10:58:01.764286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:38.364434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":548864,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836743+0000","last_change":"2024-05-12T10:49:55.646526+0000","last_active":"2024-05-12T10:54:37.836743+0000","last_peered":"2024-05-12T10:54:37.836743+0000","last_clean":"2024-05-12T10:54:37.836743+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:54:37.836743+0000","last_undegraded":"2024-05-12T10:54:37.836743+0000","last_fullsized":"2024-05-12T10:54:37.836743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:56:52.102442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.884467+0000","last_change":"2024-05-12T10:49:54.617906+0000","last_active":"2024-05-12T10:54:37.884467+0000","last_peered":"2024-05-12T10:54:37.884467+0000","last_clean":"2024-05-12T10:54:37.884467+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:54:37.884467+0000","last_undegraded":"2024-05-12T10:54:37.884467+0000","last_fullsized":"2024-05-12T10:54:37.884467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:26:35.150963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'374","reported_seq":598,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.957230+0000","last_change":"2024-05-12T10:49:59.671791+0000","last_active":"2024-05-12T10:58:01.957230+0000","last_peered":"2024-05-12T10:58:01.957230+0000","last_clean":"2024-05-12T10:58:01.957230+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:58:01.957230+0000","last_undegraded":"2024-05-12T10:58:01.957230+0000","last_fullsized":"2024-05-12T10:58:01.957230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:27.425708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":819200,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.839212+0000","last_change":"2024-05-12T10:49:55.637810+0000","last_active":"2024-05-12T10:54:37.839212+0000","last_peered":"2024-05-12T10:54:37.839212+0000","last_clean":"2024-05-12T10:54:37.839212+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:54:37.839212+0000","last_undegraded":"2024-05-12T10:54:37.839212+0000","last_fullsized":"2024-05-12T10:54:37.839212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:52.001497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.839247+0000","last_change":"2024-05-12T10:49:54.637728+0000","last_active":"2024-05-12T10:54:37.839247+0000","last_peered":"2024-05-12T10:54:37.839247+0000","last_clean":"2024-05-12T10:54:37.839247+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:54:37.839247+0000","last_undegraded":"2024-05-12T10:54:37.839247+0000","last_fullsized":"2024-05-12T10:54:37.839247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:39.996419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'283","reported_seq":453,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.948262+0000","last_change":"2024-05-12T10:50:00.383444+0000","last_active":"2024-05-12T10:58:01.948262+0000","last_peered":"2024-05-12T10:58:01.948262+0000","last_clean":"2024-05-12T10:58:01.948262+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:58:01.948262+0000","last_undegraded":"2024-05-12T10:58:01.948262+0000","last_fullsized":"2024-05-12T10:58:01.948262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:55:04.226848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836797+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:54:37.836797+0000","last_peered":"2024-05-12T10:54:37.836797+0000","last_clean":"2024-05-12T10:54:37.836797+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:54:37.836797+0000","last_undegraded":"2024-05-12T10:54:37.836797+0000","last_fullsized":"2024-05-12T10:54:37.836797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:15:58.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836051+0000","last_change":"2024-05-12T10:49:54.656814+0000","last_active":"2024-05-12T10:54:37.836051+0000","last_peered":"2024-05-12T10:54:37.836051+0000","last_clean":"2024-05-12T10:54:37.836051+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:54:37.836051+0000","last_undegraded":"2024-05-12T10:54:37.836051+0000","last_fullsized":"2024-05-12T10:54:37.836051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:26.660043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'279","reported_seq":450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.861231+0000","last_change":"2024-05-12T10:50:00.390308+0000","last_active":"2024-05-12T10:58:01.861231+0000","last_peered":"2024-05-12T10:58:01.861231+0000","last_clean":"2024-05-12T10:58:01.861231+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:58:01.861231+0000","last_undegraded":"2024-05-12T10:58:01.861231+0000","last_fullsized":"2024-05-12T10:58:01.861231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:43.650956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814290+0000","last_change":"2024-05-12T10:49:55.628907+0000","last_active":"2024-05-12T10:54:37.814290+0000","last_peered":"2024-05-12T10:54:37.814290+0000","last_clean":"2024-05-12T10:54:37.814290+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:54:37.814290+0000","last_undegraded":"2024-05-12T10:54:37.814290+0000","last_fullsized":"2024-05-12T10:54:37.814290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:13:50.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814322+0000","last_change":"2024-05-12T10:49:54.626002+0000","last_active":"2024-05-12T10:54:37.814322+0000","last_peered":"2024-05-12T10:54:37.814322+0000","last_clean":"2024-05-12T10:54:37.814322+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:54:37.814322+0000","last_undegraded":"2024-05-12T10:54:37.814322+0000","last_fullsized":"2024-05-12T10:54:37.814322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:19:19.976387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'329","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.813514+0000","last_change":"2024-05-12T10:50:00.387192+0000","last_active":"2024-05-12T10:58:01.813514+0000","last_peered":"2024-05-12T10:58:01.813514+0000","last_clean":"2024-05-12T10:58:01.813514+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:58:01.813514+0000","last_undegraded":"2024-05-12T10:58:01.813514+0000","last_fullsized":"2024-05-12T10:58:01.813514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:15:23.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.842525+0000","last_change":"2024-05-12T10:49:55.634551+0000","last_active":"2024-05-12T10:54:47.842525+0000","last_peered":"2024-05-12T10:54:47.842525+0000","last_clean":"2024-05-12T10:54:47.842525+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:54:47.842525+0000","last_undegraded":"2024-05-12T10:54:47.842525+0000","last_fullsized":"2024-05-12T10:54:47.842525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:10:52.477145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'1907","reported_seq":1938,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:27.469074+0000","last_change":"2024-05-12T10:49:54.634748+0000","last_active":"2024-05-12T10:58:27.469074+0000","last_peered":"2024-05-12T10:58:27.469074+0000","last_clean":"2024-05-12T10:58:27.469074+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:58:27.469074+0000","last_undegraded":"2024-05-12T10:58:27.469074+0000","last_fullsized":"2024-05-12T10:58:27.469074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1907,"log_dups_size":0,"ondisk_log_size":1907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:39:16.646133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3827324,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1907,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'296","reported_seq":480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.926093+0000","last_change":"2024-05-12T10:49:59.671405+0000","last_active":"2024-05-12T10:58:01.926093+0000","last_peered":"2024-05-12T10:58:01.926093+0000","last_clean":"2024-05-12T10:58:01.926093+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:58:01.926093+0000","last_undegraded":"2024-05-12T10:58:01.926093+0000","last_fullsized":"2024-05-12T10:58:01.926093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:06:34.170753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.842947+0000","last_change":"2024-05-12T10:49:55.634686+0000","last_active":"2024-05-12T10:54:37.842947+0000","last_peered":"2024-05-12T10:54:37.842947+0000","last_clean":"2024-05-12T10:54:37.842947+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:54:37.842947+0000","last_undegraded":"2024-05-12T10:54:37.842947+0000","last_fullsized":"2024-05-12T10:54:37.842947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:25:04.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'8","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:12.886479+0000","last_change":"2024-05-12T10:49:54.656012+0000","last_active":"2024-05-12T10:57:12.886479+0000","last_peered":"2024-05-12T10:57:12.886479+0000","last_clean":"2024-05-12T10:57:12.886479+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:57:12.886479+0000","last_undegraded":"2024-05-12T10:57:12.886479+0000","last_fullsized":"2024-05-12T10:57:12.886479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:29.253250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'304","reported_seq":503,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.906496+0000","last_change":"2024-05-12T10:49:59.672820+0000","last_active":"2024-05-12T10:58:01.906496+0000","last_peered":"2024-05-12T10:58:01.906496+0000","last_clean":"2024-05-12T10:58:01.906496+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:58:01.906496+0000","last_undegraded":"2024-05-12T10:58:01.906496+0000","last_fullsized":"2024-05-12T10:58:01.906496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:49:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":716800,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.815288+0000","last_change":"2024-05-12T10:49:55.620541+0000","last_active":"2024-05-12T10:54:47.815288+0000","last_peered":"2024-05-12T10:54:47.815288+0000","last_clean":"2024-05-12T10:54:47.815288+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:54:47.815288+0000","last_undegraded":"2024-05-12T10:54:47.815288+0000","last_fullsized":"2024-05-12T10:54:47.815288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:11.742829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.837479+0000","last_change":"2024-05-12T10:49:54.651289+0000","last_active":"2024-05-12T10:54:47.837479+0000","last_peered":"2024-05-12T10:54:47.837479+0000","last_clean":"2024-05-12T10:54:47.837479+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:54:47.837479+0000","last_undegraded":"2024-05-12T10:54:47.837479+0000","last_fullsized":"2024-05-12T10:54:47.837479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:33:24.087763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'307","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.889067+0000","last_change":"2024-05-12T10:50:36.855844+0000","last_active":"2024-05-12T10:58:01.889067+0000","last_peered":"2024-05-12T10:58:01.889067+0000","last_clean":"2024-05-12T10:58:01.889067+0000","last_became_active":"2024-05-12T10:50:36.855397+0000","last_became_peered":"2024-05-12T10:50:36.855397+0000","last_unstale":"2024-05-12T10:58:01.889067+0000","last_undegraded":"2024-05-12T10:58:01.889067+0000","last_fullsized":"2024-05-12T10:58:01.889067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:14:10.664926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.837469+0000","last_change":"2024-05-12T10:49:55.626645+0000","last_active":"2024-05-12T10:54:47.837469+0000","last_peered":"2024-05-12T10:54:47.837469+0000","last_clean":"2024-05-12T10:54:47.837469+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:54:47.837469+0000","last_undegraded":"2024-05-12T10:54:47.837469+0000","last_fullsized":"2024-05-12T10:54:47.837469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:41.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.850647+0000","last_change":"2024-05-12T10:49:54.654822+0000","last_active":"2024-05-12T10:54:47.850647+0000","last_peered":"2024-05-12T10:54:47.850647+0000","last_clean":"2024-05-12T10:54:47.850647+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:54:47.850647+0000","last_undegraded":"2024-05-12T10:54:47.850647+0000","last_fullsized":"2024-05-12T10:54:47.850647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:52:07.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'332","reported_seq":530,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.938963+0000","last_change":"2024-05-12T10:50:00.396453+0000","last_active":"2024-05-12T10:58:01.938963+0000","last_peered":"2024-05-12T10:58:01.938963+0000","last_clean":"2024-05-12T10:58:01.938963+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:58:01.938963+0000","last_undegraded":"2024-05-12T10:58:01.938963+0000","last_fullsized":"2024-05-12T10:58:01.938963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:40.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'283","reported_seq":465,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.940540+0000","last_change":"2024-05-12T10:50:00.390477+0000","last_active":"2024-05-12T10:58:01.940540+0000","last_peered":"2024-05-12T10:58:01.940540+0000","last_clean":"2024-05-12T10:58:01.940540+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:58:01.940540+0000","last_undegraded":"2024-05-12T10:58:01.940540+0000","last_fullsized":"2024-05-12T10:58:01.940540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:20:19.551216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":643072,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:57:12.886432+0000","last_change":"2024-05-12T10:49:55.619984+0000","last_active":"2024-05-12T10:57:12.886432+0000","last_peered":"2024-05-12T10:57:12.886432+0000","last_clean":"2024-05-12T10:57:12.886432+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:57:12.886432+0000","last_undegraded":"2024-05-12T10:57:12.886432+0000","last_fullsized":"2024-05-12T10:57:12.886432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:21:34.136203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.837419+0000","last_change":"2024-05-12T10:49:54.656580+0000","last_active":"2024-05-12T10:54:47.837419+0000","last_peered":"2024-05-12T10:54:47.837419+0000","last_clean":"2024-05-12T10:54:47.837419+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:54:47.837419+0000","last_undegraded":"2024-05-12T10:54:47.837419+0000","last_fullsized":"2024-05-12T10:54:47.837419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:43:32.603999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'272","reported_seq":449,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.950582+0000","last_change":"2024-05-12T10:49:59.681648+0000","last_active":"2024-05-12T10:58:01.950582+0000","last_peered":"2024-05-12T10:58:01.950582+0000","last_clean":"2024-05-12T10:58:01.950582+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:58:01.950582+0000","last_undegraded":"2024-05-12T10:58:01.950582+0000","last_fullsized":"2024-05-12T10:58:01.950582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:54.912836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.814669+0000","last_change":"2024-05-12T10:49:55.617393+0000","last_active":"2024-05-12T10:54:47.814669+0000","last_peered":"2024-05-12T10:54:47.814669+0000","last_clean":"2024-05-12T10:54:47.814669+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:54:47.814669+0000","last_undegraded":"2024-05-12T10:54:47.814669+0000","last_fullsized":"2024-05-12T10:54:47.814669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:51.584695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.814701+0000","last_change":"2024-05-12T10:49:54.637393+0000","last_active":"2024-05-12T10:54:47.814701+0000","last_peered":"2024-05-12T10:54:47.814701+0000","last_clean":"2024-05-12T10:54:47.814701+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:54:47.814701+0000","last_undegraded":"2024-05-12T10:54:47.814701+0000","last_fullsized":"2024-05-12T10:54:47.814701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:44:00.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.852132+0000","last_change":"2024-05-12T10:49:54.636945+0000","last_active":"2024-05-12T10:54:57.852132+0000","last_peered":"2024-05-12T10:54:57.852132+0000","last_clean":"2024-05-12T10:54:57.852132+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:54:57.852132+0000","last_undegraded":"2024-05-12T10:54:57.852132+0000","last_fullsized":"2024-05-12T10:54:57.852132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:34:25.927458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.816216+0000","last_change":"2024-05-12T10:49:55.627105+0000","last_active":"2024-05-12T10:54:57.816216+0000","last_peered":"2024-05-12T10:54:57.816216+0000","last_clean":"2024-05-12T10:54:57.816216+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:54:57.816216+0000","last_undegraded":"2024-05-12T10:54:57.816216+0000","last_fullsized":"2024-05-12T10:54:57.816216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:00:09.334541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'308","reported_seq":502,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.834536+0000","last_change":"2024-05-12T10:49:59.659142+0000","last_active":"2024-05-12T10:58:01.834536+0000","last_peered":"2024-05-12T10:58:01.834536+0000","last_clean":"2024-05-12T10:58:01.834536+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:58:01.834536+0000","last_undegraded":"2024-05-12T10:58:01.834536+0000","last_fullsized":"2024-05-12T10:58:01.834536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:40.443593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.815773+0000","last_change":"2024-05-12T10:49:54.632224+0000","last_active":"2024-05-12T10:54:57.815773+0000","last_peered":"2024-05-12T10:54:57.815773+0000","last_clean":"2024-05-12T10:54:57.815773+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:54:57.815773+0000","last_undegraded":"2024-05-12T10:54:57.815773+0000","last_fullsized":"2024-05-12T10:54:57.815773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:27:39.637678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.845878+0000","last_change":"2024-05-12T10:49:55.633243+0000","last_active":"2024-05-12T10:54:57.845878+0000","last_peered":"2024-05-12T10:54:57.845878+0000","last_clean":"2024-05-12T10:54:57.845878+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:54:57.845878+0000","last_undegraded":"2024-05-12T10:54:57.845878+0000","last_fullsized":"2024-05-12T10:54:57.845878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:14.239020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'317","reported_seq":514,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.897764+0000","last_change":"2024-05-12T10:49:59.655807+0000","last_active":"2024-05-12T10:58:01.897764+0000","last_peered":"2024-05-12T10:58:01.897764+0000","last_clean":"2024-05-12T10:58:01.897764+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:58:01.897764+0000","last_undegraded":"2024-05-12T10:58:01.897764+0000","last_fullsized":"2024-05-12T10:58:01.897764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:12.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.861868+0000","last_change":"2024-05-12T10:49:55.637106+0000","last_active":"2024-05-12T10:56:12.861868+0000","last_peered":"2024-05-12T10:56:12.861868+0000","last_clean":"2024-05-12T10:56:12.861868+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:56:12.861868+0000","last_undegraded":"2024-05-12T10:56:12.861868+0000","last_fullsized":"2024-05-12T10:56:12.861868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:22:07.477677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.908806+0000","last_change":"2024-05-12T10:49:55.618952+0000","last_active":"2024-05-12T10:56:12.908806+0000","last_peered":"2024-05-12T10:56:12.908806+0000","last_clean":"2024-05-12T10:56:12.908806+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:56:12.908806+0000","last_undegraded":"2024-05-12T10:56:12.908806+0000","last_fullsized":"2024-05-12T10:56:12.908806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:38:10.693066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856628+0000","last_change":"2024-05-12T10:49:55.623916+0000","last_active":"2024-05-12T10:56:12.856628+0000","last_peered":"2024-05-12T10:56:12.856628+0000","last_clean":"2024-05-12T10:56:12.856628+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:56:12.856628+0000","last_undegraded":"2024-05-12T10:56:12.856628+0000","last_fullsized":"2024-05-12T10:56:12.856628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:06:14.434631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831149+0000","last_change":"2024-05-12T10:49:55.620278+0000","last_active":"2024-05-12T10:56:12.831149+0000","last_peered":"2024-05-12T10:56:12.831149+0000","last_clean":"2024-05-12T10:56:12.831149+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:56:12.831149+0000","last_undegraded":"2024-05-12T10:56:12.831149+0000","last_fullsized":"2024-05-12T10:56:12.831149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:59.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811377+0000","last_change":"2024-05-12T10:49:55.626216+0000","last_active":"2024-05-12T10:54:17.811377+0000","last_peered":"2024-05-12T10:54:17.811377+0000","last_clean":"2024-05-12T10:54:17.811377+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:54:17.811377+0000","last_undegraded":"2024-05-12T10:54:17.811377+0000","last_fullsized":"2024-05-12T10:54:17.811377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:52:14.438331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.812588+0000","last_change":"2024-05-12T10:49:55.622085+0000","last_active":"2024-05-12T10:54:17.812588+0000","last_peered":"2024-05-12T10:54:17.812588+0000","last_clean":"2024-05-12T10:54:17.812588+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:54:17.812588+0000","last_undegraded":"2024-05-12T10:54:17.812588+0000","last_fullsized":"2024-05-12T10:54:17.812588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:41:42.558506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.836134+0000","last_change":"2024-05-12T10:50:36.856467+0000","last_active":"2024-05-12T10:54:17.836134+0000","last_peered":"2024-05-12T10:54:17.836134+0000","last_clean":"2024-05-12T10:54:17.836134+0000","last_became_active":"2024-05-12T10:50:36.855517+0000","last_became_peered":"2024-05-12T10:50:36.855517+0000","last_unstale":"2024-05-12T10:54:17.836134+0000","last_undegraded":"2024-05-12T10:54:17.836134+0000","last_fullsized":"2024-05-12T10:54:17.836134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:35.215695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.811397+0000","last_change":"2024-05-12T10:49:55.626353+0000","last_active":"2024-05-12T10:54:17.811397+0000","last_peered":"2024-05-12T10:54:17.811397+0000","last_clean":"2024-05-12T10:54:17.811397+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:54:17.811397+0000","last_undegraded":"2024-05-12T10:54:17.811397+0000","last_fullsized":"2024-05-12T10:54:17.811397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:58.905284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.832667+0000","last_change":"2024-05-12T10:49:55.621110+0000","last_active":"2024-05-12T10:54:17.832667+0000","last_peered":"2024-05-12T10:54:17.832667+0000","last_clean":"2024-05-12T10:54:17.832667+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:54:17.832667+0000","last_undegraded":"2024-05-12T10:54:17.832667+0000","last_fullsized":"2024-05-12T10:54:17.832667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:12:36.369923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.812357+0000","last_change":"2024-05-12T10:49:55.626913+0000","last_active":"2024-05-12T10:54:27.812357+0000","last_peered":"2024-05-12T10:54:27.812357+0000","last_clean":"2024-05-12T10:54:27.812357+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:54:27.812357+0000","last_undegraded":"2024-05-12T10:54:27.812357+0000","last_fullsized":"2024-05-12T10:54:27.812357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:27:08.492294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.834327+0000","last_change":"2024-05-12T10:49:55.629992+0000","last_active":"2024-05-12T10:54:27.834327+0000","last_peered":"2024-05-12T10:54:27.834327+0000","last_clean":"2024-05-12T10:54:27.834327+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:54:27.834327+0000","last_undegraded":"2024-05-12T10:54:27.834327+0000","last_fullsized":"2024-05-12T10:54:27.834327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:31.454363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.813293+0000","last_change":"2024-05-12T10:49:55.620821+0000","last_active":"2024-05-12T10:54:27.813293+0000","last_peered":"2024-05-12T10:54:27.813293+0000","last_clean":"2024-05-12T10:54:27.813293+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:54:27.813293+0000","last_undegraded":"2024-05-12T10:54:27.813293+0000","last_fullsized":"2024-05-12T10:54:27.813293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:53.597215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.837690+0000","last_change":"2024-05-12T10:49:55.646368+0000","last_active":"2024-05-12T10:54:27.837690+0000","last_peered":"2024-05-12T10:54:27.837690+0000","last_clean":"2024-05-12T10:54:27.837690+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:54:27.837690+0000","last_undegraded":"2024-05-12T10:54:27.837690+0000","last_fullsized":"2024-05-12T10:54:27.837690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:21:04.313921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835101+0000","last_change":"2024-05-12T10:49:55.633122+0000","last_active":"2024-05-12T10:54:27.835101+0000","last_peered":"2024-05-12T10:54:27.835101+0000","last_clean":"2024-05-12T10:54:27.835101+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:54:27.835101+0000","last_undegraded":"2024-05-12T10:54:27.835101+0000","last_fullsized":"2024-05-12T10:54:27.835101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:25:19.563648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.884507+0000","last_change":"2024-05-12T10:49:55.635394+0000","last_active":"2024-05-12T10:54:37.884507+0000","last_peered":"2024-05-12T10:54:37.884507+0000","last_clean":"2024-05-12T10:54:37.884507+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:54:37.884507+0000","last_undegraded":"2024-05-12T10:54:37.884507+0000","last_fullsized":"2024-05-12T10:54:37.884507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:41:58.478292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836122+0000","last_change":"2024-05-12T10:49:55.626485+0000","last_active":"2024-05-12T10:54:37.836122+0000","last_peered":"2024-05-12T10:54:37.836122+0000","last_clean":"2024-05-12T10:54:37.836122+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:54:37.836122+0000","last_undegraded":"2024-05-12T10:54:37.836122+0000","last_fullsized":"2024-05-12T10:54:37.836122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:17.942339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.835959+0000","last_change":"2024-05-12T10:49:55.618820+0000","last_active":"2024-05-12T10:54:37.835959+0000","last_peered":"2024-05-12T10:54:37.835959+0000","last_clean":"2024-05-12T10:54:37.835959+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:54:37.835959+0000","last_undegraded":"2024-05-12T10:54:37.835959+0000","last_fullsized":"2024-05-12T10:54:37.835959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:23:00.474438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814505+0000","last_change":"2024-05-12T10:49:55.626429+0000","last_active":"2024-05-12T10:54:37.814505+0000","last_peered":"2024-05-12T10:54:37.814505+0000","last_clean":"2024-05-12T10:54:37.814505+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:54:37.814505+0000","last_undegraded":"2024-05-12T10:54:37.814505+0000","last_fullsized":"2024-05-12T10:54:37.814505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:40:02.709729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.814258+0000","last_change":"2024-05-12T10:49:55.612139+0000","last_active":"2024-05-12T10:54:37.814258+0000","last_peered":"2024-05-12T10:54:37.814258+0000","last_clean":"2024-05-12T10:54:37.814258+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:54:37.814258+0000","last_undegraded":"2024-05-12T10:54:37.814258+0000","last_fullsized":"2024-05-12T10:54:37.814258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:57:34.138392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.814715+0000","last_change":"2024-05-12T10:49:55.631137+0000","last_active":"2024-05-12T10:54:47.814715+0000","last_peered":"2024-05-12T10:54:47.814715+0000","last_clean":"2024-05-12T10:54:47.814715+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:54:47.814715+0000","last_undegraded":"2024-05-12T10:54:47.814715+0000","last_fullsized":"2024-05-12T10:54:47.814715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:04.390314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.844400+0000","last_change":"2024-05-12T10:49:55.643416+0000","last_active":"2024-05-12T10:54:47.844400+0000","last_peered":"2024-05-12T10:54:47.844400+0000","last_clean":"2024-05-12T10:54:47.844400+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:54:47.844400+0000","last_undegraded":"2024-05-12T10:54:47.844400+0000","last_fullsized":"2024-05-12T10:54:47.844400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:58.632966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.850612+0000","last_change":"2024-05-12T10:49:55.635847+0000","last_active":"2024-05-12T10:54:47.850612+0000","last_peered":"2024-05-12T10:54:47.850612+0000","last_clean":"2024-05-12T10:54:47.850612+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:54:47.850612+0000","last_undegraded":"2024-05-12T10:54:47.850612+0000","last_fullsized":"2024-05-12T10:54:47.850612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:57:51.222099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:04.930755+0000","last_change":"2024-05-12T10:49:55.641921+0000","last_active":"2024-05-12T10:55:04.930755+0000","last_peered":"2024-05-12T10:55:04.930755+0000","last_clean":"2024-05-12T10:55:04.930755+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:55:04.930755+0000","last_undegraded":"2024-05-12T10:55:04.930755+0000","last_fullsized":"2024-05-12T10:55:04.930755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:44:57.787358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.842584+0000","last_change":"2024-05-12T10:49:55.635853+0000","last_active":"2024-05-12T10:54:47.842584+0000","last_peered":"2024-05-12T10:54:47.842584+0000","last_clean":"2024-05-12T10:54:47.842584+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:54:47.842584+0000","last_undegraded":"2024-05-12T10:54:47.842584+0000","last_fullsized":"2024-05-12T10:54:47.842584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:04:39.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.815740+0000","last_change":"2024-05-12T10:50:36.914559+0000","last_active":"2024-05-12T10:54:57.815740+0000","last_peered":"2024-05-12T10:54:57.815740+0000","last_clean":"2024-05-12T10:54:57.815740+0000","last_became_active":"2024-05-12T10:50:36.914327+0000","last_became_peered":"2024-05-12T10:50:36.914327+0000","last_unstale":"2024-05-12T10:54:57.815740+0000","last_undegraded":"2024-05-12T10:54:57.815740+0000","last_fullsized":"2024-05-12T10:54:57.815740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:47:16.693858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844166+0000","last_change":"2024-05-12T10:49:55.629001+0000","last_active":"2024-05-12T10:54:57.844166+0000","last_peered":"2024-05-12T10:54:57.844166+0000","last_clean":"2024-05-12T10:54:57.844166+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:54:57.844166+0000","last_undegraded":"2024-05-12T10:54:57.844166+0000","last_fullsized":"2024-05-12T10:54:57.844166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:42:39.042271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.839062+0000","last_change":"2024-05-12T10:49:55.625540+0000","last_active":"2024-05-12T10:54:57.839062+0000","last_peered":"2024-05-12T10:54:57.839062+0000","last_clean":"2024-05-12T10:54:57.839062+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:54:57.839062+0000","last_undegraded":"2024-05-12T10:54:57.839062+0000","last_fullsized":"2024-05-12T10:54:57.839062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:35.621918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844222+0000","last_change":"2024-05-12T10:49:55.633576+0000","last_active":"2024-05-12T10:54:57.844222+0000","last_peered":"2024-05-12T10:54:57.844222+0000","last_clean":"2024-05-12T10:54:57.844222+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:54:57.844222+0000","last_undegraded":"2024-05-12T10:54:57.844222+0000","last_fullsized":"2024-05-12T10:54:57.844222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:06:16.255147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.850758+0000","last_change":"2024-05-12T10:49:55.624205+0000","last_active":"2024-05-12T10:55:57.850758+0000","last_peered":"2024-05-12T10:55:57.850758+0000","last_clean":"2024-05-12T10:55:57.850758+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:55:57.850758+0000","last_undegraded":"2024-05-12T10:55:57.850758+0000","last_fullsized":"2024-05-12T10:55:57.850758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:21.895269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.831159+0000","last_change":"2024-05-12T10:49:55.610461+0000","last_active":"2024-05-12T10:56:12.831159+0000","last_peered":"2024-05-12T10:56:12.831159+0000","last_clean":"2024-05-12T10:56:12.831159+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:56:12.831159+0000","last_undegraded":"2024-05-12T10:56:12.831159+0000","last_fullsized":"2024-05-12T10:56:12.831159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:44.511895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.852448+0000","last_change":"2024-05-12T10:49:55.608434+0000","last_active":"2024-05-12T10:56:12.852448+0000","last_peered":"2024-05-12T10:56:12.852448+0000","last_clean":"2024-05-12T10:56:12.852448+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:56:12.852448+0000","last_undegraded":"2024-05-12T10:56:12.852448+0000","last_fullsized":"2024-05-12T10:56:12.852448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:17.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.855119+0000","last_change":"2024-05-12T10:49:55.639296+0000","last_active":"2024-05-12T10:56:12.855119+0000","last_peered":"2024-05-12T10:56:12.855119+0000","last_clean":"2024-05-12T10:56:12.855119+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:56:12.855119+0000","last_undegraded":"2024-05-12T10:56:12.855119+0000","last_fullsized":"2024-05-12T10:56:12.855119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:47:15.862328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9475,"ondisk_log_size":9475,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3831519,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2096,"num_write_kb":4004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7823360,"data_stored":7663038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2052,"ondisk_log_size":2052,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542251,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58436,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313404,"statfs":{"total":96636764160,"available":96576925696,"internally_reserved":0,"allocated":913408,"data_stored":716485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542252,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79576,"kb_used_data":4048,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94292264,"statfs":{"total":96636764160,"available":96555278336,"internally_reserved":0,"allocated":4145152,"data_stored":3953061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542252,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53696,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318144,"statfs":{"total":96636764160,"available":96581779456,"internally_reserved":0,"allocated":319488,"data_stored":126179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542254,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45372,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326468,"statfs":{"total":96636764160,"available":96590303232,"internally_reserved":0,"allocated":315392,"data_stored":125773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542252,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97628,"kb_used_data":4052,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94274212,"statfs":{"total":96636764160,"available":96536793088,"internally_reserved":0,"allocated":4149248,"data_stored":3948818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542251,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57860,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313980,"statfs":{"total":96636764160,"available":96577515520,"internally_reserved":0,"allocated":323584,"data_stored":125946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542252,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67524,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94304316,"statfs":{"total":96636764160,"available":96567619584,"internally_reserved":0,"allocated":323584,"data_stored":125745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542252,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58432,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313408,"statfs":{"total":96636764160,"available":96576929792,"internally_reserved":0,"allocated":909312,"data_stored":715829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3854336,"data_stored":3828363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3846144,"data_stored":3828260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:58:30.098 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:58:30.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.278+0000 7f80c4200640 1 Processor -- start 2024-05-12T10:58:30.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.278+0000 7f80c4200640 1 -- start start 2024-05-12T10:58:30.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c4200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc152a90 0x7f80bc15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:30.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c4200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f80bc0c6560 0x7f80bc0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:30.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c4200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80bc0c69b0 con 0x7f80bc0c4920 2024-05-12T10:58:30.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c4200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f80bc0c4f80 con 0x7f80bc0c6560 2024-05-12T10:58:30.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c4200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f80bc0c4d40 con 0x7f80bc152a90 2024-05-12T10:58:30.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c1800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc152a90 0x7f80bc15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:30.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c2200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f80bc0c6560 0x7f80bc0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:30.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c0e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f80bc0c4920 0x7f80bc1593b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:42752/0 (socket says 172.21.15.115:42752) 2024-05-12T10:58:30.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c0e00640 1 -- 172.21.15.115:0/2630093523 learned_addr learned my addr 172.21.15.115:0/2630093523 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:30.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c1800640 1 -- 172.21.15.115:0/2630093523 >> v2:172.21.15.134:3300/0 conn(0x7f80bc0c6560 msgr2=0x7f80bc0c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:30.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c1800640 1 --2- 172.21.15.115:0/2630093523 >> v2:172.21.15.134:3300/0 conn(0x7f80bc0c6560 0x7f80bc0c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c1800640 1 -- 172.21.15.115:0/2630093523 >> v1:172.21.15.134:6789/0 conn(0x7f80bc0c4920 legacy=0x7f80bc1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:30.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c1800640 1 -- 172.21.15.115:0/2630093523 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc0ca850 con 0x7f80bc152a90 2024-05-12T10:58:30.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.282+0000 7f80c2200640 1 --2- 172.21.15.115:0/2630093523 >> v2:172.21.15.134:3300/0 conn(0x7f80bc0c6560 0x7f80bc0c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:58:30.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80c1800640 1 --2- 172.21.15.115:0/2630093523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc152a90 0x7f80bc15cb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f80b00097c0 tx=0x7f80b001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f183b474356d4f66 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:30.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80bbe00640 1 -- 172.21.15.115:0/2630093523 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b00b0070 con 0x7f80bc152a90 2024-05-12T10:58:30.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80bbe00640 1 -- 172.21.15.115:0/2630093523 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b00ab600 con 0x7f80bc152a90 2024-05-12T10:58:30.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80bbe00640 1 -- 172.21.15.115:0/2630093523 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b00ab9d0 con 0x7f80bc152a90 2024-05-12T10:58:30.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80c4200640 1 -- 172.21.15.115:0/2630093523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc152a90 msgr2=0x7f80bc15cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:30.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80c4200640 1 --2- 172.21.15.115:0/2630093523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc152a90 0x7f80bc15cb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f80b00097c0 tx=0x7f80b001c4a0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80c4200640 1 -- 172.21.15.115:0/2630093523 shutdown_connections 2024-05-12T10:58:30.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80c4200640 1 --2- 172.21.15.115:0/2630093523 >> v2:172.21.15.134:3300/0 conn(0x7f80bc0c6560 0x7f80bc0c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80c4200640 1 --2- 172.21.15.115:0/2630093523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc152a90 0x7f80bc15cb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80c4200640 1 -- 172.21.15.115:0/2630093523 >> 172.21.15.115:0/2630093523 conn(0x7f80bc0681c0 msgr2=0x7f80bc0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:30.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80c4200640 1 -- 172.21.15.115:0/2630093523 shutdown_connections 2024-05-12T10:58:30.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80c4200640 1 -- 172.21.15.115:0/2630093523 wait complete. 2024-05-12T10:58:30.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80c4200640 1 Processor -- start 2024-05-12T10:58:30.279 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.286+0000 7f80c4200640 1 -- start start 2024-05-12T10:58:30.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c4200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc0c4920 0x7f80bc1f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:30.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c4200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc0c6560 0x7f80bc14b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:30.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c4200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80bc152a90 0x7f80bc1f8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:30.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c4200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc152e70 con 0x7f80bc152a90 2024-05-12T10:58:30.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c4200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc15c6a0 con 0x7f80bc0c4920 2024-05-12T10:58:30.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c4200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f80bc152ff0 con 0x7f80bc0c6560 2024-05-12T10:58:30.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c2200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80bc152a90 0x7f80bc1f8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:30.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c2200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80bc152a90 0x7f80bc1f8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54718/0 (socket says 172.21.15.115:54718) 2024-05-12T10:58:30.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c2200640 1 -- 172.21.15.115:0/3302457248 learned_addr learned my addr 172.21.15.115:0/3302457248 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:30.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c0e00640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc0c6560 0x7f80bc14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:30.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c1800640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc0c4920 0x7f80bc1f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:30.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c2200640 1 -- 172.21.15.115:0/3302457248 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc0c6560 msgr2=0x7f80bc14b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:30.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c2200640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc0c6560 0x7f80bc14b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c2200640 1 -- 172.21.15.115:0/3302457248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc0c4920 msgr2=0x7f80bc1f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:30.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c2200640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc0c4920 0x7f80bc1f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c2200640 1 -- 172.21.15.115:0/3302457248 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc1f90e0 con 0x7f80bc152a90 2024-05-12T10:58:30.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c2200640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80bc152a90 0x7f80bc1f8ba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009f00 tx=0x7f80b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:30.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80b9600640 1 -- 172.21.15.115:0/3302457248 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4018030 con 0x7f80bc152a90 2024-05-12T10:58:30.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80b9600640 1 -- 172.21.15.115:0/3302457248 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b400ce50 con 0x7f80bc152a90 2024-05-12T10:58:30.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c4200640 1 -- 172.21.15.115:0/3302457248 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80bc14db90 con 0x7f80bc152a90 2024-05-12T10:58:30.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80b9600640 1 -- 172.21.15.115:0/3302457248 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4003bc0 con 0x7f80bc152a90 2024-05-12T10:58:30.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c4200640 1 -- 172.21.15.115:0/3302457248 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80bc14e150 con 0x7f80bc152a90 2024-05-12T10:58:30.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.290+0000 7f80c4200640 1 -- 172.21.15.115:0/3302457248 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80bc069730 con 0x7f80bc152a90 2024-05-12T10:58:30.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.294+0000 7f80b9600640 1 -- 172.21.15.115:0/3302457248 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f80b401b070 con 0x7f80bc152a90 2024-05-12T10:58:30.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.294+0000 7f80b9600640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f809c06f400 0x7f809c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:30.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.294+0000 7f80b9600640 1 -- 172.21.15.115:0/3302457248 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f80b408ffe0 con 0x7f80bc152a90 2024-05-12T10:58:30.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.294+0000 7f80c1800640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f809c06f400 0x7f809c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:30.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.294+0000 7f80c1800640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f809c06f400 0x7f809c0718c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80b00ad000 tx=0x7f80b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:30.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.298+0000 7f80b9600640 1 -- 172.21.15.115:0/3302457248 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f80b4022070 con 0x7f80bc152a90 2024-05-12T10:58:30.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.454+0000 7f80c4200640 1 -- 172.21.15.115:0/3302457248 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80bc0759a0 con 0x7f80bc152a90 2024-05-12T10:58:30.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80b9600640 1 -- 172.21.15.115:0/3302457248 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18937 (secure 0 0 0) 0x7f80b4010040 con 0x7f80bc152a90 2024-05-12T10:58:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:58:30.448 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":28,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:36.829784+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:58:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 -- 172.21.15.115:0/3302457248 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f809c06f400 msgr2=0x7f809c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f809c06f400 0x7f809c0718c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80b00ad000 tx=0x7f80b0008040 comp rx=0 tx=0).stop 2024-05-12T10:58:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 -- 172.21.15.115:0/3302457248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80bc152a90 msgr2=0x7f80bc1f8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80bc152a90 0x7f80bc1f8ba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009f00 tx=0x7f80b400c490 comp rx=0 tx=0).stop 2024-05-12T10:58:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 -- 172.21.15.115:0/3302457248 shutdown_connections 2024-05-12T10:58:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f809c06f400 0x7f809c0718c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80bc152a90 0x7f80bc1f8ba0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc0c6560 0x7f80bc14b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 --2- 172.21.15.115:0/3302457248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc0c4920 0x7f80bc1f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 -- 172.21.15.115:0/3302457248 >> 172.21.15.115:0/3302457248 conn(0x7f80bc0681c0 msgr2=0x7f80bc0c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:30.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 -- 172.21.15.115:0/3302457248 shutdown_connections 2024-05-12T10:58:30.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:30.458+0000 7f80c4200640 1 -- 172.21.15.115:0/3302457248 wait complete. 2024-05-12T10:58:31.470 INFO:tasks.ceph:Scrubbing osd.0 2024-05-12T10:58:31.470 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-12T10:58:31.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.622+0000 7f2dcea00640 1 Processor -- start 2024-05-12T10:58:31.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.622+0000 7f2dcea00640 1 -- start start 2024-05-12T10:58:31.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.622+0000 7f2dcea00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2dc8153a70 0x7f2dc80c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.622+0000 7f2dcea00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2dc80c9900 0x7f2dc80c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dcea00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc8070d00 con 0x7f2dc80ccf10 2024-05-12T10:58:31.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dcea00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f2dc80c8420 con 0x7f2dc80c9900 2024-05-12T10:58:31.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dcea00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2dc8070ab0 con 0x7f2dc8153a70 2024-05-12T10:58:31.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dc7400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2dc80c9900 0x7f2dc80c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dcca00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2dc80ccf10 0x7f2dc806f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:39414/0 (socket says 172.21.15.115:39414) 2024-05-12T10:58:31.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dcca00640 1 -- 172.21.15.115:0/4195495454 learned_addr learned my addr 172.21.15.115:0/4195495454 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:31.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dc6a00640 1 -- 172.21.15.115:0/4195495454 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780865219 0 0) 0x7f2dc8070d00 con 0x7f2dc80ccf10 2024-05-12T10:58:31.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dc6a00640 1 -- 172.21.15.115:0/4195495454 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dac003530 con 0x7f2dc80ccf10 2024-05-12T10:58:31.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dc7400640 1 -- 172.21.15.115:0/4195495454 >> v2:172.21.15.134:3300/0 conn(0x7f2dc8153a70 msgr2=0x7f2dc80c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:31.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dc7400640 1 --2- 172.21.15.115:0/4195495454 >> v2:172.21.15.134:3300/0 conn(0x7f2dc8153a70 0x7f2dc80c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dc7400640 1 -- 172.21.15.115:0/4195495454 >> v1:172.21.15.115:6789/0 conn(0x7f2dc80ccf10 legacy=0x7f2dc806f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dc7400640 1 -- 172.21.15.115:0/4195495454 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc80cb1c0 con 0x7f2dc80c9900 2024-05-12T10:58:31.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.626+0000 7f2dc7400640 1 --2- 172.21.15.115:0/4195495454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc80c9900 0x7f2dc80c6f70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2db40097c0 tx=0x7f2db401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4934a98b9bfcb683 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:31.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dc6a00640 1 -- 172.21.15.115:0/4195495454 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db40b5070 con 0x7f2dc80c9900 2024-05-12T10:58:31.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dc6a00640 1 -- 172.21.15.115:0/4195495454 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db40a8950 con 0x7f2dc80c9900 2024-05-12T10:58:31.619 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dc6a00640 1 -- 172.21.15.115:0/4195495454 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db40a8d20 con 0x7f2dc80c9900 2024-05-12T10:58:31.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 -- 172.21.15.115:0/4195495454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc80c9900 msgr2=0x7f2dc80c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 --2- 172.21.15.115:0/4195495454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc80c9900 0x7f2dc80c6f70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2db40097c0 tx=0x7f2db401ec50 comp rx=0 tx=0).stop 2024-05-12T10:58:31.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 -- 172.21.15.115:0/4195495454 shutdown_connections 2024-05-12T10:58:31.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 --2- 172.21.15.115:0/4195495454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc80c9900 0x7f2dc80c6f70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 --2- 172.21.15.115:0/4195495454 >> v2:172.21.15.134:3300/0 conn(0x7f2dc8153a70 0x7f2dc80c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 -- 172.21.15.115:0/4195495454 >> 172.21.15.115:0/4195495454 conn(0x7f2dc80cd320 msgr2=0x7f2dc80cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:31.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 -- 172.21.15.115:0/4195495454 shutdown_connections 2024-05-12T10:58:31.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 -- 172.21.15.115:0/4195495454 wait complete. 2024-05-12T10:58:31.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 Processor -- start 2024-05-12T10:58:31.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 -- start start 2024-05-12T10:58:31.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c9900 0x7f2dc814b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc80ccf10 0x7f2dc81474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc8153a70 0x7f2dc8147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc80cde40 con 0x7f2dc80ccf10 2024-05-12T10:58:31.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc80c7f00 con 0x7f2dc8153a70 2024-05-12T10:58:31.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcea00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc80cdfc0 con 0x7f2dc80c9900 2024-05-12T10:58:31.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dc7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc80ccf10 0x7f2dc81474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dc7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc80ccf10 0x7f2dc81474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54734/0 (socket says 172.21.15.115:54734) 2024-05-12T10:58:31.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dc7400640 1 -- 172.21.15.115:0/44348200 learned_addr learned my addr 172.21.15.115:0/44348200 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:31.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dcca00640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc8153a70 0x7f2dc8147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.630+0000 7f2dc7e00640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c9900 0x7f2dc814b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dc7400640 1 -- 172.21.15.115:0/44348200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c9900 msgr2=0x7f2dc814b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dc7400640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c9900 0x7f2dc814b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dc7400640 1 -- 172.21.15.115:0/44348200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc8153a70 msgr2=0x7f2dc8147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dc7400640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc8153a70 0x7f2dc8147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dc7400640 1 -- 172.21.15.115:0/44348200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc81f5920 con 0x7f2dc80ccf10 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dc7400640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc80ccf10 0x7f2dc81474f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2db40097c0 tx=0x7f2db401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dbfe00640 1 -- 172.21.15.115:0/44348200 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db40b5040 con 0x7f2dc80ccf10 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dbfe00640 1 -- 172.21.15.115:0/44348200 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db40bf070 con 0x7f2dc80ccf10 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dcea00640 1 -- 172.21.15.115:0/44348200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc81f5bc0 con 0x7f2dc80ccf10 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dbfe00640 1 -- 172.21.15.115:0/44348200 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db40b08a0 con 0x7f2dc80ccf10 2024-05-12T10:58:31.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dcea00640 1 -- 172.21.15.115:0/44348200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc8146cf0 con 0x7f2dc80ccf10 2024-05-12T10:58:31.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dcea00640 1 -- 172.21.15.115:0/44348200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2dc8069730 con 0x7f2dc80ccf10 2024-05-12T10:58:31.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dbfe00640 1 -- 172.21.15.115:0/44348200 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2db40b0a40 con 0x7f2dc80ccf10 2024-05-12T10:58:31.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dbfe00640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2da806f400 0x7f2da80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dbfe00640 1 -- 172.21.15.115:0/44348200 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2db412cc10 con 0x7f2dc80ccf10 2024-05-12T10:58:31.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dc7e00640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2da806f400 0x7f2da80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dbfe00640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] conn(0x7f2da8078e10 0x7f2da807b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dbfe00640 1 -- 172.21.15.115:0/44348200 --> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2db40bae50 con 0x7f2da8078e10 2024-05-12T10:58:31.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.634+0000 7f2dbfe00640 1 -- 172.21.15.115:0/44348200 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2db41312a0 con 0x7f2dc80ccf10 2024-05-12T10:58:31.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.638+0000 7f2dcca00640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] conn(0x7f2da8078e10 0x7f2da807b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.638+0000 7f2dc7e00640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2da806f400 0x7f2da80718c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2db8006fd0 tx=0x7f2db8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:31.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.638+0000 7f2dcca00640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] conn(0x7f2da8078e10 0x7f2da807b2b0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:31.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.638+0000 7f2dbfe00640 1 -- 172.21.15.115:0/44348200 <== osd.0 v2:172.21.15.115:6816/199636976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2db40bae50 con 0x7f2da8078e10 2024-05-12T10:58:31.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcea00640 1 -- 172.21.15.115:0/44348200 --> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2dc8157390 con 0x7f2da8078e10 2024-05-12T10:58:31.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dbfe00640 1 -- 172.21.15.115:0/44348200 <== osd.0 v2:172.21.15.115:6816/199636976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2dc8157390 con 0x7f2da8078e10 2024-05-12T10:58:31.642 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:58:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T10:58:31.642 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:58:31.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcea00640 1 -- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] conn(0x7f2da8078e10 msgr2=0x7f2da807b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcea00640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:6816/199636976,v1:172.21.15.115:6818/199636976] conn(0x7f2da8078e10 0x7f2da807b2b0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcea00640 1 -- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2da806f400 msgr2=0x7f2da80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcea00640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2da806f400 0x7f2da80718c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2db8006fd0 tx=0x7f2db8008040 comp rx=0 tx=0).stop 2024-05-12T10:58:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcea00640 1 -- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc80ccf10 msgr2=0x7f2dc81474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcea00640 1 --2- 172.21.15.115:0/44348200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc80ccf10 0x7f2dc81474f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2db40097c0 tx=0x7f2db401b9f0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcca00640 1 -- 172.21.15.115:0/44348200 reap_dead start 2024-05-12T10:58:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcea00640 1 -- 172.21.15.115:0/44348200 shutdown_connections 2024-05-12T10:58:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcea00640 1 -- 172.21.15.115:0/44348200 >> 172.21.15.115:0/44348200 conn(0x7f2dc80cd320 msgr2=0x7f2dc8144ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcea00640 1 -- 172.21.15.115:0/44348200 shutdown_connections 2024-05-12T10:58:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.650+0000 7f2dcea00640 1 -- 172.21.15.115:0/44348200 wait complete. 2024-05-12T10:58:31.660 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-12T10:58:31.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe1cc00640 1 Processor -- start 2024-05-12T10:58:31.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe1cc00640 1 -- start start 2024-05-12T10:58:31.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe1cc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efe18155d70 0x7efe1815c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe1cc00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe180c8d30 0x7efe180c9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe1cc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efe18073070 0x7efe18073500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe1cc00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7efe1815caa0 con 0x7efe180c8d30 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe1cc00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efe180c7fc0 con 0x7efe18073070 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe1cc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7efe180c8210 con 0x7efe18155d70 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe16a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe180c8d30 0x7efe180c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe16a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe180c8d30 0x7efe180c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54750/0 (socket says 172.21.15.115:54750) 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe16a00640 1 -- 172.21.15.115:0/134797556 learned_addr learned my addr 172.21.15.115:0/134797556 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe17e00640 1 --2- 172.21.15.115:0/134797556 >> v2:172.21.15.134:3300/0 conn(0x7efe18073070 0x7efe18073500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe17400640 1 --2- 172.21.15.115:0/134797556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efe18155d70 0x7efe1815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe16a00640 1 -- 172.21.15.115:0/134797556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efe18155d70 msgr2=0x7efe1815c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe16a00640 1 --2- 172.21.15.115:0/134797556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efe18155d70 0x7efe1815c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe16a00640 1 -- 172.21.15.115:0/134797556 >> v2:172.21.15.134:3300/0 conn(0x7efe18073070 msgr2=0x7efe18073500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:31.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe16a00640 1 --2- 172.21.15.115:0/134797556 >> v2:172.21.15.134:3300/0 conn(0x7efe18073070 0x7efe18073500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe16a00640 1 -- 172.21.15.115:0/134797556 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1806ff60 con 0x7efe180c8d30 2024-05-12T10:58:31.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.810+0000 7efe17400640 1 --2- 172.21.15.115:0/134797556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efe18155d70 0x7efe1815c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:58:31.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe16a00640 1 --2- 172.21.15.115:0/134797556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe180c8d30 0x7efe180c9520 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efe18072bb0 tx=0x7efe0401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18a701089608fc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:31.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe16000640 1 -- 172.21.15.115:0/134797556 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040b2070 con 0x7efe180c8d30 2024-05-12T10:58:31.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe16000640 1 -- 172.21.15.115:0/134797556 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe040a9070 con 0x7efe180c8d30 2024-05-12T10:58:31.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe16000640 1 -- 172.21.15.115:0/134797556 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040ad880 con 0x7efe180c8d30 2024-05-12T10:58:31.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe1cc00640 1 -- 172.21.15.115:0/134797556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe180c8d30 msgr2=0x7efe180c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe1cc00640 1 --2- 172.21.15.115:0/134797556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe180c8d30 0x7efe180c9520 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efe18072bb0 tx=0x7efe0401c490 comp rx=0 tx=0).stop 2024-05-12T10:58:31.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe1cc00640 1 -- 172.21.15.115:0/134797556 shutdown_connections 2024-05-12T10:58:31.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe1cc00640 1 --2- 172.21.15.115:0/134797556 >> v2:172.21.15.134:3300/0 conn(0x7efe18073070 0x7efe18073500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe1cc00640 1 --2- 172.21.15.115:0/134797556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe180c8d30 0x7efe180c9520 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe1cc00640 1 --2- 172.21.15.115:0/134797556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efe18155d70 0x7efe1815c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe1cc00640 1 -- 172.21.15.115:0/134797556 >> 172.21.15.115:0/134797556 conn(0x7efe1806c440 msgr2=0x7efe1806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:31.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe1cc00640 1 -- 172.21.15.115:0/134797556 shutdown_connections 2024-05-12T10:58:31.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe1cc00640 1 -- 172.21.15.115:0/134797556 wait complete. 2024-05-12T10:58:31.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe1cc00640 1 Processor -- start 2024-05-12T10:58:31.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.814+0000 7efe1cc00640 1 -- start start 2024-05-12T10:58:31.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe1cc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18073070 0x7efe181f8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe1cc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe180c8d30 0x7efe1815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe1cc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efe18155d70 0x7efe18151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe1cc00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efe180cb000 con 0x7efe180c8d30 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe1cc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efe18070d20 con 0x7efe18073070 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe1cc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7efe180c84f0 con 0x7efe18155d70 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe16a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe180c8d30 0x7efe1815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe16a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe180c8d30 0x7efe1815e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54760/0 (socket says 172.21.15.115:54760) 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe16a00640 1 -- 172.21.15.115:0/694557963 learned_addr learned my addr 172.21.15.115:0/694557963 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe17400640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18073070 0x7efe181f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe16a00640 1 -- 172.21.15.115:0/694557963 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efe18155d70 msgr2=0x7efe18151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe16a00640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efe18155d70 0x7efe18151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe16a00640 1 -- 172.21.15.115:0/694557963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18073070 msgr2=0x7efe181f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe16a00640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18073070 0x7efe181f8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe16a00640 1 -- 172.21.15.115:0/694557963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe181f8820 con 0x7efe180c8d30 2024-05-12T10:58:31.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe16a00640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe180c8d30 0x7efe1815e4f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efe0401ab40 tx=0x7efe04019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:31.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe0f400640 1 -- 172.21.15.115:0/694557963 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040bb070 con 0x7efe180c8d30 2024-05-12T10:58:31.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe0f400640 1 -- 172.21.15.115:0/694557963 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe040addf0 con 0x7efe180c8d30 2024-05-12T10:58:31.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe1cc00640 1 -- 172.21.15.115:0/694557963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe181f8b00 con 0x7efe180c8d30 2024-05-12T10:58:31.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe0f400640 1 -- 172.21.15.115:0/694557963 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040b2040 con 0x7efe180c8d30 2024-05-12T10:58:31.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe1cc00640 1 -- 172.21.15.115:0/694557963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe18150820 con 0x7efe180c8d30 2024-05-12T10:58:31.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.818+0000 7efe1cc00640 1 -- 172.21.15.115:0/694557963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe181f9020 con 0x7efe180c8d30 2024-05-12T10:58:31.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.822+0000 7efe0f400640 1 -- 172.21.15.115:0/694557963 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efe040be070 con 0x7efe180c8d30 2024-05-12T10:58:31.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.822+0000 7efe0f400640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efdf806f430 0x7efdf80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:31.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.822+0000 7efe0f400640 1 -- 172.21.15.115:0/694557963 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7efe04128610 con 0x7efe180c8d30 2024-05-12T10:58:31.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.822+0000 7efe17400640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efdf806f430 0x7efdf80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:31.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.822+0000 7efe17400640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efdf806f430 0x7efdf80718f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe08006fd0 tx=0x7efe08008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:31.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.826+0000 7efe0f400640 1 -- 172.21.15.115:0/694557963 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efe181f9020 con 0x7efe180c8d30 2024-05-12T10:58:31.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 -- 172.21.15.115:0/694557963 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7efe18150b70 con 0x7efdf806f430 2024-05-12T10:58:31.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe0f400640 1 -- 172.21.15.115:0/694557963 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efe18150b70 con 0x7efdf806f430 2024-05-12T10:58:31.977 INFO:teuthology.orchestra.run.smithi115.stderr:instructed osd(s) 0 to deep-scrub 2024-05-12T10:58:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 -- 172.21.15.115:0/694557963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efdf806f430 msgr2=0x7efdf80718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efdf806f430 0x7efdf80718f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe08006fd0 tx=0x7efe08008040 comp rx=0 tx=0).stop 2024-05-12T10:58:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 -- 172.21.15.115:0/694557963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe180c8d30 msgr2=0x7efe1815e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe180c8d30 0x7efe1815e4f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efe0401ab40 tx=0x7efe04019230 comp rx=0 tx=0).stop 2024-05-12T10:58:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 -- 172.21.15.115:0/694557963 shutdown_connections 2024-05-12T10:58:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efdf806f430 0x7efdf80718f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efe18155d70 0x7efe18151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe180c8d30 0x7efe1815e4f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 --2- 172.21.15.115:0/694557963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18073070 0x7efe181f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 -- 172.21.15.115:0/694557963 >> 172.21.15.115:0/694557963 conn(0x7efe1806c440 msgr2=0x7efe180c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:31.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 -- 172.21.15.115:0/694557963 shutdown_connections 2024-05-12T10:58:31.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:31.986+0000 7efe1cc00640 1 -- 172.21.15.115:0/694557963 wait complete. 2024-05-12T10:58:31.998 INFO:tasks.ceph:Scrubbing osd.1 2024-05-12T10:58:31.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-12T10:58:32.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.146+0000 7f2ab9200640 1 Processor -- start 2024-05-12T10:58:32.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.146+0000 7f2ab9200640 1 -- start start 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2ab9200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab41560b0 0x7f2ab415c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2ab9200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ab40685c0 0x7f2ab40cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2ab9200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab40ce370 con 0x7f2ab40cd820 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2ab9200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f2ab415cca0 con 0x7f2ab40685c0 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2ab9200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab4156490 con 0x7f2ab41560b0 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2aa9400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ab40685c0 0x7f2ab40cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2aa9400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ab40685c0 0x7f2ab40cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54762/0 (socket says 172.21.15.115:54762) 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2aa9400640 1 -- 172.21.15.115:0/2578192676 learned_addr learned my addr 172.21.15.115:0/2578192676 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2ab1e00640 1 --2- 172.21.15.115:0/2578192676 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab41560b0 0x7f2ab415c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2aa9400640 1 -- 172.21.15.115:0/2578192676 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab41560b0 msgr2=0x7f2ab415c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2aa9400640 1 --2- 172.21.15.115:0/2578192676 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab41560b0 0x7f2ab415c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2aa9400640 1 -- 172.21.15.115:0/2578192676 >> v1:172.21.15.134:6789/0 conn(0x7f2ab40cd820 legacy=0x7f2ab40c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.150+0000 7f2aa9400640 1 -- 172.21.15.115:0/2578192676 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab40cddb0 con 0x7f2ab40685c0 2024-05-12T10:58:32.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2aa9400640 1 --2- 172.21.15.115:0/2578192676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ab40685c0 0x7f2ab40cc380 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0098a0 tx=0x7f2a9c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e4dc3070d7e369 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab1400640 1 -- 172.21.15.115:0/2578192676 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c0b5070 con 0x7f2ab40685c0 2024-05-12T10:58:32.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab1400640 1 -- 172.21.15.115:0/2578192676 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9c0a8a30 con 0x7f2ab40685c0 2024-05-12T10:58:32.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab1400640 1 -- 172.21.15.115:0/2578192676 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c0a8e00 con 0x7f2ab40685c0 2024-05-12T10:58:32.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab9200640 1 -- 172.21.15.115:0/2578192676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ab40685c0 msgr2=0x7f2ab40cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab9200640 1 --2- 172.21.15.115:0/2578192676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ab40685c0 0x7f2ab40cc380 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0098a0 tx=0x7f2a9c01ed30 comp rx=0 tx=0).stop 2024-05-12T10:58:32.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab9200640 1 -- 172.21.15.115:0/2578192676 shutdown_connections 2024-05-12T10:58:32.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab9200640 1 --2- 172.21.15.115:0/2578192676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ab40685c0 0x7f2ab40cc380 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab9200640 1 --2- 172.21.15.115:0/2578192676 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab41560b0 0x7f2ab415c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab9200640 1 -- 172.21.15.115:0/2578192676 >> 172.21.15.115:0/2578192676 conn(0x7f2ab4070860 msgr2=0x7f2ab4070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:32.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab9200640 1 -- 172.21.15.115:0/2578192676 shutdown_connections 2024-05-12T10:58:32.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab9200640 1 -- 172.21.15.115:0/2578192676 wait complete. 2024-05-12T10:58:32.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab9200640 1 Processor -- start 2024-05-12T10:58:32.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.154+0000 7f2ab9200640 1 -- start start 2024-05-12T10:58:32.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2ab9200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab40685c0 0x7f2ab4158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2ab9200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ab40cd820 0x7f2ab4158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2ab9200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab41560b0 0x7f2ab41568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2ab9200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab40c3b30 con 0x7f2ab40cd820 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2ab9200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab40c3850 con 0x7f2ab40685c0 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2ab9200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab40c3e10 con 0x7f2ab41560b0 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aa9400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ab40cd820 0x7f2ab4158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aa9400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ab40cd820 0x7f2ab4158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54770/0 (socket says 172.21.15.115:54770) 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aa9400640 1 -- 172.21.15.115:0/2927103852 learned_addr learned my addr 172.21.15.115:0/2927103852 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2ab1e00640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab40685c0 0x7f2ab4158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2ab2800640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab41560b0 0x7f2ab41568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aa9400640 1 -- 172.21.15.115:0/2927103852 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab41560b0 msgr2=0x7f2ab41568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aa9400640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab41560b0 0x7f2ab41568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aa9400640 1 -- 172.21.15.115:0/2927103852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab40685c0 msgr2=0x7f2ab4158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aa9400640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab40685c0 0x7f2ab4158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aa9400640 1 -- 172.21.15.115:0/2927103852 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab41f1a30 con 0x7f2ab40cd820 2024-05-12T10:58:32.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aa9400640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ab40cd820 0x7f2ab4158dd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0b3040 tx=0x7f2a9c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aaaa00640 1 -- 172.21.15.115:0/2927103852 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c0b5070 con 0x7f2ab40cd820 2024-05-12T10:58:32.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aaaa00640 1 -- 172.21.15.115:0/2927103852 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9c0b0a70 con 0x7f2ab40cd820 2024-05-12T10:58:32.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aaaa00640 1 -- 172.21.15.115:0/2927103852 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c0b0e60 con 0x7f2ab40cd820 2024-05-12T10:58:32.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2ab9200640 1 -- 172.21.15.115:0/2927103852 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab415b780 con 0x7f2ab40cd820 2024-05-12T10:58:32.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2ab9200640 1 -- 172.21.15.115:0/2927103852 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab41f1f80 con 0x7f2ab40cd820 2024-05-12T10:58:32.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2ab9200640 1 -- 172.21.15.115:0/2927103852 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ab4069730 con 0x7f2ab40cd820 2024-05-12T10:58:32.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.158+0000 7f2aaaa00640 1 -- 172.21.15.115:0/2927103852 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2a9c0b9030 con 0x7f2ab40cd820 2024-05-12T10:58:32.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.162+0000 7f2aaaa00640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2a9006f400 0x7f2a900718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.162+0000 7f2aaaa00640 1 -- 172.21.15.115:0/2927103852 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2a9c12c6b0 con 0x7f2ab40cd820 2024-05-12T10:58:32.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.162+0000 7f2ab1e00640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2a9006f400 0x7f2a900718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.162+0000 7f2aaaa00640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] conn(0x7f2a90078e10 0x7f2a9007b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.162+0000 7f2aaaa00640 1 -- 172.21.15.115:0/2927103852 --> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a9007b980 con 0x7f2a90078e10 2024-05-12T10:58:32.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.162+0000 7f2aaaa00640 1 -- 172.21.15.115:0/2927103852 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a9c12ca60 con 0x7f2ab40cd820 2024-05-12T10:58:32.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.162+0000 7f2ab2800640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] conn(0x7f2a90078e10 0x7f2a9007b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.162+0000 7f2ab1e00640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2a9006f400 0x7f2a900718c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009a50 tx=0x7f2aa4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.162+0000 7f2ab2800640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] conn(0x7f2a90078e10 0x7f2a9007b2b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.162+0000 7f2aaaa00640 1 -- 172.21.15.115:0/2927103852 <== osd.1 v2:172.21.15.115:6800/2401741239 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2a9007b980 con 0x7f2a90078e10 2024-05-12T10:58:32.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.174+0000 7f2ab9200640 1 -- 172.21.15.115:0/2927103852 --> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2ab40c3590 con 0x7f2a90078e10 2024-05-12T10:58:32.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.174+0000 7f2aaaa00640 1 -- 172.21.15.115:0/2927103852 <== osd.1 v2:172.21.15.115:6800/2401741239 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2ab40c3590 con 0x7f2a90078e10 2024-05-12T10:58:32.167 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:58:32.167 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T10:58:32.167 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:58:32.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.178+0000 7f2ab9200640 1 -- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] conn(0x7f2a90078e10 msgr2=0x7f2a9007b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.178+0000 7f2ab9200640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:6800/2401741239,v1:172.21.15.115:6801/2401741239] conn(0x7f2a90078e10 0x7f2a9007b2b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.178+0000 7f2ab9200640 1 -- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2a9006f400 msgr2=0x7f2a900718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.178+0000 7f2ab9200640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2a9006f400 0x7f2a900718c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009a50 tx=0x7f2aa4008040 comp rx=0 tx=0).stop 2024-05-12T10:58:32.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.178+0000 7f2ab9200640 1 -- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ab40cd820 msgr2=0x7f2ab4158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.178+0000 7f2ab9200640 1 --2- 172.21.15.115:0/2927103852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ab40cd820 0x7f2ab4158dd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0b3040 tx=0x7f2a9c01bad0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.178+0000 7f2ab2800640 1 -- 172.21.15.115:0/2927103852 reap_dead start 2024-05-12T10:58:32.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.178+0000 7f2ab9200640 1 -- 172.21.15.115:0/2927103852 shutdown_connections 2024-05-12T10:58:32.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.178+0000 7f2ab9200640 1 -- 172.21.15.115:0/2927103852 >> 172.21.15.115:0/2927103852 conn(0x7f2ab4070860 msgr2=0x7f2ab4151040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:32.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.178+0000 7f2ab9200640 1 -- 172.21.15.115:0/2927103852 shutdown_connections 2024-05-12T10:58:32.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.178+0000 7f2ab9200640 1 -- 172.21.15.115:0/2927103852 wait complete. 2024-05-12T10:58:32.186 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-12T10:58:32.323 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.330+0000 7fb5f5a00640 1 Processor -- start 2024-05-12T10:58:32.323 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.330+0000 7fb5f5a00640 1 -- start start 2024-05-12T10:58:32.324 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5f5a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015ca30 0x7fb5f0159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.324 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5f5a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f015be20 con 0x7fb5f0152a10 2024-05-12T10:58:32.324 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5f5a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f0072cf0 con 0x7fb5f0152df0 2024-05-12T10:58:32.324 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5f5a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f0072fd0 con 0x7fb5f015ca30 2024-05-12T10:58:32.325 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5eea00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb5f0152a10 0x7fb5f0073d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60158/0 (socket says 172.21.15.115:60158) 2024-05-12T10:58:32.325 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5eea00640 1 -- 172.21.15.115:0/342725552 learned_addr learned my addr 172.21.15.115:0/342725552 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216677554 0 0) 0x7fb5f015be20 con 0x7fb5f0152a10 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5d4003530 con 0x7fb5f0152a10 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4006885536 0 0) 0x7fb5d4003530 con 0x7fb5f0152a10 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015ca30 msgr2=0x7fb5f0159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015ca30 0x7fb5f0159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 >> v1:172.21.15.134:6789/0 conn(0x7fb5f0152df0 legacy=0x7fb5f015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f00c4990 con 0x7fb5f0152a10 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fb5e0001700 con 0x7fb5f0152a10 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 >> v1:172.21.15.115:6789/0 conn(0x7fb5f0152a10 legacy=0x7fb5f0073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015ca30 0x7fb5d40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5d4004110 0x7fb5d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d4004e70 0x7fb5d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f0072fd0 con 0x7fb5d4004e70 2024-05-12T10:58:32.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d40055a0 con 0x7fb5d4004110 2024-05-12T10:58:32.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d400bf10 con 0x7fb5f015ca30 2024-05-12T10:58:32.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ef400640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d4004e70 0x7fb5d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5eea00640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015ca30 0x7fb5d40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5e6000640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5d4004110 0x7fb5d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ef400640 1 -- 172.21.15.115:0/342725552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015ca30 msgr2=0x7fb5d40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:32.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ef400640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015ca30 0x7fb5d40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ef400640 1 -- 172.21.15.115:0/342725552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5d4004110 msgr2=0x7fb5d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:32.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ef400640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5d4004110 0x7fb5d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5ef400640 1 -- 172.21.15.115:0/342725552 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d4003530 con 0x7fb5d4004e70 2024-05-12T10:58:32.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.334+0000 7fb5e6000640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5d4004110 0x7fb5d4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:32.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.338+0000 7fb5ef400640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d4004e70 0x7fb5d400b9d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80099d0 tx=0x7fb5e801ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b744d0fd3326fd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.338+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e80b4070 con 0x7fb5d4004e70 2024-05-12T10:58:32.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.338+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e80af440 con 0x7fb5d4004e70 2024-05-12T10:58:32.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.338+0000 7fb5ee000640 1 -- 172.21.15.115:0/342725552 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8006e60 con 0x7fb5d4004e70 2024-05-12T10:58:32.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.338+0000 7fb5f5a00640 1 -- 172.21.15.115:0/342725552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d4004e70 msgr2=0x7fb5d400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.338+0000 7fb5f5a00640 1 --2- 172.21.15.115:0/342725552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5d4004e70 0x7fb5d400b9d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80099d0 tx=0x7fb5e801ee60 comp rx=0 tx=0).stop 2024-05-12T10:58:32.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.338+0000 7fb5ef400640 1 -- 172.21.15.115:0/342725552 reap_dead start 2024-05-12T10:58:32.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.338+0000 7fb5f5a00640 1 -- 172.21.15.115:0/342725552 shutdown_connections 2024-05-12T10:58:32.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.338+0000 7fb5f5a00640 1 -- 172.21.15.115:0/342725552 >> 172.21.15.115:0/342725552 conn(0x7fb5f0076830 msgr2=0x7fb5f00681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:32.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.338+0000 7fb5f5a00640 1 -- 172.21.15.115:0/342725552 shutdown_connections 2024-05-12T10:58:32.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.338+0000 7fb5f5a00640 1 -- 172.21.15.115:0/342725552 wait complete. 2024-05-12T10:58:32.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5f5a00640 1 Processor -- start 2024-05-12T10:58:32.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5f5a00640 1 -- start start 2024-05-12T10:58:32.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5f5a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015aeb0 0x7fb5f01f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5f5a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5f015b290 0x7fb5f0148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5f5a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f0158270 0x7fb5f0148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5f5a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f0073460 con 0x7fb5f015b290 2024-05-12T10:58:32.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5f5a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f00c4f50 con 0x7fb5f0158270 2024-05-12T10:58:32.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5f5a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f00735e0 con 0x7fb5f015aeb0 2024-05-12T10:58:32.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e6000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5f015b290 0x7fb5f0148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e6000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5f015b290 0x7fb5f0148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57796/0 (socket says 172.21.15.115:57796) 2024-05-12T10:58:32.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e6000640 1 -- 172.21.15.115:0/4006698886 learned_addr learned my addr 172.21.15.115:0/4006698886 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:32.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5eea00640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015aeb0 0x7fb5f01f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5ef400640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f0158270 0x7fb5f0148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e6000640 1 -- 172.21.15.115:0/4006698886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015aeb0 msgr2=0x7fb5f01f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e6000640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015aeb0 0x7fb5f01f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e6000640 1 -- 172.21.15.115:0/4006698886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f0158270 msgr2=0x7fb5f0148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e6000640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f0158270 0x7fb5f0148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e6000640 1 -- 172.21.15.115:0/4006698886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f01f5780 con 0x7fb5f015b290 2024-05-12T10:58:32.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e6000640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5f015b290 0x7fb5f0148150 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800e7b0 tx=0x7fb5d800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e7400640 1 -- 172.21.15.115:0/4006698886 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d80050d0 con 0x7fb5f015b290 2024-05-12T10:58:32.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e7400640 1 -- 172.21.15.115:0/4006698886 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d8005270 con 0x7fb5f015b290 2024-05-12T10:58:32.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5e7400640 1 -- 172.21.15.115:0/4006698886 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8005420 con 0x7fb5f015b290 2024-05-12T10:58:32.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5f5a00640 1 -- 172.21.15.115:0/4006698886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f01f14b0 con 0x7fb5f015b290 2024-05-12T10:58:32.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5f5a00640 1 -- 172.21.15.115:0/4006698886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f01f1a30 con 0x7fb5f015b290 2024-05-12T10:58:32.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.342+0000 7fb5f5a00640 1 -- 172.21.15.115:0/4006698886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f0069730 con 0x7fb5f015b290 2024-05-12T10:58:32.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.346+0000 7fb5e7400640 1 -- 172.21.15.115:0/4006698886 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb5d801a020 con 0x7fb5f015b290 2024-05-12T10:58:32.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.346+0000 7fb5e7400640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb5cc06f430 0x7fb5cc0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.337 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.346+0000 7fb5e7400640 1 -- 172.21.15.115:0/4006698886 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb5d808ee40 con 0x7fb5f015b290 2024-05-12T10:58:32.337 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.346+0000 7fb5eea00640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb5cc06f430 0x7fb5cc0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.337 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.346+0000 7fb5eea00640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb5cc06f430 0x7fb5cc0718f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0001060 tx=0x7fb5e0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.350+0000 7fb5e7400640 1 -- 172.21.15.115:0/4006698886 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb5d805b890 con 0x7fb5f015b290 2024-05-12T10:58:32.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.510+0000 7fb5f5a00640 1 -- 172.21.15.115:0/4006698886 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fb5f00c52f0 con 0x7fb5cc06f430 2024-05-12T10:58:32.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.510+0000 7fb5e7400640 1 -- 172.21.15.115:0/4006698886 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb5f00c52f0 con 0x7fb5cc06f430 2024-05-12T10:58:32.502 INFO:teuthology.orchestra.run.smithi115.stderr:instructed osd(s) 1 to deep-scrub 2024-05-12T10:58:32.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 -- 172.21.15.115:0/4006698886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb5cc06f430 msgr2=0x7fb5cc0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb5cc06f430 0x7fb5cc0718f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0001060 tx=0x7fb5e0009040 comp rx=0 tx=0).stop 2024-05-12T10:58:32.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 -- 172.21.15.115:0/4006698886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5f015b290 msgr2=0x7fb5f0148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5f015b290 0x7fb5f0148150 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800e7b0 tx=0x7fb5d800ec70 comp rx=0 tx=0).stop 2024-05-12T10:58:32.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 -- 172.21.15.115:0/4006698886 shutdown_connections 2024-05-12T10:58:32.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fb5cc06f430 0x7fb5cc0718f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f0158270 0x7fb5f0148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5f015b290 0x7fb5f0148150 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 --2- 172.21.15.115:0/4006698886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5f015aeb0 0x7fb5f01f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 -- 172.21.15.115:0/4006698886 >> 172.21.15.115:0/4006698886 conn(0x7fb5f0076830 msgr2=0x7fb5f0149f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:32.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 -- 172.21.15.115:0/4006698886 shutdown_connections 2024-05-12T10:58:32.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.514+0000 7fb5f5a00640 1 -- 172.21.15.115:0/4006698886 wait complete. 2024-05-12T10:58:32.526 INFO:tasks.ceph:Scrubbing osd.2 2024-05-12T10:58:32.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-12T10:58:32.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.674+0000 7fbaf7a00640 1 Processor -- start 2024-05-12T10:58:32.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.678+0000 7fbaf7a00640 1 -- start start 2024-05-12T10:58:32.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.678+0000 7fbaf7a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbaf0142bc0 0x7fbaf0159e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.678+0000 7fbaf7a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf015a810 con 0x7fbaf015a390 2024-05-12T10:58:32.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.678+0000 7fbaf7a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf00c45f0 con 0x7fbaf00b4c10 2024-05-12T10:58:32.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.678+0000 7fbaf7a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf00c48d0 con 0x7fbaf0142bc0 2024-05-12T10:58:32.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.678+0000 7fbaf5a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbaf015a390 0x7fbaf0071160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60170/0 (socket says 172.21.15.115:60170) 2024-05-12T10:58:32.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.678+0000 7fbaf5a00640 1 -- 172.21.15.115:0/2663074098 learned_addr learned my addr 172.21.15.115:0/2663074098 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:32.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.678+0000 7fbaefe00640 1 --2- 172.21.15.115:0/2663074098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbaf0142bc0 0x7fbaf0159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.678+0000 7fbaefe00640 1 -- 172.21.15.115:0/2663074098 >> v1:172.21.15.134:6789/0 conn(0x7fbaf00b4c10 legacy=0x7fbaf00cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.678+0000 7fbaefe00640 1 -- 172.21.15.115:0/2663074098 >> v1:172.21.15.115:6789/0 conn(0x7fbaf015a390 legacy=0x7fbaf0071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.678+0000 7fbaefe00640 1 -- 172.21.15.115:0/2663074098 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf00c4bb0 con 0x7fbaf0142bc0 2024-05-12T10:58:32.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.682+0000 7fbaefe00640 1 --2- 172.21.15.115:0/2663074098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbaf0142bc0 0x7fbaf0159e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbadc0097f0 tx=0x7fbadc01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15a95463e921e8c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.682+0000 7fbaef400640 1 -- 172.21.15.115:0/2663074098 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0b5070 con 0x7fbaf0142bc0 2024-05-12T10:58:32.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.682+0000 7fbaef400640 1 -- 172.21.15.115:0/2663074098 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbadc0a89d0 con 0x7fbaf0142bc0 2024-05-12T10:58:32.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.682+0000 7fbaef400640 1 -- 172.21.15.115:0/2663074098 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0a8da0 con 0x7fbaf0142bc0 2024-05-12T10:58:32.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 -- 172.21.15.115:0/2663074098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbaf0142bc0 msgr2=0x7fbaf0159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 --2- 172.21.15.115:0/2663074098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbaf0142bc0 0x7fbaf0159e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbadc0097f0 tx=0x7fbadc01ecd0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 -- 172.21.15.115:0/2663074098 shutdown_connections 2024-05-12T10:58:32.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 --2- 172.21.15.115:0/2663074098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbaf0142bc0 0x7fbaf0159e50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 -- 172.21.15.115:0/2663074098 >> 172.21.15.115:0/2663074098 conn(0x7fbaf006c840 msgr2=0x7fbaf006cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:32.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 -- 172.21.15.115:0/2663074098 shutdown_connections 2024-05-12T10:58:32.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 -- 172.21.15.115:0/2663074098 wait complete. 2024-05-12T10:58:32.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 Processor -- start 2024-05-12T10:58:32.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 -- start start 2024-05-12T10:58:32.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbaf00b4c10 0x7fbaf006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaf0142bc0 0x7fbaf006e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaf015a390 0x7fbaf00cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf00b4ff0 con 0x7fbaf015a390 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf00c5170 con 0x7fbaf0142bc0 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf7a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf01598c0 con 0x7fbaf00b4c10 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf5a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaf015a390 0x7fbaf00cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf5a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaf015a390 0x7fbaf00cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57806/0 (socket says 172.21.15.115:57806) 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf5a00640 1 -- 172.21.15.115:0/3396721119 learned_addr learned my addr 172.21.15.115:0/3396721119 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf5000640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbaf00b4c10 0x7fbaf006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaefe00640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaf0142bc0 0x7fbaf006e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf5a00640 1 -- 172.21.15.115:0/3396721119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbaf00b4c10 msgr2=0x7fbaf006f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf5a00640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbaf00b4c10 0x7fbaf006f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf5a00640 1 -- 172.21.15.115:0/3396721119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaf0142bc0 msgr2=0x7fbaf006e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf5a00640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaf0142bc0 0x7fbaf006e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf5a00640 1 -- 172.21.15.115:0/3396721119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf013bf80 con 0x7fbaf015a390 2024-05-12T10:58:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.686+0000 7fbaf5a00640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaf015a390 0x7fbaf00cd4d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbae800cb40 tx=0x7fbae800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaecc00640 1 -- 172.21.15.115:0/3396721119 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8017070 con 0x7fbaf015a390 2024-05-12T10:58:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaecc00640 1 -- 172.21.15.115:0/3396721119 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae800ac40 con 0x7fbaf015a390 2024-05-12T10:58:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaecc00640 1 -- 172.21.15.115:0/3396721119 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8012400 con 0x7fbaf015a390 2024-05-12T10:58:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaf7a00640 1 -- 172.21.15.115:0/3396721119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf013c260 con 0x7fbaf015a390 2024-05-12T10:58:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaf7a00640 1 -- 172.21.15.115:0/3396721119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf006dc70 con 0x7fbaf015a390 2024-05-12T10:58:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaf7a00640 1 -- 172.21.15.115:0/3396721119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbaf0069730 con 0x7fbaf015a390 2024-05-12T10:58:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaecc00640 1 -- 172.21.15.115:0/3396721119 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbae801a070 con 0x7fbaf015a390 2024-05-12T10:58:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaecc00640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbad006f400 0x7fbad00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaecc00640 1 -- 172.21.15.115:0/3396721119 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbae808f400 con 0x7fbaf015a390 2024-05-12T10:58:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaf5000640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbad006f400 0x7fbad00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaecc00640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] conn(0x7fbad0078e10 0x7fbad007b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaecc00640 1 -- 172.21.15.115:0/3396721119 --> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbad007b980 con 0x7fbad0078e10 2024-05-12T10:58:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaecc00640 1 -- 172.21.15.115:0/3396721119 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbae8096050 con 0x7fbaf015a390 2024-05-12T10:58:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaefe00640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] conn(0x7fbad0078e10 0x7fbad007b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.690+0000 7fbaf5000640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbad006f400 0x7fbad00718c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbae4007fd0 tx=0x7fbae4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.694+0000 7fbaefe00640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] conn(0x7fbad0078e10 0x7fbad007b2b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.694+0000 7fbaecc00640 1 -- 172.21.15.115:0/3396721119 <== osd.2 v2:172.21.15.115:6817/332404290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbad007b980 con 0x7fbad0078e10 2024-05-12T10:58:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf7a00640 1 -- 172.21.15.115:0/3396721119 --> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbaf006ccc0 con 0x7fbad0078e10 2024-05-12T10:58:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaecc00640 1 -- 172.21.15.115:0/3396721119 <== osd.2 v2:172.21.15.115:6817/332404290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbaf006ccc0 con 0x7fbad0078e10 2024-05-12T10:58:32.698 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:58:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T10:58:32.698 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:58:32.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf7a00640 1 -- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] conn(0x7fbad0078e10 msgr2=0x7fbad007b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf7a00640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:6817/332404290,v1:172.21.15.115:6820/332404290] conn(0x7fbad0078e10 0x7fbad007b2b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf7a00640 1 -- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbad006f400 msgr2=0x7fbad00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf7a00640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fbad006f400 0x7fbad00718c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbae4007fd0 tx=0x7fbae4009040 comp rx=0 tx=0).stop 2024-05-12T10:58:32.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf7a00640 1 -- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaf015a390 msgr2=0x7fbaf00cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf7a00640 1 --2- 172.21.15.115:0/3396721119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaf015a390 0x7fbaf00cd4d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbae800cb40 tx=0x7fbae800a060 comp rx=0 tx=0).stop 2024-05-12T10:58:32.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf5a00640 1 -- 172.21.15.115:0/3396721119 reap_dead start 2024-05-12T10:58:32.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf7a00640 1 -- 172.21.15.115:0/3396721119 shutdown_connections 2024-05-12T10:58:32.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf7a00640 1 -- 172.21.15.115:0/3396721119 >> 172.21.15.115:0/3396721119 conn(0x7fbaf006c840 msgr2=0x7fbaf00759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:32.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf7a00640 1 -- 172.21.15.115:0/3396721119 shutdown_connections 2024-05-12T10:58:32.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.706+0000 7fbaf7a00640 1 -- 172.21.15.115:0/3396721119 wait complete. 2024-05-12T10:58:32.715 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-12T10:58:32.853 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04df200640 1 Processor -- start 2024-05-12T10:58:32.853 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04df200640 1 -- start start 2024-05-12T10:58:32.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04df200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04e0155d70 0x7f04e006c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04df200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04e0071560 0x7f04e00c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04df200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e006c980 con 0x7f04e006e200 2024-05-12T10:58:32.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04df200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f04e0156150 con 0x7f04e0155d70 2024-05-12T10:58:32.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04df200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f04e015fc90 con 0x7f04e0071560 2024-05-12T10:58:32.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04dde00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04e0155d70 0x7f04e006c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04d5400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f04e006e200 0x7f04e0070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60178/0 (socket says 172.21.15.115:60178) 2024-05-12T10:58:32.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04d5400640 1 -- 172.21.15.115:0/3678222888 learned_addr learned my addr 172.21.15.115:0/3678222888 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:32.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04de800640 1 --2- 172.21.15.115:0/3678222888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04e0071560 0x7f04e00c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04dde00640 1 -- 172.21.15.115:0/3678222888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04e0071560 msgr2=0x7f04e00c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:32.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04dde00640 1 --2- 172.21.15.115:0/3678222888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04e0071560 0x7f04e00c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04dde00640 1 -- 172.21.15.115:0/3678222888 >> v1:172.21.15.115:6789/0 conn(0x7f04e006e200 legacy=0x7f04e0070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04dde00640 1 -- 172.21.15.115:0/3678222888 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e015f080 con 0x7f04e0155d70 2024-05-12T10:58:32.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04de800640 1 --2- 172.21.15.115:0/3678222888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04e0071560 0x7f04e00c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:32.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.862+0000 7f04dd400640 1 -- 172.21.15.115:0/3678222888 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3714505578 0 0) 0x7f04e006c980 con 0x7f04e006e200 2024-05-12T10:58:32.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04dde00640 1 --2- 172.21.15.115:0/3678222888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04e0155d70 0x7f04e006c440 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f04d00097c0 tx=0x7f04d001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c98713345fe725f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04dd400640 1 -- 172.21.15.115:0/3678222888 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d00b5070 con 0x7f04e0155d70 2024-05-12T10:58:32.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04dd400640 1 -- 172.21.15.115:0/3678222888 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d00a8990 con 0x7f04e0155d70 2024-05-12T10:58:32.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04dd400640 1 -- 172.21.15.115:0/3678222888 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d00a8d60 con 0x7f04e0155d70 2024-05-12T10:58:32.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04df200640 1 -- 172.21.15.115:0/3678222888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04e0155d70 msgr2=0x7f04e006c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04df200640 1 --2- 172.21.15.115:0/3678222888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04e0155d70 0x7f04e006c440 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f04d00097c0 tx=0x7f04d001ec90 comp rx=0 tx=0).stop 2024-05-12T10:58:32.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04df200640 1 -- 172.21.15.115:0/3678222888 shutdown_connections 2024-05-12T10:58:32.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04df200640 1 --2- 172.21.15.115:0/3678222888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04e0071560 0x7f04e00c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04df200640 1 --2- 172.21.15.115:0/3678222888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04e0155d70 0x7f04e006c440 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04df200640 1 -- 172.21.15.115:0/3678222888 >> 172.21.15.115:0/3678222888 conn(0x7f04e0076830 msgr2=0x7f04e00681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:32.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04df200640 1 -- 172.21.15.115:0/3678222888 shutdown_connections 2024-05-12T10:58:32.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.866+0000 7f04df200640 1 -- 172.21.15.115:0/3678222888 wait complete. 2024-05-12T10:58:32.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04df200640 1 Processor -- start 2024-05-12T10:58:32.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04df200640 1 -- start start 2024-05-12T10:58:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04df200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04e006e200 0x7f04e014bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04df200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04e0071560 0x7f04e01f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04df200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e0155d70 0x7f04e01f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04df200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f04e015f920 con 0x7f04e006e200 2024-05-12T10:58:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04df200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f04e015f640 con 0x7f04e0155d70 2024-05-12T10:58:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04df200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f04e0070fa0 con 0x7f04e0071560 2024-05-12T10:58:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04dde00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04e006e200 0x7f04e014bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04dde00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04e006e200 0x7f04e014bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57836/0 (socket says 172.21.15.115:57836) 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04dde00640 1 -- 172.21.15.115:0/883967718 learned_addr learned my addr 172.21.15.115:0/883967718 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04d5400640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04e0071560 0x7f04e01f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04dde00640 1 -- 172.21.15.115:0/883967718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04e0071560 msgr2=0x7f04e01f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04dde00640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04e0071560 0x7f04e01f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04dde00640 1 -- 172.21.15.115:0/883967718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e0155d70 msgr2=0x7f04e01f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04dde00640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e0155d70 0x7f04e01f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04dde00640 1 -- 172.21.15.115:0/883967718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e01f5a00 con 0x7f04e006e200 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04dde00640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04e006e200 0x7f04e014bc20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f04d001c8c0 tx=0x7f04d001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04d6a00640 1 -- 172.21.15.115:0/883967718 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d00bf070 con 0x7f04e006e200 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04d6a00640 1 -- 172.21.15.115:0/883967718 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d00b07a0 con 0x7f04e006e200 2024-05-12T10:58:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04d6a00640 1 -- 172.21.15.115:0/883967718 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d00b5040 con 0x7f04e006e200 2024-05-12T10:58:32.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04df200640 1 -- 172.21.15.115:0/883967718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e01f5c70 con 0x7f04e006e200 2024-05-12T10:58:32.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04df200640 1 -- 172.21.15.115:0/883967718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e015b9c0 con 0x7f04e006e200 2024-05-12T10:58:32.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.870+0000 7f04df200640 1 -- 172.21.15.115:0/883967718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e006a230 con 0x7f04e006e200 2024-05-12T10:58:32.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.874+0000 7f04d6a00640 1 -- 172.21.15.115:0/883967718 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f04d00b0b90 con 0x7f04e006e200 2024-05-12T10:58:32.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.874+0000 7f04d6a00640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f04bc06f430 0x7f04bc0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.874+0000 7f04d6a00640 1 -- 172.21.15.115:0/883967718 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f04d012bfb0 con 0x7f04e006e200 2024-05-12T10:58:32.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.874+0000 7f04d5400640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f04bc06f430 0x7f04bc0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.874+0000 7f04d5400640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f04bc06f430 0x7f04bc0718f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f04c8007fd0 tx=0x7f04c8007b20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:32.878+0000 7f04d6a00640 1 -- 172.21.15.115:0/883967718 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f04d00187f0 con 0x7f04e006e200 2024-05-12T10:58:33.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 -- 172.21.15.115:0/883967718 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f04e0159d30 con 0x7f04bc06f430 2024-05-12T10:58:33.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04d6a00640 1 -- 172.21.15.115:0/883967718 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f04e0159d30 con 0x7f04bc06f430 2024-05-12T10:58:33.028 INFO:teuthology.orchestra.run.smithi115.stderr:instructed osd(s) 2 to deep-scrub 2024-05-12T10:58:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 -- 172.21.15.115:0/883967718 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f04bc06f430 msgr2=0x7f04bc0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f04bc06f430 0x7f04bc0718f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f04c8007fd0 tx=0x7f04c8007b20 comp rx=0 tx=0).stop 2024-05-12T10:58:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 -- 172.21.15.115:0/883967718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04e006e200 msgr2=0x7f04e014bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04e006e200 0x7f04e014bc20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f04d001c8c0 tx=0x7f04d001ba30 comp rx=0 tx=0).stop 2024-05-12T10:58:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 -- 172.21.15.115:0/883967718 shutdown_connections 2024-05-12T10:58:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f04bc06f430 0x7f04bc0718f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e0155d70 0x7f04e01f5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04e0071560 0x7f04e01f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 --2- 172.21.15.115:0/883967718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04e006e200 0x7f04e014bc20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 -- 172.21.15.115:0/883967718 >> 172.21.15.115:0/883967718 conn(0x7f04e0076830 msgr2=0x7f04e00ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 -- 172.21.15.115:0/883967718 shutdown_connections 2024-05-12T10:58:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.038+0000 7f04df200640 1 -- 172.21.15.115:0/883967718 wait complete. 2024-05-12T10:58:33.050 INFO:tasks.ceph:Scrubbing osd.3 2024-05-12T10:58:33.050 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-12T10:58:33.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.198+0000 7fe5e1800640 1 Processor -- start 2024-05-12T10:58:33.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.198+0000 7fe5e1800640 1 -- start start 2024-05-12T10:58:33.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5e1800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5dc0cc590 0x7fe5dc0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5e1800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5dc0c7590 0x7fe5dc152740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5e1800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe5dc0723e0 0x7fe5dc152c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5e1800640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fe5dc0c67d0 con 0x7fe5dc0723e0 2024-05-12T10:58:33.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5e1800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe5dc0c7ec0 con 0x7fe5dc0cc590 2024-05-12T10:58:33.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5e1800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe5dc0c64a0 con 0x7fe5dc0c7590 2024-05-12T10:58:33.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5db400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe5dc0723e0 0x7fe5dc152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5db400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe5dc0723e0 0x7fe5dc152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57838/0 (socket says 172.21.15.115:57838) 2024-05-12T10:58:33.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5db400640 1 -- 172.21.15.115:0/3841515729 learned_addr learned my addr 172.21.15.115:0/3841515729 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:33.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5daa00640 1 --2- 172.21.15.115:0/3841515729 >> v2:172.21.15.134:3300/0 conn(0x7fe5dc0cc590 0x7fe5dc0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5da000640 1 --2- 172.21.15.115:0/3841515729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5dc0c7590 0x7fe5dc152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5db400640 1 -- 172.21.15.115:0/3841515729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5dc0c7590 msgr2=0x7fe5dc152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:33.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5db400640 1 --2- 172.21.15.115:0/3841515729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5dc0c7590 0x7fe5dc152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5db400640 1 -- 172.21.15.115:0/3841515729 >> v2:172.21.15.134:3300/0 conn(0x7fe5dc0cc590 msgr2=0x7fe5dc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:33.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5db400640 1 --2- 172.21.15.115:0/3841515729 >> v2:172.21.15.134:3300/0 conn(0x7fe5dc0cc590 0x7fe5dc0c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.202+0000 7fe5db400640 1 -- 172.21.15.115:0/3841515729 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc0c8160 con 0x7fe5dc0723e0 2024-05-12T10:58:33.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5db400640 1 --2- 172.21.15.115:0/3841515729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5dc0723e0 0x7fe5dc152c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0cd220 tx=0x7fe5d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0af1c034e1cec0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5d9600640 1 -- 172.21.15.115:0/3841515729 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40b1070 con 0x7fe5dc0723e0 2024-05-12T10:58:33.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5d9600640 1 -- 172.21.15.115:0/3841515729 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d40ac410 con 0x7fe5dc0723e0 2024-05-12T10:58:33.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5d9600640 1 -- 172.21.15.115:0/3841515729 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40ac7e0 con 0x7fe5dc0723e0 2024-05-12T10:58:33.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 -- 172.21.15.115:0/3841515729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5dc0723e0 msgr2=0x7fe5dc152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 --2- 172.21.15.115:0/3841515729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5dc0723e0 0x7fe5dc152c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0cd220 tx=0x7fe5d401c520 comp rx=0 tx=0).stop 2024-05-12T10:58:33.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 -- 172.21.15.115:0/3841515729 shutdown_connections 2024-05-12T10:58:33.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 --2- 172.21.15.115:0/3841515729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5dc0723e0 0x7fe5dc152c80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 --2- 172.21.15.115:0/3841515729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5dc0c7590 0x7fe5dc152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 --2- 172.21.15.115:0/3841515729 >> v2:172.21.15.134:3300/0 conn(0x7fe5dc0cc590 0x7fe5dc0c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 -- 172.21.15.115:0/3841515729 >> 172.21.15.115:0/3841515729 conn(0x7fe5dc0cd320 msgr2=0x7fe5dc0cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:33.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 -- 172.21.15.115:0/3841515729 shutdown_connections 2024-05-12T10:58:33.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 -- 172.21.15.115:0/3841515729 wait complete. 2024-05-12T10:58:33.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 Processor -- start 2024-05-12T10:58:33.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 -- start start 2024-05-12T10:58:33.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5dc0723e0 0x7fe5dc15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5dc0c7590 0x7fe5dc1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5dc0cc590 0x7fe5dc140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0c9820 con 0x7fe5dc0723e0 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0c96a0 con 0x7fe5dc0c7590 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5e1800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe5dc0cce70 con 0x7fe5dc0cc590 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5daa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5dc0723e0 0x7fe5dc15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5daa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5dc0723e0 0x7fe5dc15a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57852/0 (socket says 172.21.15.115:57852) 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5daa00640 1 -- 172.21.15.115:0/1850093635 learned_addr learned my addr 172.21.15.115:0/1850093635 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.206+0000 7fe5da000640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5dc0c7590 0x7fe5dc1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5daa00640 1 -- 172.21.15.115:0/1850093635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5dc0cc590 msgr2=0x7fe5dc140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5daa00640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5dc0cc590 0x7fe5dc140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5daa00640 1 -- 172.21.15.115:0/1850093635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5dc0c7590 msgr2=0x7fe5dc1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5daa00640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5dc0c7590 0x7fe5dc1512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5daa00640 1 -- 172.21.15.115:0/1850093635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc06f300 con 0x7fe5dc0723e0 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5da000640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5dc0c7590 0x7fe5dc1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:33.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5daa00640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5dc0723e0 0x7fe5dc15a750 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc007ea0 tx=0x7fe5cc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5d2a00640 1 -- 172.21.15.115:0/1850093635 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc014620 con 0x7fe5dc0723e0 2024-05-12T10:58:33.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5d2a00640 1 -- 172.21.15.115:0/1850093635 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc019070 con 0x7fe5dc0723e0 2024-05-12T10:58:33.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5e1800640 1 -- 172.21.15.115:0/1850093635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5dc15ac90 con 0x7fe5dc0723e0 2024-05-12T10:58:33.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5d2a00640 1 -- 172.21.15.115:0/1850093635 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc014a00 con 0x7fe5dc0723e0 2024-05-12T10:58:33.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5e1800640 1 -- 172.21.15.115:0/1850093635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5dc1385f0 con 0x7fe5dc0723e0 2024-05-12T10:58:33.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5e1800640 1 -- 172.21.15.115:0/1850093635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5dc069730 con 0x7fe5dc0723e0 2024-05-12T10:58:33.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5d2a00640 1 -- 172.21.15.115:0/1850093635 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe5cc014ba0 con 0x7fe5dc0723e0 2024-05-12T10:58:33.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5d2a00640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe5bc06f400 0x7fe5bc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.210+0000 7fe5d2a00640 1 -- 172.21.15.115:0/1850093635 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe5cc08fe80 con 0x7fe5dc0723e0 2024-05-12T10:58:33.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.214+0000 7fe5da000640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe5bc06f400 0x7fe5bc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.214+0000 7fe5d2a00640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] conn(0x7fe5bc078e10 0x7fe5bc07b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.214+0000 7fe5d2a00640 1 -- 172.21.15.115:0/1850093635 --> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5cc00be50 con 0x7fe5bc078e10 2024-05-12T10:58:33.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.214+0000 7fe5d2a00640 1 -- 172.21.15.115:0/1850093635 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe5cc0924a0 con 0x7fe5dc0723e0 2024-05-12T10:58:33.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.214+0000 7fe5db400640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] conn(0x7fe5bc078e10 0x7fe5bc07b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.214+0000 7fe5da000640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe5bc06f400 0x7fe5bc0718c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc070b90 tx=0x7fe5c8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.214+0000 7fe5db400640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] conn(0x7fe5bc078e10 0x7fe5bc07b2b0 crc :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.214+0000 7fe5d2a00640 1 -- 172.21.15.115:0/1850093635 <== osd.3 v2:172.21.15.115:6802/1329544943 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5cc00be50 con 0x7fe5bc078e10 2024-05-12T10:58:33.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5e1800640 1 -- 172.21.15.115:0/1850093635 --> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe5dc0ca340 con 0x7fe5bc078e10 2024-05-12T10:58:33.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5d2a00640 1 -- 172.21.15.115:0/1850093635 <== osd.3 v2:172.21.15.115:6802/1329544943 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe5dc0ca340 con 0x7fe5bc078e10 2024-05-12T10:58:33.218 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:58:33.218 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T10:58:33.218 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:58:33.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5e1800640 1 -- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] conn(0x7fe5bc078e10 msgr2=0x7fe5bc07b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5e1800640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:6802/1329544943,v1:172.21.15.115:6804/1329544943] conn(0x7fe5bc078e10 0x7fe5bc07b2b0 crc :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5e1800640 1 -- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe5bc06f400 msgr2=0x7fe5bc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5e1800640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe5bc06f400 0x7fe5bc0718c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc070b90 tx=0x7fe5c8008040 comp rx=0 tx=0).stop 2024-05-12T10:58:33.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5e1800640 1 -- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5dc0723e0 msgr2=0x7fe5dc15a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5e1800640 1 --2- 172.21.15.115:0/1850093635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5dc0723e0 0x7fe5dc15a750 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc007ea0 tx=0x7fe5cc007f90 comp rx=0 tx=0).stop 2024-05-12T10:58:33.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5db400640 1 -- 172.21.15.115:0/1850093635 reap_dead start 2024-05-12T10:58:33.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5e1800640 1 -- 172.21.15.115:0/1850093635 shutdown_connections 2024-05-12T10:58:33.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5e1800640 1 -- 172.21.15.115:0/1850093635 >> 172.21.15.115:0/1850093635 conn(0x7fe5dc0cd320 msgr2=0x7fe5dc152510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:33.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5e1800640 1 -- 172.21.15.115:0/1850093635 shutdown_connections 2024-05-12T10:58:33.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.226+0000 7fe5e1800640 1 -- 172.21.15.115:0/1850093635 wait complete. 2024-05-12T10:58:33.237 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-12T10:58:33.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc58e00640 1 Processor -- start 2024-05-12T10:58:33.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc58e00640 1 -- start start 2024-05-12T10:58:33.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc58e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdc5406e6d0 0x7fdc5406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc58e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 0x7fdc54155a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc58e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc54072fe0 con 0x7fdc540caeb0 2024-05-12T10:58:33.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc58e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdc540c7e00 con 0x7fdc5406e6d0 2024-05-12T10:58:33.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc58e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdc54072880 con 0x7fdc5406f410 2024-05-12T10:58:33.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc51e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdc5406e6d0 0x7fdc5406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc49400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 0x7fdc54155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc51e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdc5406e6d0 0x7fdc5406eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.115:36556/0 (socket says 172.21.15.115:36556) 2024-05-12T10:58:33.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc52800640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fdc540caeb0 0x7fdc540734c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:45378/0 (socket says 172.21.15.115:45378) 2024-05-12T10:58:33.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc51e00640 1 -- 172.21.15.115:0/3961058720 learned_addr learned my addr 172.21.15.115:0/3961058720 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:33.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.382+0000 7fdc49400640 1 --2- 172.21.15.115:0/3961058720 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 0x7fdc54155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:48936/0 (socket says 172.21.15.115:48936) 2024-05-12T10:58:33.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.386+0000 7fdc51e00640 1 -- 172.21.15.115:0/3961058720 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 msgr2=0x7fdc54155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:33.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.386+0000 7fdc51e00640 1 --2- 172.21.15.115:0/3961058720 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 0x7fdc54155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.386+0000 7fdc51e00640 1 -- 172.21.15.115:0/3961058720 >> v1:172.21.15.134:6789/0 conn(0x7fdc540caeb0 legacy=0x7fdc540734c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.386+0000 7fdc51e00640 1 -- 172.21.15.115:0/3961058720 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc54072b40 con 0x7fdc5406e6d0 2024-05-12T10:58:33.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.386+0000 7fdc51e00640 1 --2- 172.21.15.115:0/3961058720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc5406e6d0 0x7fdc5406eab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009870 tx=0x7fdc4401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=645bf7919246b3bf server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.386+0000 7fdc51400640 1 -- 172.21.15.115:0/3961058720 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc440a7070 con 0x7fdc5406e6d0 2024-05-12T10:58:33.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.386+0000 7fdc51400640 1 -- 172.21.15.115:0/3961058720 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc440b0070 con 0x7fdc5406e6d0 2024-05-12T10:58:33.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.386+0000 7fdc51400640 1 -- 172.21.15.115:0/3961058720 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc440ab890 con 0x7fdc5406e6d0 2024-05-12T10:58:33.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 -- 172.21.15.115:0/3961058720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc5406e6d0 msgr2=0x7fdc5406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 --2- 172.21.15.115:0/3961058720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc5406e6d0 0x7fdc5406eab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009870 tx=0x7fdc4401c560 comp rx=0 tx=0).stop 2024-05-12T10:58:33.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 -- 172.21.15.115:0/3961058720 shutdown_connections 2024-05-12T10:58:33.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 --2- 172.21.15.115:0/3961058720 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 0x7fdc54155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 --2- 172.21.15.115:0/3961058720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc5406e6d0 0x7fdc5406eab0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 -- 172.21.15.115:0/3961058720 >> 172.21.15.115:0/3961058720 conn(0x7fdc540ca3c0 msgr2=0x7fdc540ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:33.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 -- 172.21.15.115:0/3961058720 shutdown_connections 2024-05-12T10:58:33.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 -- 172.21.15.115:0/3961058720 wait complete. 2024-05-12T10:58:33.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 Processor -- start 2024-05-12T10:58:33.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 -- start start 2024-05-12T10:58:33.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc5406e6d0 0x7fdc5414d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 0x7fdc54148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc540caeb0 0x7fdc54158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdc541563d0 con 0x7fdc5406e6d0 2024-05-12T10:58:33.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc54168d20 con 0x7fdc540caeb0 2024-05-12T10:58:33.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc58e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdc54168ea0 con 0x7fdc5406f410 2024-05-12T10:58:33.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc51e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc5406e6d0 0x7fdc5414d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc51e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc5406e6d0 0x7fdc5414d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57856/0 (socket says 172.21.15.115:57856) 2024-05-12T10:58:33.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc51e00640 1 -- 172.21.15.115:0/149912936 learned_addr learned my addr 172.21.15.115:0/149912936 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:33.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc52800640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc540caeb0 0x7fdc54158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc49400640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 0x7fdc54148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc51e00640 1 -- 172.21.15.115:0/149912936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 msgr2=0x7fdc54148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc51e00640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 0x7fdc54148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc51e00640 1 -- 172.21.15.115:0/149912936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc540caeb0 msgr2=0x7fdc54158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc51e00640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc540caeb0 0x7fdc54158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc51e00640 1 -- 172.21.15.115:0/149912936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5415a890 con 0x7fdc5406e6d0 2024-05-12T10:58:33.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.390+0000 7fdc49400640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 0x7fdc54148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:33.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.394+0000 7fdc51e00640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc5406e6d0 0x7fdc5414d240 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdc440ad040 tx=0x7fdc4401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.394+0000 7fdc4aa00640 1 -- 172.21.15.115:0/149912936 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc440be5f0 con 0x7fdc5406e6d0 2024-05-12T10:58:33.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.394+0000 7fdc4aa00640 1 -- 172.21.15.115:0/149912936 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc440be7b0 con 0x7fdc5406e6d0 2024-05-12T10:58:33.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.394+0000 7fdc58e00640 1 -- 172.21.15.115:0/149912936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5414b980 con 0x7fdc5406e6d0 2024-05-12T10:58:33.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.394+0000 7fdc4aa00640 1 -- 172.21.15.115:0/149912936 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc440beba0 con 0x7fdc5406e6d0 2024-05-12T10:58:33.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.394+0000 7fdc58e00640 1 -- 172.21.15.115:0/149912936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5414bf40 con 0x7fdc5406e6d0 2024-05-12T10:58:33.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.394+0000 7fdc58e00640 1 -- 172.21.15.115:0/149912936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc54069730 con 0x7fdc5406e6d0 2024-05-12T10:58:33.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.394+0000 7fdc4aa00640 1 -- 172.21.15.115:0/149912936 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdc440b43f0 con 0x7fdc5406e6d0 2024-05-12T10:58:33.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.394+0000 7fdc4aa00640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc3006f430 0x7fdc300718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.394+0000 7fdc4aa00640 1 -- 172.21.15.115:0/149912936 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdc4412a3a0 con 0x7fdc5406e6d0 2024-05-12T10:58:33.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.394+0000 7fdc49400640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc3006f430 0x7fdc300718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.398+0000 7fdc49400640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc3006f430 0x7fdc300718f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdc5414b560 tx=0x7fdc3c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.398+0000 7fdc4aa00640 1 -- 172.21.15.115:0/149912936 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fdc440c4060 con 0x7fdc5406e6d0 2024-05-12T10:58:33.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.558+0000 7fdc58e00640 1 -- 172.21.15.115:0/149912936 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fdc54147260 con 0x7fdc3006f430 2024-05-12T10:58:33.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.558+0000 7fdc4aa00640 1 -- 172.21.15.115:0/149912936 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdc3c011a10 con 0x7fdc3006f430 2024-05-12T10:58:33.550 INFO:teuthology.orchestra.run.smithi115.stderr:instructed osd(s) 3 to deep-scrub 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 -- 172.21.15.115:0/149912936 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc3006f430 msgr2=0x7fdc300718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc3006f430 0x7fdc300718f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdc5414b560 tx=0x7fdc3c008040 comp rx=0 tx=0).stop 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 -- 172.21.15.115:0/149912936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc5406e6d0 msgr2=0x7fdc5414d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc5406e6d0 0x7fdc5414d240 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdc440ad040 tx=0x7fdc4401ada0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 -- 172.21.15.115:0/149912936 shutdown_connections 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc3006f430 0x7fdc300718f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc540caeb0 0x7fdc54158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc5406f410 0x7fdc54148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 --2- 172.21.15.115:0/149912936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc5406e6d0 0x7fdc5414d240 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 -- 172.21.15.115:0/149912936 >> 172.21.15.115:0/149912936 conn(0x7fdc540ca3c0 msgr2=0x7fdc54154ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 -- 172.21.15.115:0/149912936 shutdown_connections 2024-05-12T10:58:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.562+0000 7fdc58e00640 1 -- 172.21.15.115:0/149912936 wait complete. 2024-05-12T10:58:33.571 INFO:tasks.ceph:Scrubbing osd.4 2024-05-12T10:58:33.571 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-12T10:58:33.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f2875e00640 1 Processor -- start 2024-05-12T10:58:33.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f2875e00640 1 -- start start 2024-05-12T10:58:33.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f2875e00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f28700cc590 0x7f28700c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f2875e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28700c7590 0x7f2870152740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f2875e00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28700c7ec0 con 0x7f28700723e0 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f2875e00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f28700c67d0 con 0x7f28700cc590 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f2875e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f28700c64a0 con 0x7f28700c7590 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f286ea00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f28700cc590 0x7f28700c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f286ea00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f28700cc590 0x7f28700c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57868/0 (socket says 172.21.15.115:57868) 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f286ea00640 1 -- 172.21.15.115:0/3560325650 learned_addr learned my addr 172.21.15.115:0/3560325650 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f286f400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f28700723e0 0x7f287015be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60182/0 (socket says 172.21.15.115:60182) 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.722+0000 7f2866000640 1 --2- 172.21.15.115:0/3560325650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28700c7590 0x7f2870152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f286ea00640 1 -- 172.21.15.115:0/3560325650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28700c7590 msgr2=0x7f2870152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f286ea00640 1 --2- 172.21.15.115:0/3560325650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28700c7590 0x7f2870152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f286ea00640 1 -- 172.21.15.115:0/3560325650 >> v1:172.21.15.115:6789/0 conn(0x7f28700723e0 legacy=0x7f287015be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f286ea00640 1 -- 172.21.15.115:0/3560325650 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28700c8160 con 0x7f28700cc590 2024-05-12T10:58:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f286e000640 1 -- 172.21.15.115:0/3560325650 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235236650 0 0) 0x7f28700c7ec0 con 0x7f28700723e0 2024-05-12T10:58:33.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f286ea00640 1 --2- 172.21.15.115:0/3560325650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28700cc590 0x7f28700c9160 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2860009870 tx=0x7f286001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba8e304aafef589 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f286e000640 1 -- 172.21.15.115:0/3560325650 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28600a7070 con 0x7f28700cc590 2024-05-12T10:58:33.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f286e000640 1 -- 172.21.15.115:0/3560325650 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28600b0070 con 0x7f28700cc590 2024-05-12T10:58:33.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f286e000640 1 -- 172.21.15.115:0/3560325650 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28600ab890 con 0x7f28700cc590 2024-05-12T10:58:33.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f2875e00640 1 -- 172.21.15.115:0/3560325650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28700cc590 msgr2=0x7f28700c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f2875e00640 1 --2- 172.21.15.115:0/3560325650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28700cc590 0x7f28700c9160 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2860009870 tx=0x7f286001c560 comp rx=0 tx=0).stop 2024-05-12T10:58:33.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f2875e00640 1 -- 172.21.15.115:0/3560325650 shutdown_connections 2024-05-12T10:58:33.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f2875e00640 1 --2- 172.21.15.115:0/3560325650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28700c7590 0x7f2870152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f2875e00640 1 --2- 172.21.15.115:0/3560325650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28700cc590 0x7f28700c9160 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.726+0000 7f2875e00640 1 -- 172.21.15.115:0/3560325650 >> 172.21.15.115:0/3560325650 conn(0x7f28700cd320 msgr2=0x7f28700cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:33.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 -- 172.21.15.115:0/3560325650 shutdown_connections 2024-05-12T10:58:33.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 -- 172.21.15.115:0/3560325650 wait complete. 2024-05-12T10:58:33.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 Processor -- start 2024-05-12T10:58:33.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 -- start start 2024-05-12T10:58:33.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28700723e0 0x7f28701f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28700c7590 0x7f287015b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28700cc590 0x7f287015a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f28700c96a0 con 0x7f28700c7590 2024-05-12T10:58:33.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2870153090 con 0x7f28700cc590 2024-05-12T10:58:33.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f28700c9820 con 0x7f28700723e0 2024-05-12T10:58:33.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2866000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28700c7590 0x7f287015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2866000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28700c7590 0x7f287015b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57880/0 (socket says 172.21.15.115:57880) 2024-05-12T10:58:33.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2866000640 1 -- 172.21.15.115:0/711757429 learned_addr learned my addr 172.21.15.115:0/711757429 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:33.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f286ea00640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28700723e0 0x7f28701f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f286f400640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28700cc590 0x7f287015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2866000640 1 -- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28700723e0 msgr2=0x7f28701f8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2866000640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28700723e0 0x7f28701f8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2866000640 1 -- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28700cc590 msgr2=0x7f287015a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2866000640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28700cc590 0x7f287015a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2866000640 1 -- 172.21.15.115:0/711757429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287014bc40 con 0x7f28700c7590 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f286ea00640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28700723e0 0x7f28701f8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2866000640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28700c7590 0x7f287015b640 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f285800d830 tx=0x7f285800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2867e00640 1 -- 172.21.15.115:0/711757429 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285800b6c0 con 0x7f28700c7590 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2867e00640 1 -- 172.21.15.115:0/711757429 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2858019070 con 0x7f28700c7590 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2867e00640 1 -- 172.21.15.115:0/711757429 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285800ba60 con 0x7f28700c7590 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 -- 172.21.15.115:0/711757429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287014bf20 con 0x7f28700c7590 2024-05-12T10:58:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.730+0000 7f2875e00640 1 -- 172.21.15.115:0/711757429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f287014c4e0 con 0x7f28700c7590 2024-05-12T10:58:33.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.734+0000 7f2875e00640 1 -- 172.21.15.115:0/711757429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2870069730 con 0x7f28700c7590 2024-05-12T10:58:33.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.734+0000 7f2867e00640 1 -- 172.21.15.115:0/711757429 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f285801e460 con 0x7f28700c7590 2024-05-12T10:58:33.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.734+0000 7f2867e00640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f284c06f430 0x7f284c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.734+0000 7f2867e00640 1 -- 172.21.15.115:0/711757429 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f285808fd10 con 0x7f28700c7590 2024-05-12T10:58:33.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.734+0000 7f286ea00640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f284c06f430 0x7f284c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.734+0000 7f2867e00640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] conn(0x7f284c078e40 0x7f284c07b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.734+0000 7f2867e00640 1 -- 172.21.15.115:0/711757429 --> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2858013e50 con 0x7f284c078e40 2024-05-12T10:58:33.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.734+0000 7f2867e00640 1 -- 172.21.15.115:0/711757429 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2858093020 con 0x7f28700c7590 2024-05-12T10:58:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.734+0000 7f286f400640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] conn(0x7f284c078e40 0x7f284c07b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.734+0000 7f286ea00640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f284c06f430 0x7f284c0718f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f28600af000 tx=0x7f28600a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.738+0000 7f286f400640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] conn(0x7f284c078e40 0x7f284c07b2e0 crc :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.738+0000 7f2867e00640 1 -- 172.21.15.115:0/711757429 <== osd.4 v2:172.21.15.134:6800/3949181256 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2858013e50 con 0x7f284c078e40 2024-05-12T10:58:33.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.750+0000 7f2875e00640 1 -- 172.21.15.115:0/711757429 --> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f28700c50a0 con 0x7f284c078e40 2024-05-12T10:58:33.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.750+0000 7f2867e00640 1 -- 172.21.15.115:0/711757429 <== osd.4 v2:172.21.15.134:6800/3949181256 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f28700c50a0 con 0x7f284c078e40 2024-05-12T10:58:33.743 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:58:33.743 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T10:58:33.743 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:58:33.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.750+0000 7f2875e00640 1 -- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] conn(0x7f284c078e40 msgr2=0x7f284c07b2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.750+0000 7f2875e00640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.134:6800/3949181256,v1:172.21.15.134:6801/3949181256] conn(0x7f284c078e40 0x7f284c07b2e0 crc :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.750+0000 7f2875e00640 1 -- 172.21.15.115:0/711757429 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f284c06f430 msgr2=0x7f284c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.750+0000 7f2875e00640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f284c06f430 0x7f284c0718f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f28600af000 tx=0x7f28600a7000 comp rx=0 tx=0).stop 2024-05-12T10:58:33.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.750+0000 7f2875e00640 1 -- 172.21.15.115:0/711757429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28700c7590 msgr2=0x7f287015b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.750+0000 7f2875e00640 1 --2- 172.21.15.115:0/711757429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28700c7590 0x7f287015b640 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f285800d830 tx=0x7f285800dcf0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.750+0000 7f286f400640 1 -- 172.21.15.115:0/711757429 reap_dead start 2024-05-12T10:58:33.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.754+0000 7f2875e00640 1 -- 172.21.15.115:0/711757429 shutdown_connections 2024-05-12T10:58:33.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.754+0000 7f2875e00640 1 -- 172.21.15.115:0/711757429 >> 172.21.15.115:0/711757429 conn(0x7f28700cd320 msgr2=0x7f287006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:33.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.754+0000 7f2875e00640 1 -- 172.21.15.115:0/711757429 shutdown_connections 2024-05-12T10:58:33.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.754+0000 7f2875e00640 1 -- 172.21.15.115:0/711757429 wait complete. 2024-05-12T10:58:33.761 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-12T10:58:33.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.906+0000 7f5575c00640 1 Processor -- start 2024-05-12T10:58:33.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.906+0000 7f5575c00640 1 -- start start 2024-05-12T10:58:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.906+0000 7f5575c00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5570152a10 0x7f5570159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.906+0000 7f5575c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5570152df0 0x7f5570073d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.906+0000 7f5575c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5570073820 0x7f55700742b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.906+0000 7f5575c00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f557015be20 con 0x7f5570152a10 2024-05-12T10:58:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.906+0000 7f5575c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5570072cf0 con 0x7f5570152df0 2024-05-12T10:58:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.906+0000 7f5575c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5570072fd0 con 0x7f5570073820 2024-05-12T10:58:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.906+0000 7f556ea00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5570152a10 0x7f5570159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556ea00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5570152a10 0x7f5570159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57888/0 (socket says 172.21.15.115:57888) 2024-05-12T10:58:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556ea00640 1 -- 172.21.15.115:0/4211051723 learned_addr learned my addr 172.21.15.115:0/4211051723 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f5566000640 1 --2- 172.21.15.115:0/4211051723 >> v2:172.21.15.134:3300/0 conn(0x7f5570152df0 0x7f5570073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556f400640 1 --2- 172.21.15.115:0/4211051723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5570073820 0x7f55700742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556ea00640 1 -- 172.21.15.115:0/4211051723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5570073820 msgr2=0x7f55700742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556ea00640 1 --2- 172.21.15.115:0/4211051723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5570073820 0x7f55700742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556ea00640 1 -- 172.21.15.115:0/4211051723 >> v2:172.21.15.134:3300/0 conn(0x7f5570152df0 msgr2=0x7f5570073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556ea00640 1 --2- 172.21.15.115:0/4211051723 >> v2:172.21.15.134:3300/0 conn(0x7f5570152df0 0x7f5570073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556ea00640 1 -- 172.21.15.115:0/4211051723 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55700c4990 con 0x7f5570152a10 2024-05-12T10:58:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f5566000640 1 --2- 172.21.15.115:0/4211051723 >> v2:172.21.15.134:3300/0 conn(0x7f5570152df0 0x7f5570073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:33.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556ea00640 1 --2- 172.21.15.115:0/4211051723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570152a10 0x7f5570159310 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5570071d40 tx=0x7f556001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6745ddf89e91d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556e000640 1 -- 172.21.15.115:0/4211051723 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55600a6040 con 0x7f5570152a10 2024-05-12T10:58:33.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556e000640 1 -- 172.21.15.115:0/4211051723 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55600af070 con 0x7f5570152a10 2024-05-12T10:58:33.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.910+0000 7f556e000640 1 -- 172.21.15.115:0/4211051723 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55600aa860 con 0x7f5570152a10 2024-05-12T10:58:33.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 -- 172.21.15.115:0/4211051723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570152a10 msgr2=0x7f5570159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 --2- 172.21.15.115:0/4211051723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570152a10 0x7f5570159310 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5570071d40 tx=0x7f556001c520 comp rx=0 tx=0).stop 2024-05-12T10:58:33.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 -- 172.21.15.115:0/4211051723 shutdown_connections 2024-05-12T10:58:33.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 --2- 172.21.15.115:0/4211051723 >> v2:172.21.15.134:3300/0 conn(0x7f5570152df0 0x7f5570073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 --2- 172.21.15.115:0/4211051723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5570073820 0x7f55700742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 --2- 172.21.15.115:0/4211051723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570152a10 0x7f5570159310 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 -- 172.21.15.115:0/4211051723 >> 172.21.15.115:0/4211051723 conn(0x7f5570076830 msgr2=0x7f55700681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:33.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 -- 172.21.15.115:0/4211051723 shutdown_connections 2024-05-12T10:58:33.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 -- 172.21.15.115:0/4211051723 wait complete. 2024-05-12T10:58:33.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 Processor -- start 2024-05-12T10:58:33.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 -- start start 2024-05-12T10:58:33.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5570073820 0x7f5570155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570152a10 0x7f557014ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5570152df0 0x7f5570154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f55700c67b0 con 0x7f5570152a10 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55700c6630 con 0x7f5570073820 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5575c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f55700c6930 con 0x7f5570152df0 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5566000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570152a10 0x7f557014ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5566000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570152a10 0x7f557014ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57892/0 (socket says 172.21.15.115:57892) 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5566000640 1 -- 172.21.15.115:0/1295544640 learned_addr learned my addr 172.21.15.115:0/1295544640 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f556ea00640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5570073820 0x7f5570155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f556f400640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5570152df0 0x7f5570154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5566000640 1 -- 172.21.15.115:0/1295544640 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5570152df0 msgr2=0x7f5570154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5566000640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5570152df0 0x7f5570154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5566000640 1 -- 172.21.15.115:0/1295544640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5570073820 msgr2=0x7f5570155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5566000640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5570073820 0x7f5570155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5566000640 1 -- 172.21.15.115:0/1295544640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55701f4f60 con 0x7f5570152a10 2024-05-12T10:58:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.914+0000 7f5566000640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570152a10 0x7f557014ace0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f555800d830 tx=0x7f555800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.918+0000 7f5567400640 1 -- 172.21.15.115:0/1295544640 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55580096a0 con 0x7f5570152a10 2024-05-12T10:58:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.918+0000 7f5567400640 1 -- 172.21.15.115:0/1295544640 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5558019070 con 0x7f5570152a10 2024-05-12T10:58:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.918+0000 7f5567400640 1 -- 172.21.15.115:0/1295544640 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558009a80 con 0x7f5570152a10 2024-05-12T10:58:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.918+0000 7f5575c00640 1 -- 172.21.15.115:0/1295544640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55700ca0a0 con 0x7f5570152a10 2024-05-12T10:58:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.918+0000 7f5575c00640 1 -- 172.21.15.115:0/1295544640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5570155c90 con 0x7f5570152a10 2024-05-12T10:58:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.918+0000 7f5575c00640 1 -- 172.21.15.115:0/1295544640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5570069730 con 0x7f5570152a10 2024-05-12T10:58:33.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.918+0000 7f5567400640 1 -- 172.21.15.115:0/1295544640 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f555801e460 con 0x7f5570152a10 2024-05-12T10:58:33.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.918+0000 7f5567400640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f554c06f400 0x7f554c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.918+0000 7f5567400640 1 -- 172.21.15.115:0/1295544640 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f555808fb60 con 0x7f5570152a10 2024-05-12T10:58:33.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.918+0000 7f556ea00640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f554c06f400 0x7f554c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.922+0000 7f556ea00640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f554c06f400 0x7f554c0718c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f55600ae000 tx=0x7f55600a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:33.922+0000 7f5567400640 1 -- 172.21.15.115:0/1295544640 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f555805c770 con 0x7f5570152a10 2024-05-12T10:58:34.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.082+0000 7f5575c00640 1 -- 172.21.15.115:0/1295544640 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f55700c52f0 con 0x7f554c06f400 2024-05-12T10:58:34.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.082+0000 7f5567400640 1 -- 172.21.15.115:0/1295544640 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55700c52f0 con 0x7f554c06f400 2024-05-12T10:58:34.075 INFO:teuthology.orchestra.run.smithi115.stderr:instructed osd(s) 4 to deep-scrub 2024-05-12T10:58:34.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 -- 172.21.15.115:0/1295544640 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f554c06f400 msgr2=0x7f554c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f554c06f400 0x7f554c0718c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f55600ae000 tx=0x7f55600a7000 comp rx=0 tx=0).stop 2024-05-12T10:58:34.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 -- 172.21.15.115:0/1295544640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570152a10 msgr2=0x7f557014ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570152a10 0x7f557014ace0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f555800d830 tx=0x7f555800dcf0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 -- 172.21.15.115:0/1295544640 shutdown_connections 2024-05-12T10:58:34.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f554c06f400 0x7f554c0718c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5570152df0 0x7f5570154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570152a10 0x7f557014ace0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 --2- 172.21.15.115:0/1295544640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5570073820 0x7f5570155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 -- 172.21.15.115:0/1295544640 >> 172.21.15.115:0/1295544640 conn(0x7f5570076830 msgr2=0x7f557006fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:34.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 -- 172.21.15.115:0/1295544640 shutdown_connections 2024-05-12T10:58:34.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.086+0000 7f5575c00640 1 -- 172.21.15.115:0/1295544640 wait complete. 2024-05-12T10:58:34.095 INFO:tasks.ceph:Scrubbing osd.5 2024-05-12T10:58:34.095 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-12T10:58:34.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efe01400640 1 Processor -- start 2024-05-12T10:58:34.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efe01400640 1 -- start start 2024-05-12T10:58:34.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efe01400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efdfc0b4c10 0x7efdfc0cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efe01400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdfc0c45f0 con 0x7efdfc15a560 2024-05-12T10:58:34.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efe01400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdfc0c48d0 con 0x7efdfc142bc0 2024-05-12T10:58:34.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efe01400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7efdfc0c4bb0 con 0x7efdfc0b4c10 2024-05-12T10:58:34.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efdfb200640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efdfc15a560 0x7efdfc071160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60186/0 (socket says 172.21.15.115:60186) 2024-05-12T10:58:34.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efdfb200640 1 -- 172.21.15.115:0/2841129439 learned_addr learned my addr 172.21.15.115:0/2841129439 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:34.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efdfa800640 1 --2- 172.21.15.115:0/2841129439 >> v2:172.21.15.134:3300/0 conn(0x7efdfc0b4c10 0x7efdfc0cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efdf9400640 1 -- 172.21.15.115:0/2841129439 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 406447898 0 0) 0x7efdfc0c45f0 con 0x7efdfc15a560 2024-05-12T10:58:34.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efdf9400640 1 -- 172.21.15.115:0/2841129439 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efde0003530 con 0x7efdfc15a560 2024-05-12T10:58:34.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efdf9400640 1 -- 172.21.15.115:0/2841129439 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658593659 0 0) 0x7efdfc0c48d0 con 0x7efdfc142bc0 2024-05-12T10:58:34.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efdf9400640 1 -- 172.21.15.115:0/2841129439 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdfc0c45f0 con 0x7efdfc142bc0 2024-05-12T10:58:34.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efdfa800640 1 -- 172.21.15.115:0/2841129439 >> v1:172.21.15.134:6789/0 conn(0x7efdfc142bc0 legacy=0x7efdfc159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efdf9400640 1 -- 172.21.15.115:0/2841129439 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2078430964 0 0) 0x7efde0003530 con 0x7efdfc15a560 2024-05-12T10:58:34.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efdfa800640 1 -- 172.21.15.115:0/2841129439 >> v1:172.21.15.115:6789/0 conn(0x7efdfc15a560 legacy=0x7efdfc071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.246+0000 7efdfa800640 1 -- 172.21.15.115:0/2841129439 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc0c4e90 con 0x7efdfc0b4c10 2024-05-12T10:58:34.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.250+0000 7efdfa800640 1 --2- 172.21.15.115:0/2841129439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdfc0b4c10 0x7efdfc0cfae0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efdec0097c0 tx=0x7efdec01ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=629600aa41b4dc82 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.250+0000 7efdf9400640 1 -- 172.21.15.115:0/2841129439 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec0b5070 con 0x7efdfc0b4c10 2024-05-12T10:58:34.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.250+0000 7efdf9400640 1 -- 172.21.15.115:0/2841129439 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec0a8630 con 0x7efdfc0b4c10 2024-05-12T10:58:34.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.250+0000 7efdf9400640 1 -- 172.21.15.115:0/2841129439 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4001aa0 con 0x7efdfc0b4c10 2024-05-12T10:58:34.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.250+0000 7efe01400640 1 -- 172.21.15.115:0/2841129439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdfc0b4c10 msgr2=0x7efdfc0cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.250+0000 7efe01400640 1 --2- 172.21.15.115:0/2841129439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdfc0b4c10 0x7efdfc0cfae0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efdec0097c0 tx=0x7efdec01ebb0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.250+0000 7efe01400640 1 -- 172.21.15.115:0/2841129439 shutdown_connections 2024-05-12T10:58:34.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.250+0000 7efe01400640 1 --2- 172.21.15.115:0/2841129439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdfc0b4c10 0x7efdfc0cfae0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.250+0000 7efe01400640 1 -- 172.21.15.115:0/2841129439 >> 172.21.15.115:0/2841129439 conn(0x7efdfc06c840 msgr2=0x7efdfc06cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:34.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.250+0000 7efe01400640 1 -- 172.21.15.115:0/2841129439 shutdown_connections 2024-05-12T10:58:34.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.250+0000 7efe01400640 1 -- 172.21.15.115:0/2841129439 wait complete. 2024-05-12T10:58:34.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efe01400640 1 Processor -- start 2024-05-12T10:58:34.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efe01400640 1 -- start start 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efe01400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efdfc0b4c10 0x7efdfc1f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efe01400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdfc142bc0 0x7efdfc1410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efe01400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdfc15a560 0x7efdfc1f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efe01400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1598c0 con 0x7efdfc142bc0 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efe01400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc0b4ff0 con 0x7efdfc15a560 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efe01400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7efdfc071870 con 0x7efdfc0b4c10 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdfc142bc0 0x7efdfc1410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdfc142bc0 0x7efdfc1410f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57906/0 (socket says 172.21.15.115:57906) 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf9e00640 1 -- 172.21.15.115:0/1903901103 learned_addr learned my addr 172.21.15.115:0/1903901103 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdfb200640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdfc15a560 0x7efdfc1f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdfa800640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efdfc0b4c10 0x7efdfc1f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf9e00640 1 -- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efdfc0b4c10 msgr2=0x7efdfc1f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf9e00640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efdfc0b4c10 0x7efdfc1f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf9e00640 1 -- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdfc15a560 msgr2=0x7efdfc1f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf9e00640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdfc15a560 0x7efdfc1f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf9e00640 1 -- 172.21.15.115:0/1903901103 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc1f5a90 con 0x7efdfc142bc0 2024-05-12T10:58:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdfa800640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efdfc0b4c10 0x7efdfc1f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf9e00640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdfc142bc0 0x7efdfc1410f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efde800c530 tx=0x7efde800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf2a00640 1 -- 172.21.15.115:0/1903901103 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde80052d0 con 0x7efdfc142bc0 2024-05-12T10:58:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf2a00640 1 -- 172.21.15.115:0/1903901103 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde8005490 con 0x7efdfc142bc0 2024-05-12T10:58:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efe01400640 1 -- 172.21.15.115:0/1903901103 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc139700 con 0x7efdfc142bc0 2024-05-12T10:58:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efdf2a00640 1 -- 172.21.15.115:0/1903901103 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8012850 con 0x7efdfc142bc0 2024-05-12T10:58:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.254+0000 7efe01400640 1 -- 172.21.15.115:0/1903901103 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc06f0b0 con 0x7efdfc142bc0 2024-05-12T10:58:34.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.258+0000 7efe01400640 1 -- 172.21.15.115:0/1903901103 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efdfc1f1700 con 0x7efdfc142bc0 2024-05-12T10:58:34.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.258+0000 7efdf2a00640 1 -- 172.21.15.115:0/1903901103 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efde80129f0 con 0x7efdfc142bc0 2024-05-12T10:58:34.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.258+0000 7efdf2a00640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efddc06f400 0x7efddc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.258+0000 7efdf2a00640 1 -- 172.21.15.115:0/1903901103 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7efde808f250 con 0x7efdfc142bc0 2024-05-12T10:58:34.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.258+0000 7efdfa800640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efddc06f400 0x7efddc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.258+0000 7efdf2a00640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] conn(0x7efddc078e10 0x7efddc07b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.258+0000 7efdf2a00640 1 -- 172.21.15.115:0/1903901103 --> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efddc07b980 con 0x7efddc078e10 2024-05-12T10:58:34.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.258+0000 7efdf2a00640 1 -- 172.21.15.115:0/1903901103 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efde8096050 con 0x7efdfc142bc0 2024-05-12T10:58:34.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.258+0000 7efdfb200640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] conn(0x7efddc078e10 0x7efddc07b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.258+0000 7efdfa800640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efddc06f400 0x7efddc0718c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efdec0b2000 tx=0x7efdec0aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.258+0000 7efdfb200640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] conn(0x7efddc078e10 0x7efddc07b2b0 crc :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.262+0000 7efdf2a00640 1 -- 172.21.15.115:0/1903901103 <== osd.5 v2:172.21.15.134:6808/2656330194 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efddc07b980 con 0x7efddc078e10 2024-05-12T10:58:34.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.274+0000 7efe01400640 1 -- 172.21.15.115:0/1903901103 --> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efdfc069730 con 0x7efddc078e10 2024-05-12T10:58:34.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.274+0000 7efdf2a00640 1 -- 172.21.15.115:0/1903901103 <== osd.5 v2:172.21.15.134:6808/2656330194 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efdfc069730 con 0x7efddc078e10 2024-05-12T10:58:34.267 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:58:34.267 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T10:58:34.267 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:58:34.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.274+0000 7efe01400640 1 -- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] conn(0x7efddc078e10 msgr2=0x7efddc07b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.274+0000 7efe01400640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.134:6808/2656330194,v1:172.21.15.134:6809/2656330194] conn(0x7efddc078e10 0x7efddc07b2b0 crc :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.274+0000 7efe01400640 1 -- 172.21.15.115:0/1903901103 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efddc06f400 msgr2=0x7efddc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.274+0000 7efe01400640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efddc06f400 0x7efddc0718c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efdec0b2000 tx=0x7efdec0aa070 comp rx=0 tx=0).stop 2024-05-12T10:58:34.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.274+0000 7efe01400640 1 -- 172.21.15.115:0/1903901103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdfc142bc0 msgr2=0x7efdfc1410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.274+0000 7efe01400640 1 --2- 172.21.15.115:0/1903901103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdfc142bc0 0x7efdfc1410f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efde800c530 tx=0x7efde800c9f0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.274+0000 7efdfb200640 1 -- 172.21.15.115:0/1903901103 reap_dead start 2024-05-12T10:58:34.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.278+0000 7efe01400640 1 -- 172.21.15.115:0/1903901103 shutdown_connections 2024-05-12T10:58:34.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.278+0000 7efe01400640 1 -- 172.21.15.115:0/1903901103 >> 172.21.15.115:0/1903901103 conn(0x7efdfc06c840 msgr2=0x7efdfc0cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:34.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.278+0000 7efe01400640 1 -- 172.21.15.115:0/1903901103 shutdown_connections 2024-05-12T10:58:34.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.278+0000 7efe01400640 1 -- 172.21.15.115:0/1903901103 wait complete. 2024-05-12T10:58:34.285 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-12T10:58:34.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3339400640 1 Processor -- start 2024-05-12T10:58:34.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3339400640 1 -- start start 2024-05-12T10:58:34.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3339400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3334071790 0x7f3334165200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3339400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3334071be0 con 0x7f3334150780 2024-05-12T10:58:34.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3339400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333415a2c0 con 0x7f33340c9fd0 2024-05-12T10:58:34.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3339400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f333415a830 con 0x7f3334071790 2024-05-12T10:58:34.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3334150780 0x7f33340c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60192/0 (socket says 172.21.15.115:60192) 2024-05-12T10:58:34.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333e00640 1 -- 172.21.15.115:0/4131054991 learned_addr learned my addr 172.21.15.115:0/4131054991 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:34.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3338a00640 1 --2- 172.21.15.115:0/4131054991 >> v2:172.21.15.134:3300/0 conn(0x7f3334071790 0x7f3334165200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834865731 0 0) 0x7f3324001120 con 0x7f3334150780 2024-05-12T10:58:34.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3318003530 con 0x7f3334150780 2024-05-12T10:58:34.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254231156 0 0) 0x7f333415a2c0 con 0x7f33340c9fd0 2024-05-12T10:58:34.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3324001120 con 0x7f33340c9fd0 2024-05-12T10:58:34.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1520506334 0 0) 0x7f3318003530 con 0x7f3334150780 2024-05-12T10:58:34.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 >> v2:172.21.15.134:3300/0 conn(0x7f3334071790 msgr2=0x7f3334165200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:34.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 --2- 172.21.15.115:0/4131054991 >> v2:172.21.15.134:3300/0 conn(0x7f3334071790 0x7f3334165200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 >> v1:172.21.15.134:6789/0 conn(0x7f33340c9fd0 legacy=0x7f33340cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333415a550 con 0x7f3334150780 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f33240018d0 con 0x7f3334150780 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 >> v1:172.21.15.115:6789/0 conn(0x7f3334150780 legacy=0x7f33340c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 --2- 172.21.15.115:0/4131054991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3318003c40 0x7f3318004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 --2- 172.21.15.115:0/4131054991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3318004810 0x7f3318004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 --2- 172.21.15.115:0/4131054991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3318005220 0x7f331800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f333415a830 con 0x7f3318004810 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f331800c150 con 0x7f3318005220 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.430+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f331800c350 con 0x7f3318003c40 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f332b400640 1 --2- 172.21.15.115:0/4131054991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3318004810 0x7f3318004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f3333e00640 1 --2- 172.21.15.115:0/4131054991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3318003c40 0x7f3318004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f3338a00640 1 --2- 172.21.15.115:0/4131054991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3318005220 0x7f331800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f332b400640 1 -- 172.21.15.115:0/4131054991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3318003c40 msgr2=0x7f3318004040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f332b400640 1 --2- 172.21.15.115:0/4131054991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3318003c40 0x7f3318004040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f332b400640 1 -- 172.21.15.115:0/4131054991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3318005220 msgr2=0x7f331800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:34.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f332b400640 1 --2- 172.21.15.115:0/4131054991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3318005220 0x7f331800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f332b400640 1 -- 172.21.15.115:0/4131054991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3318003530 con 0x7f3318004810 2024-05-12T10:58:34.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f3338a00640 1 -- 172.21.15.115:0/4131054991 reap_dead start 2024-05-12T10:58:34.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f332b400640 1 --2- 172.21.15.115:0/4131054991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3318004810 0x7f3318004c90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f331c001930 tx=0x7f331c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43e6597080868b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c001550 con 0x7f3318004810 2024-05-12T10:58:34.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331c0052d0 con 0x7f3318004810 2024-05-12T10:58:34.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.434+0000 7f3333400640 1 -- 172.21.15.115:0/4131054991 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c0054c0 con 0x7f3318004810 2024-05-12T10:58:34.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 -- 172.21.15.115:0/4131054991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3318004810 msgr2=0x7f3318004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 --2- 172.21.15.115:0/4131054991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3318004810 0x7f3318004c90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f331c001930 tx=0x7f331c01ec30 comp rx=0 tx=0).stop 2024-05-12T10:58:34.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 -- 172.21.15.115:0/4131054991 shutdown_connections 2024-05-12T10:58:34.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 --2- 172.21.15.115:0/4131054991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3318004810 0x7f3318004c90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 -- 172.21.15.115:0/4131054991 >> 172.21.15.115:0/4131054991 conn(0x7f3334076830 msgr2=0x7f33340681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:34.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 -- 172.21.15.115:0/4131054991 shutdown_connections 2024-05-12T10:58:34.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 -- 172.21.15.115:0/4131054991 wait complete. 2024-05-12T10:58:34.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 Processor -- start 2024-05-12T10:58:34.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 -- start start 2024-05-12T10:58:34.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3318004810 0x7f333414c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33340cdb20 0x7f33340b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33340b2550 0x7f33340b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f33340c6640 con 0x7f33340b2550 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f33340709e0 con 0x7f33340cdb20 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3339400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f33340cb160 con 0x7f3318004810 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3338a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33340b2550 0x7f33340b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3338a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33340b2550 0x7f33340b29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57922/0 (socket says 172.21.15.115:57922) 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3338a00640 1 -- 172.21.15.115:0/457712789 learned_addr learned my addr 172.21.15.115:0/457712789 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3333e00640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3318004810 0x7f333414c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f332b400640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33340cdb20 0x7f33340b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3338a00640 1 -- 172.21.15.115:0/457712789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3318004810 msgr2=0x7f333414c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3338a00640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3318004810 0x7f333414c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3338a00640 1 -- 172.21.15.115:0/457712789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33340cdb20 msgr2=0x7f33340b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3338a00640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33340cdb20 0x7f33340b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3338a00640 1 -- 172.21.15.115:0/457712789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333414cdb0 con 0x7f33340b2550 2024-05-12T10:58:34.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3333e00640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3318004810 0x7f333414c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:34.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.438+0000 7f3338a00640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33340b2550 0x7f33340b29d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3334071510 tx=0x7f332c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.442+0000 7f3330c00640 1 -- 172.21.15.115:0/457712789 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c00fe10 con 0x7f33340b2550 2024-05-12T10:58:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.442+0000 7f3330c00640 1 -- 172.21.15.115:0/457712789 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c01d070 con 0x7f33340b2550 2024-05-12T10:58:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.442+0000 7f3330c00640 1 -- 172.21.15.115:0/457712789 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c015670 con 0x7f33340b2550 2024-05-12T10:58:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.442+0000 7f3339400640 1 -- 172.21.15.115:0/457712789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33340ce370 con 0x7f33340b2550 2024-05-12T10:58:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.442+0000 7f3339400640 1 -- 172.21.15.115:0/457712789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33340ce930 con 0x7f33340b2550 2024-05-12T10:58:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.442+0000 7f3339400640 1 -- 172.21.15.115:0/457712789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3334050830 con 0x7f33340b2550 2024-05-12T10:58:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.442+0000 7f3330c00640 1 -- 172.21.15.115:0/457712789 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f332c015810 con 0x7f33340b2550 2024-05-12T10:58:34.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.442+0000 7f3330c00640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3310073890 0x7f3310075d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.442+0000 7f3330c00640 1 -- 172.21.15.115:0/457712789 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f332c08fed0 con 0x7f33340b2550 2024-05-12T10:58:34.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.442+0000 7f3333e00640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3310073890 0x7f3310075d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.446+0000 7f3333e00640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3310073890 0x7f3310075d50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f33340ca7e0 tx=0x7f3324009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.446+0000 7f3330c00640 1 -- 172.21.15.115:0/457712789 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f332c010040 con 0x7f33340b2550 2024-05-12T10:58:34.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.606+0000 7f3339400640 1 -- 172.21.15.115:0/457712789 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f3334071570 con 0x7f3310073890 2024-05-12T10:58:34.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.606+0000 7f3330c00640 1 -- 172.21.15.115:0/457712789 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3334071570 con 0x7f3310073890 2024-05-12T10:58:34.597 INFO:teuthology.orchestra.run.smithi115.stderr:instructed osd(s) 5 to deep-scrub 2024-05-12T10:58:34.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.606+0000 7f3339400640 1 -- 172.21.15.115:0/457712789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3310073890 msgr2=0x7f3310075d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.606+0000 7f3339400640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3310073890 0x7f3310075d50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f33340ca7e0 tx=0x7f3324009040 comp rx=0 tx=0).stop 2024-05-12T10:58:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.606+0000 7f3339400640 1 -- 172.21.15.115:0/457712789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33340b2550 msgr2=0x7f33340b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.606+0000 7f3339400640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33340b2550 0x7f33340b29d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3334071510 tx=0x7f332c00f580 comp rx=0 tx=0).stop 2024-05-12T10:58:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.610+0000 7f3339400640 1 -- 172.21.15.115:0/457712789 shutdown_connections 2024-05-12T10:58:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.610+0000 7f3339400640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3310073890 0x7f3310075d50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.610+0000 7f3339400640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33340b2550 0x7f33340b29d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.610+0000 7f3339400640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33340cdb20 0x7f33340b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.610+0000 7f3339400640 1 --2- 172.21.15.115:0/457712789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3318004810 0x7f333414c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.610+0000 7f3339400640 1 -- 172.21.15.115:0/457712789 >> 172.21.15.115:0/457712789 conn(0x7f3334076830 msgr2=0x7f33340681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.610+0000 7f3339400640 1 -- 172.21.15.115:0/457712789 shutdown_connections 2024-05-12T10:58:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.610+0000 7f3339400640 1 -- 172.21.15.115:0/457712789 wait complete. 2024-05-12T10:58:34.618 INFO:tasks.ceph:Scrubbing osd.6 2024-05-12T10:58:34.618 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-12T10:58:34.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b15600640 1 Processor -- start 2024-05-12T10:58:34.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b15600640 1 -- start start 2024-05-12T10:58:34.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b15600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2b10155e90 0x7f2b1006f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b15600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b100c9160 0x7f2b1006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b15600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b100cce90 con 0x7f2b100723e0 2024-05-12T10:58:34.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b15600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2b100cd170 con 0x7f2b10155e90 2024-05-12T10:58:34.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b15600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2b1015fc80 con 0x7f2b100c9160 2024-05-12T10:58:34.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b0ea00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2b10155e90 0x7f2b1006f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b0f400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b100c9160 0x7f2b1006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b0f400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b100c9160 0x7f2b1006fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.115:49020/0 (socket says 172.21.15.115:49020) 2024-05-12T10:58:34.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b0f400640 1 -- 172.21.15.115:0/3958692063 learned_addr learned my addr 172.21.15.115:0/3958692063 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:34.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b0e000640 1 --1- 172.21.15.115:0/3958692063 >> v1:172.21.15.134:6789/0 conn(0x7f2b100723e0 0x7f2b100c8a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:45412/0 (socket says 172.21.15.115:45412) 2024-05-12T10:58:34.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b0f400640 1 -- 172.21.15.115:0/3958692063 >> v2:172.21.15.134:3300/0 conn(0x7f2b10155e90 msgr2=0x7f2b1006f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:34.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b0f400640 1 --2- 172.21.15.115:0/3958692063 >> v2:172.21.15.134:3300/0 conn(0x7f2b10155e90 0x7f2b1006f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b0f400640 1 -- 172.21.15.115:0/3958692063 >> v1:172.21.15.134:6789/0 conn(0x7f2b100723e0 legacy=0x7f2b100c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.770+0000 7f2b0f400640 1 -- 172.21.15.115:0/3958692063 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1015ff60 con 0x7f2b100c9160 2024-05-12T10:58:34.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.774+0000 7f2b0f400640 1 --2- 172.21.15.115:0/3958692063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b100c9160 0x7f2b1006fcc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009e50 tx=0x7f2b0801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6851973f67fcea1b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.774+0000 7f2b0d600640 1 -- 172.21.15.115:0/3958692063 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b080a57f0 con 0x7f2b100c9160 2024-05-12T10:58:34.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.774+0000 7f2b0d600640 1 -- 172.21.15.115:0/3958692063 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b080a5990 con 0x7f2b100c9160 2024-05-12T10:58:34.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.774+0000 7f2b0d600640 1 -- 172.21.15.115:0/3958692063 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b080a5d60 con 0x7f2b100c9160 2024-05-12T10:58:34.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.774+0000 7f2b15600640 1 -- 172.21.15.115:0/3958692063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b100c9160 msgr2=0x7f2b1006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.774+0000 7f2b15600640 1 --2- 172.21.15.115:0/3958692063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b100c9160 0x7f2b1006fcc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009e50 tx=0x7f2b0801ca30 comp rx=0 tx=0).stop 2024-05-12T10:58:34.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 -- 172.21.15.115:0/3958692063 shutdown_connections 2024-05-12T10:58:34.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 --2- 172.21.15.115:0/3958692063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b100c9160 0x7f2b1006fcc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 --2- 172.21.15.115:0/3958692063 >> v2:172.21.15.134:3300/0 conn(0x7f2b10155e90 0x7f2b1006f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 -- 172.21.15.115:0/3958692063 >> 172.21.15.115:0/3958692063 conn(0x7f2b100cd320 msgr2=0x7f2b100cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:34.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 -- 172.21.15.115:0/3958692063 shutdown_connections 2024-05-12T10:58:34.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 -- 172.21.15.115:0/3958692063 wait complete. 2024-05-12T10:58:34.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 Processor -- start 2024-05-12T10:58:34.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 -- start start 2024-05-12T10:58:34.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b100723e0 0x7f2b1015df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b100c9160 0x7f2b1015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b10155e90 0x7f2b101f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10168e70 con 0x7f2b100723e0 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10168cf0 con 0x7f2b10155e90 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2b10168ff0 con 0x7f2b100c9160 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0ea00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b100723e0 0x7f2b1015df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0ea00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b100723e0 0x7f2b1015df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57924/0 (socket says 172.21.15.115:57924) 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0ea00640 1 -- 172.21.15.115:0/3815614820 learned_addr learned my addr 172.21.15.115:0/3815614820 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0e000640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b100c9160 0x7f2b1015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0f400640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b10155e90 0x7f2b101f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0ea00640 1 -- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b100c9160 msgr2=0x7f2b1015e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0ea00640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b100c9160 0x7f2b1015e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0ea00640 1 -- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b10155e90 msgr2=0x7f2b101f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0ea00640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b10155e90 0x7f2b101f6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0ea00640 1 -- 172.21.15.115:0/3815614820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b100c5e50 con 0x7f2b100723e0 2024-05-12T10:58:34.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0f400640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b10155e90 0x7f2b101f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:58:34.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b0ea00640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b100723e0 0x7f2b1015df70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000e8a0 tx=0x7f2b0000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b06a00640 1 -- 172.21.15.115:0/3815614820 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00017070 con 0x7f2b100723e0 2024-05-12T10:58:34.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b06a00640 1 -- 172.21.15.115:0/3815614820 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0000c940 con 0x7f2b100723e0 2024-05-12T10:58:34.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 -- 172.21.15.115:0/3815614820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b100c6110 con 0x7f2b100723e0 2024-05-12T10:58:34.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b06a00640 1 -- 172.21.15.115:0/3815614820 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0000ccf0 con 0x7f2b100723e0 2024-05-12T10:58:34.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.778+0000 7f2b15600640 1 -- 172.21.15.115:0/3815614820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b100c7550 con 0x7f2b100723e0 2024-05-12T10:58:34.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.782+0000 7f2b15600640 1 -- 172.21.15.115:0/3815614820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b100c63f0 con 0x7f2b100723e0 2024-05-12T10:58:34.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.782+0000 7f2b06a00640 1 -- 172.21.15.115:0/3815614820 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2b0001a070 con 0x7f2b100723e0 2024-05-12T10:58:34.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.782+0000 7f2b06a00640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2af006f400 0x7f2af00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.782+0000 7f2b06a00640 1 -- 172.21.15.115:0/3815614820 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2b0008f510 con 0x7f2b100723e0 2024-05-12T10:58:34.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.782+0000 7f2b0e000640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2af006f400 0x7f2af00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.782+0000 7f2b06a00640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] conn(0x7f2af0078e10 0x7f2af007b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.782+0000 7f2b06a00640 1 -- 172.21.15.115:0/3815614820 --> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b0000fe50 con 0x7f2af0078e10 2024-05-12T10:58:34.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.782+0000 7f2b06a00640 1 -- 172.21.15.115:0/3815614820 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b00096050 con 0x7f2b100723e0 2024-05-12T10:58:34.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.782+0000 7f2b0f400640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] conn(0x7f2af0078e10 0x7f2af007b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.782+0000 7f2b0e000640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2af006f400 0x7f2af00718c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b1015ee70 tx=0x7f2afc007c90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.786+0000 7f2b0f400640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] conn(0x7f2af0078e10 0x7f2af007b2b0 crc :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.786+0000 7f2b06a00640 1 -- 172.21.15.115:0/3815614820 <== osd.6 v2:172.21.15.134:6824/1206319910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b0000fe50 con 0x7f2af0078e10 2024-05-12T10:58:34.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.798+0000 7f2b15600640 1 -- 172.21.15.115:0/3815614820 --> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2b100c7750 con 0x7f2af0078e10 2024-05-12T10:58:34.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.798+0000 7f2b06a00640 1 -- 172.21.15.115:0/3815614820 <== osd.6 v2:172.21.15.134:6824/1206319910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2b100c7750 con 0x7f2af0078e10 2024-05-12T10:58:34.791 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:58:34.791 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T10:58:34.791 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:58:34.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.802+0000 7f2b15600640 1 -- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] conn(0x7f2af0078e10 msgr2=0x7f2af007b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.802+0000 7f2b15600640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.134:6824/1206319910,v1:172.21.15.134:6825/1206319910] conn(0x7f2af0078e10 0x7f2af007b2b0 crc :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.802+0000 7f2b15600640 1 -- 172.21.15.115:0/3815614820 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2af006f400 msgr2=0x7f2af00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.802+0000 7f2b15600640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f2af006f400 0x7f2af00718c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b1015ee70 tx=0x7f2afc007c90 comp rx=0 tx=0).stop 2024-05-12T10:58:34.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.802+0000 7f2b15600640 1 -- 172.21.15.115:0/3815614820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b100723e0 msgr2=0x7f2b1015df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.802+0000 7f2b15600640 1 --2- 172.21.15.115:0/3815614820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b100723e0 0x7f2b1015df70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000e8a0 tx=0x7f2b0000eca0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.802+0000 7f2b0f400640 1 -- 172.21.15.115:0/3815614820 reap_dead start 2024-05-12T10:58:34.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.802+0000 7f2b15600640 1 -- 172.21.15.115:0/3815614820 shutdown_connections 2024-05-12T10:58:34.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.802+0000 7f2b15600640 1 -- 172.21.15.115:0/3815614820 >> 172.21.15.115:0/3815614820 conn(0x7f2b100cd320 msgr2=0x7f2b10154e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:34.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.802+0000 7f2b15600640 1 -- 172.21.15.115:0/3815614820 shutdown_connections 2024-05-12T10:58:34.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.802+0000 7f2b15600640 1 -- 172.21.15.115:0/3815614820 wait complete. 2024-05-12T10:58:34.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-12T10:58:34.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae1ca00640 1 Processor -- start 2024-05-12T10:58:34.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae1ca00640 1 -- start start 2024-05-12T10:58:34.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae1ca00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fae18153e90 0x7fae18159a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae1ca00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae180cb3e0 con 0x7fae180cbba0 2024-05-12T10:58:34.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae1ca00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae180c6570 con 0x7fae18071a30 2024-05-12T10:58:34.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae1ca00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fae180caa40 con 0x7fae18153e90 2024-05-12T10:58:34.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae16800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fae180cbba0 0x7fae18164350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60208/0 (socket says 172.21.15.115:60208) 2024-05-12T10:58:34.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae16800640 1 -- 172.21.15.115:0/3806131245 learned_addr learned my addr 172.21.15.115:0/3806131245 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:34.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae15e00640 1 --2- 172.21.15.115:0/3806131245 >> v2:172.21.15.134:3300/0 conn(0x7fae18153e90 0x7fae18159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283473777 0 0) 0x7fae180cb3e0 con 0x7fae180cbba0 2024-05-12T10:58:34.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadfc003530 con 0x7fae180cbba0 2024-05-12T10:58:34.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4056129888 0 0) 0x7fadfc003530 con 0x7fae180cbba0 2024-05-12T10:58:34.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 >> v2:172.21.15.134:3300/0 conn(0x7fae18153e90 msgr2=0x7fae18159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:34.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 --2- 172.21.15.115:0/3806131245 >> v2:172.21.15.134:3300/0 conn(0x7fae18153e90 0x7fae18159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 >> v1:172.21.15.134:6789/0 conn(0x7fae18071a30 legacy=0x7fae180cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae180ca170 con 0x7fae180cbba0 2024-05-12T10:58:34.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fae10001aa0 con 0x7fae180cbba0 2024-05-12T10:58:34.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 >> v1:172.21.15.115:6789/0 conn(0x7fae180cbba0 legacy=0x7fae18164350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 --2- 172.21.15.115:0/3806131245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadfc003a10 0x7fadfc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 --2- 172.21.15.115:0/3806131245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc004810 0x7fadfc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 --2- 172.21.15.115:0/3806131245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0051d0 0x7fadfc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fae180caa40 con 0x7fadfc0051d0 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc00c070 con 0x7fadfc004810 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fadfc00c270 con 0x7fadfc003a10 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae16800640 1 --2- 172.21.15.115:0/3806131245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0051d0 0x7fadfc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae15e00640 1 --2- 172.21.15.115:0/3806131245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadfc003a10 0x7fadfc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.958+0000 7fae15400640 1 --2- 172.21.15.115:0/3806131245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc004810 0x7fadfc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae16800640 1 -- 172.21.15.115:0/3806131245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadfc003a10 msgr2=0x7fadfc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae16800640 1 --2- 172.21.15.115:0/3806131245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadfc003a10 0x7fadfc003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae16800640 1 -- 172.21.15.115:0/3806131245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc004810 msgr2=0x7fadfc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae16800640 1 --2- 172.21.15.115:0/3806131245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc004810 0x7fadfc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae16800640 1 -- 172.21.15.115:0/3806131245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc003530 con 0x7fadfc0051d0 2024-05-12T10:58:34.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae16800640 1 -- 172.21.15.115:0/3806131245 reap_dead start 2024-05-12T10:58:34.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae16800640 1 --2- 172.21.15.115:0/3806131245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0051d0 0x7fadfc00b9d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fae180cb5b0 tx=0x7fae1001f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b1a9bbad37b655 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1000a450 con 0x7fadfc0051d0 2024-05-12T10:58:34.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae100072d0 con 0x7fadfc0051d0 2024-05-12T10:58:34.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae14a00640 1 -- 172.21.15.115:0/3806131245 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae100076c0 con 0x7fadfc0051d0 2024-05-12T10:58:34.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae1ca00640 1 -- 172.21.15.115:0/3806131245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0051d0 msgr2=0x7fadfc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae1ca00640 1 --2- 172.21.15.115:0/3806131245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0051d0 0x7fadfc00b9d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fae180cb5b0 tx=0x7fae1001f940 comp rx=0 tx=0).stop 2024-05-12T10:58:34.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae1ca00640 1 -- 172.21.15.115:0/3806131245 shutdown_connections 2024-05-12T10:58:34.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae1ca00640 1 --2- 172.21.15.115:0/3806131245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0051d0 0x7fadfc00b9d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae1ca00640 1 -- 172.21.15.115:0/3806131245 >> 172.21.15.115:0/3806131245 conn(0x7fae18072050 msgr2=0x7fae18072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:34.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae1ca00640 1 -- 172.21.15.115:0/3806131245 shutdown_connections 2024-05-12T10:58:34.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.962+0000 7fae1ca00640 1 -- 172.21.15.115:0/3806131245 wait complete. 2024-05-12T10:58:34.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae1ca00640 1 Processor -- start 2024-05-12T10:58:34.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae1ca00640 1 -- start start 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae1ca00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0051d0 0x7fae180afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae1ca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae180b11f0 0x7fae180c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae1ca00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae18157860 0x7fae18157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae1ca00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fae180b4080 con 0x7fae180b11f0 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae1ca00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae180ca450 con 0x7fadfc0051d0 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae1ca00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fae180b4200 con 0x7fae18157860 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae15400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae180b11f0 0x7fae180c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae15400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae180b11f0 0x7fae180c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57946/0 (socket says 172.21.15.115:57946) 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae15400640 1 -- 172.21.15.115:0/3591423018 learned_addr learned my addr 172.21.15.115:0/3591423018 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae15e00640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0051d0 0x7fae180afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae16800640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae18157860 0x7fae18157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae15400640 1 -- 172.21.15.115:0/3591423018 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae18157860 msgr2=0x7fae18157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae15400640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae18157860 0x7fae18157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae15400640 1 -- 172.21.15.115:0/3591423018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0051d0 msgr2=0x7fae180afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:34.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae15400640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0051d0 0x7fae180afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:34.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae15400640 1 -- 172.21.15.115:0/3591423018 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1815a4e0 con 0x7fae180b11f0 2024-05-12T10:58:34.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae15400640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae180b11f0 0x7fae180c4850 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fae0000f7d0 tx=0x7fae0000fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae0e000640 1 -- 172.21.15.115:0/3591423018 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0001a070 con 0x7fae180b11f0 2024-05-12T10:58:34.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae0e000640 1 -- 172.21.15.115:0/3591423018 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae00005110 con 0x7fae180b11f0 2024-05-12T10:58:34.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae0e000640 1 -- 172.21.15.115:0/3591423018 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae000067e0 con 0x7fae180b11f0 2024-05-12T10:58:34.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae1ca00640 1 -- 172.21.15.115:0/3591423018 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1806ea20 con 0x7fae180b11f0 2024-05-12T10:58:34.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.966+0000 7fae1ca00640 1 -- 172.21.15.115:0/3591423018 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae181f4ab0 con 0x7fae180b11f0 2024-05-12T10:58:34.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.970+0000 7fae1ca00640 1 -- 172.21.15.115:0/3591423018 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae18069730 con 0x7fae180b11f0 2024-05-12T10:58:34.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.970+0000 7fae0e000640 1 -- 172.21.15.115:0/3591423018 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fae0001d070 con 0x7fae180b11f0 2024-05-12T10:58:34.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.970+0000 7fae0e000640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadf406f400 0x7fadf40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:34.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.970+0000 7fae0e000640 1 -- 172.21.15.115:0/3591423018 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fae0008efe0 con 0x7fae180b11f0 2024-05-12T10:58:34.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.970+0000 7fae15e00640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadf406f400 0x7fadf40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:34.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.970+0000 7fae15e00640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadf406f400 0x7fadf40718c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fae08009b60 tx=0x7fae08009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:34.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:34.974+0000 7fae0e000640 1 -- 172.21.15.115:0/3591423018 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fae1815a4e0 con 0x7fae180b11f0 2024-05-12T10:58:35.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae1ca00640 1 -- 172.21.15.115:0/3591423018 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fae180caf10 con 0x7fadf406f400 2024-05-12T10:58:35.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae0e000640 1 -- 172.21.15.115:0/3591423018 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fae180caf10 con 0x7fadf406f400 2024-05-12T10:58:35.125 INFO:teuthology.orchestra.run.smithi115.stderr:instructed osd(s) 6 to deep-scrub 2024-05-12T10:58:35.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae1ca00640 1 -- 172.21.15.115:0/3591423018 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadf406f400 msgr2=0x7fadf40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae1ca00640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadf406f400 0x7fadf40718c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fae08009b60 tx=0x7fae08009190 comp rx=0 tx=0).stop 2024-05-12T10:58:35.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae1ca00640 1 -- 172.21.15.115:0/3591423018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae180b11f0 msgr2=0x7fae180c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae1ca00640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae180b11f0 0x7fae180c4850 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fae0000f7d0 tx=0x7fae0000fbd0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae1ca00640 1 -- 172.21.15.115:0/3591423018 shutdown_connections 2024-05-12T10:58:35.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae1ca00640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fadf406f400 0x7fadf40718c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae1ca00640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae18157860 0x7fae18157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae1ca00640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae180b11f0 0x7fae180c4850 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae1ca00640 1 --2- 172.21.15.115:0/3591423018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadfc0051d0 0x7fae180afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.134+0000 7fae1ca00640 1 -- 172.21.15.115:0/3591423018 >> 172.21.15.115:0/3591423018 conn(0x7fae18072050 msgr2=0x7fae180b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:35.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.138+0000 7fae1ca00640 1 -- 172.21.15.115:0/3591423018 shutdown_connections 2024-05-12T10:58:35.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.138+0000 7fae1ca00640 1 -- 172.21.15.115:0/3591423018 wait complete. 2024-05-12T10:58:35.147 INFO:tasks.ceph:Scrubbing osd.7 2024-05-12T10:58:35.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-12T10:58:35.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d9a00640 1 Processor -- start 2024-05-12T10:58:35.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d9a00640 1 -- start start 2024-05-12T10:58:35.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d9a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94d40c7590 0x7f94d4152740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d9a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94d40c7ec0 con 0x7f94d40cc590 2024-05-12T10:58:35.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d9a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94d40c64a0 con 0x7f94d40723e0 2024-05-12T10:58:35.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d9a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f94d40c9870 con 0x7f94d40c7590 2024-05-12T10:58:35.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d2a00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f94d40cc590 0x7f94d40c9160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60216/0 (socket says 172.21.15.115:60216) 2024-05-12T10:58:35.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d2a00640 1 -- 172.21.15.115:0/211613869 learned_addr learned my addr 172.21.15.115:0/211613869 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:35.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d2000640 1 --2- 172.21.15.115:0/211613869 >> v2:172.21.15.115:3300/0 conn(0x7f94d40c7590 0x7f94d4152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d1600640 1 -- 172.21.15.115:0/211613869 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2055016988 0 0) 0x7f94d40c7ec0 con 0x7f94d40cc590 2024-05-12T10:58:35.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d1600640 1 -- 172.21.15.115:0/211613869 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94b8003530 con 0x7f94d40cc590 2024-05-12T10:58:35.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d2000640 1 -- 172.21.15.115:0/211613869 >> v1:172.21.15.134:6789/0 conn(0x7f94d40723e0 legacy=0x7f94d4163260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:35.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d2000640 1 -- 172.21.15.115:0/211613869 >> v1:172.21.15.115:6789/0 conn(0x7f94d40cc590 legacy=0x7f94d40c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.298+0000 7f94d2000640 1 -- 172.21.15.115:0/211613869 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d40c8160 con 0x7f94d40c7590 2024-05-12T10:58:35.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.302+0000 7f94d2000640 1 --2- 172.21.15.115:0/211613869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94d40c7590 0x7f94d4152740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f94d40c6670 tx=0x7f94c001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886a671761852ac4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.302+0000 7f94d1600640 1 -- 172.21.15.115:0/211613869 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c00b1070 con 0x7f94d40c7590 2024-05-12T10:58:35.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.302+0000 7f94d1600640 1 -- 172.21.15.115:0/211613869 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c00ac410 con 0x7f94d40c7590 2024-05-12T10:58:35.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.302+0000 7f94d1600640 1 -- 172.21.15.115:0/211613869 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c00ac7e0 con 0x7f94d40c7590 2024-05-12T10:58:35.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.302+0000 7f94d9a00640 1 -- 172.21.15.115:0/211613869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94d40c7590 msgr2=0x7f94d4152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.302+0000 7f94d9a00640 1 --2- 172.21.15.115:0/211613869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94d40c7590 0x7f94d4152740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f94d40c6670 tx=0x7f94c001c4a0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.302+0000 7f94d9a00640 1 -- 172.21.15.115:0/211613869 shutdown_connections 2024-05-12T10:58:35.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.302+0000 7f94d9a00640 1 --2- 172.21.15.115:0/211613869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94d40c7590 0x7f94d4152740 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.302+0000 7f94d9a00640 1 -- 172.21.15.115:0/211613869 >> 172.21.15.115:0/211613869 conn(0x7f94d40cd320 msgr2=0x7f94d40cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:35.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.302+0000 7f94d9a00640 1 -- 172.21.15.115:0/211613869 shutdown_connections 2024-05-12T10:58:35.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.302+0000 7f94d9a00640 1 -- 172.21.15.115:0/211613869 wait complete. 2024-05-12T10:58:35.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d9a00640 1 Processor -- start 2024-05-12T10:58:35.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d9a00640 1 -- start start 2024-05-12T10:58:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d9a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94d40723e0 0x7f94d4157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d9a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94d40c7590 0x7f94d41f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d9a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d40cc590 0x7f94d41459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d9a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f94d40c67d0 con 0x7f94d40723e0 2024-05-12T10:58:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d9a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4153090 con 0x7f94d40cc590 2024-05-12T10:58:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d9a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f94d40cce70 con 0x7f94d40c7590 2024-05-12T10:58:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d2a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94d40723e0 0x7f94d4157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d2a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94d40723e0 0x7f94d4157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57972/0 (socket says 172.21.15.115:57972) 2024-05-12T10:58:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d2a00640 1 -- 172.21.15.115:0/237574690 learned_addr learned my addr 172.21.15.115:0/237574690 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d2000640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94d40c7590 0x7f94d41f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d3400640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d40cc590 0x7f94d41459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d2a00640 1 -- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94d40c7590 msgr2=0x7f94d41f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d2a00640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94d40c7590 0x7f94d41f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d2a00640 1 -- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d40cc590 msgr2=0x7f94d41459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d2a00640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d40cc590 0x7f94d41459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d2a00640 1 -- 172.21.15.115:0/237574690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d414e700 con 0x7f94d40723e0 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d3400640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d40cc590 0x7f94d41459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d2a00640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94d40723e0 0x7f94d4157a00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f94c400c460 tx=0x7f94c400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94caa00640 1 -- 172.21.15.115:0/237574690 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c4017070 con 0x7f94d40723e0 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94caa00640 1 -- 172.21.15.115:0/237574690 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c4005cf0 con 0x7f94d40723e0 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94caa00640 1 -- 172.21.15.115:0/237574690 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c4007270 con 0x7f94d40723e0 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d9a00640 1 -- 172.21.15.115:0/237574690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d4151910 con 0x7f94d40723e0 2024-05-12T10:58:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d9a00640 1 -- 172.21.15.115:0/237574690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d415bf60 con 0x7f94d40723e0 2024-05-12T10:58:35.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.306+0000 7f94d9a00640 1 -- 172.21.15.115:0/237574690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94d414ea90 con 0x7f94d40723e0 2024-05-12T10:58:35.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.310+0000 7f94caa00640 1 -- 172.21.15.115:0/237574690 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f94c401a070 con 0x7f94d40723e0 2024-05-12T10:58:35.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.310+0000 7f94caa00640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f94b406f400 0x7f94b40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.310+0000 7f94caa00640 1 -- 172.21.15.115:0/237574690 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f94c408e800 con 0x7f94d40723e0 2024-05-12T10:58:35.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.310+0000 7f94d2000640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f94b406f400 0x7f94b40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.310+0000 7f94caa00640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] conn(0x7f94b4078e10 0x7f94b407b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.310+0000 7f94caa00640 1 -- 172.21.15.115:0/237574690 --> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94b407b980 con 0x7f94b4078e10 2024-05-12T10:58:35.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.310+0000 7f94caa00640 1 -- 172.21.15.115:0/237574690 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94c40932c0 con 0x7f94d40723e0 2024-05-12T10:58:35.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.310+0000 7f94d3400640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] conn(0x7f94b4078e10 0x7f94b407b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.310+0000 7f94d2000640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f94b406f400 0x7f94b40718c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f94c00ae000 tx=0x7f94c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.310+0000 7f94d3400640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] conn(0x7f94b4078e10 0x7f94b407b2b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.314+0000 7f94caa00640 1 -- 172.21.15.115:0/237574690 <== osd.7 v2:172.21.15.134:6816/3958491632 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f94b407b980 con 0x7f94b4078e10 2024-05-12T10:58:35.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d9a00640 1 -- 172.21.15.115:0/237574690 --> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f94d4069730 con 0x7f94b4078e10 2024-05-12T10:58:35.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94caa00640 1 -- 172.21.15.115:0/237574690 <== osd.7 v2:172.21.15.134:6816/3958491632 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f94d4069730 con 0x7f94b4078e10 2024-05-12T10:58:35.318 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-12T10:58:35.318 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T10:58:35.318 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-12T10:58:35.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d9a00640 1 -- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] conn(0x7f94b4078e10 msgr2=0x7f94b407b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d9a00640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.134:6816/3958491632,v1:172.21.15.134:6817/3958491632] conn(0x7f94b4078e10 0x7f94b407b2b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d9a00640 1 -- 172.21.15.115:0/237574690 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f94b406f400 msgr2=0x7f94b40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d9a00640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f94b406f400 0x7f94b40718c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f94c00ae000 tx=0x7f94c0008040 comp rx=0 tx=0).stop 2024-05-12T10:58:35.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d9a00640 1 -- 172.21.15.115:0/237574690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94d40723e0 msgr2=0x7f94d4157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d9a00640 1 --2- 172.21.15.115:0/237574690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94d40723e0 0x7f94d4157a00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f94c400c460 tx=0x7f94c400c920 comp rx=0 tx=0).stop 2024-05-12T10:58:35.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d3400640 1 -- 172.21.15.115:0/237574690 reap_dead start 2024-05-12T10:58:35.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d9a00640 1 -- 172.21.15.115:0/237574690 shutdown_connections 2024-05-12T10:58:35.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d9a00640 1 -- 172.21.15.115:0/237574690 >> 172.21.15.115:0/237574690 conn(0x7f94d40cd320 msgr2=0x7f94d4155520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:35.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d9a00640 1 -- 172.21.15.115:0/237574690 shutdown_connections 2024-05-12T10:58:35.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.326+0000 7f94d9a00640 1 -- 172.21.15.115:0/237574690 wait complete. 2024-05-12T10:58:35.337 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-12T10:58:35.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5784400640 1 Processor -- start 2024-05-12T10:58:35.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5784400640 1 -- start start 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5784400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f577c071a30 0x7f577c0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5784400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f577c0cae10 0x7f577c0cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5784400640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577c0ca040 con 0x7f577c0b20a0 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5784400640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f577c0ca980 con 0x7f577c071a30 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5784400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f577c0cbde0 con 0x7f577c0cae10 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5781000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f577c071a30 0x7f577c0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5781000640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f577c071a30 0x7f577c0cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57988/0 (socket says 172.21.15.115:57988) 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5781000640 1 -- 172.21.15.115:0/3856360294 learned_addr learned my addr 172.21.15.115:0/3856360294 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5782400640 1 --2- 172.21.15.115:0/3856360294 >> v2:172.21.15.134:3300/0 conn(0x7f577c0cae10 0x7f577c0cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5781000640 1 -- 172.21.15.115:0/3856360294 >> v2:172.21.15.134:3300/0 conn(0x7f577c0cae10 msgr2=0x7f577c0cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5781000640 1 --2- 172.21.15.115:0/3856360294 >> v2:172.21.15.134:3300/0 conn(0x7f577c0cae10 0x7f577c0cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5781000640 1 -- 172.21.15.115:0/3856360294 >> v1:172.21.15.115:6789/0 conn(0x7f577c0b20a0 legacy=0x7f577c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.482+0000 7f5781000640 1 -- 172.21.15.115:0/3856360294 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c071260 con 0x7f577c071a30 2024-05-12T10:58:35.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f5781000640 1 --2- 172.21.15.115:0/3856360294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577c071a30 0x7f577c0cc060 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f577c074450 tx=0x7f576801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97fbc0ddc2b47b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f577be00640 1 -- 172.21.15.115:0/3856360294 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57680b5070 con 0x7f577c071a30 2024-05-12T10:58:35.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f577be00640 1 -- 172.21.15.115:0/3856360294 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57680a8a10 con 0x7f577c071a30 2024-05-12T10:58:35.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f577be00640 1 -- 172.21.15.115:0/3856360294 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57680a8de0 con 0x7f577c071a30 2024-05-12T10:58:35.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f5784400640 1 -- 172.21.15.115:0/3856360294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577c071a30 msgr2=0x7f577c0cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f5784400640 1 --2- 172.21.15.115:0/3856360294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577c071a30 0x7f577c0cc060 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f577c074450 tx=0x7f576801ed10 comp rx=0 tx=0).stop 2024-05-12T10:58:35.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f5784400640 1 -- 172.21.15.115:0/3856360294 shutdown_connections 2024-05-12T10:58:35.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f5784400640 1 --2- 172.21.15.115:0/3856360294 >> v2:172.21.15.134:3300/0 conn(0x7f577c0cae10 0x7f577c0cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f5784400640 1 --2- 172.21.15.115:0/3856360294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577c071a30 0x7f577c0cc060 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f5784400640 1 -- 172.21.15.115:0/3856360294 >> 172.21.15.115:0/3856360294 conn(0x7f577c072050 msgr2=0x7f577c072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:35.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f5784400640 1 -- 172.21.15.115:0/3856360294 shutdown_connections 2024-05-12T10:58:35.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.486+0000 7f5784400640 1 -- 172.21.15.115:0/3856360294 wait complete. 2024-05-12T10:58:35.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5784400640 1 Processor -- start 2024-05-12T10:58:35.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5784400640 1 -- start start 2024-05-12T10:58:35.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5784400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577c071a30 0x7f577c1f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5784400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f577c0b20a0 0x7f577c0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5784400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f577c0cae10 0x7f577c154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5784400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f577c071540 con 0x7f577c071a30 2024-05-12T10:58:35.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5784400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f577c0cbb00 con 0x7f577c0b20a0 2024-05-12T10:58:35.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5784400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f577c06f3a0 con 0x7f577c0cae10 2024-05-12T10:58:35.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5781a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577c071a30 0x7f577c1f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5781a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577c071a30 0x7f577c1f5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58004/0 (socket says 172.21.15.115:58004) 2024-05-12T10:58:35.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5781a00640 1 -- 172.21.15.115:0/817631205 learned_addr learned my addr 172.21.15.115:0/817631205 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:35.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5782400640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f577c0cae10 0x7f577c154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5781000640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f577c0b20a0 0x7f577c0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5781a00640 1 -- 172.21.15.115:0/817631205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f577c0cae10 msgr2=0x7f577c154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5781a00640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f577c0cae10 0x7f577c154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5781a00640 1 -- 172.21.15.115:0/817631205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f577c0b20a0 msgr2=0x7f577c0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5781a00640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f577c0b20a0 0x7f577c0b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5781a00640 1 -- 172.21.15.115:0/817631205 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c1540b0 con 0x7f577c071a30 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5781000640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f577c0b20a0 0x7f577c0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5782400640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f577c0cae10 0x7f577c154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5781a00640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577c071a30 0x7f577c1f5290 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f577000c530 tx=0x7f577000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5779600640 1 -- 172.21.15.115:0/817631205 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770017070 con 0x7f577c071a30 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5779600640 1 -- 172.21.15.115:0/817631205 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57700052d0 con 0x7f577c071a30 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5784400640 1 -- 172.21.15.115:0/817631205 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f577c1f5920 con 0x7f577c071a30 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5779600640 1 -- 172.21.15.115:0/817631205 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770012870 con 0x7f577c071a30 2024-05-12T10:58:35.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.490+0000 7f5784400640 1 -- 172.21.15.115:0/817631205 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f577c1f5ec0 con 0x7f577c071a30 2024-05-12T10:58:35.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.494+0000 7f5784400640 1 -- 172.21.15.115:0/817631205 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f577c069730 con 0x7f577c071a30 2024-05-12T10:58:35.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.494+0000 7f5779600640 1 -- 172.21.15.115:0/817631205 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f577001a070 con 0x7f577c071a30 2024-05-12T10:58:35.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.494+0000 7f5779600640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f575c06f400 0x7f575c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.494+0000 7f5779600640 1 -- 172.21.15.115:0/817631205 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f577008eaa0 con 0x7f577c071a30 2024-05-12T10:58:35.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.494+0000 7f5781000640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f575c06f400 0x7f575c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.494+0000 7f5781000640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f575c06f400 0x7f575c0718c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f57680b2000 tx=0x7f57680aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.498+0000 7f5779600640 1 -- 172.21.15.115:0/817631205 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5770005480 con 0x7f577c071a30 2024-05-12T10:58:35.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.662+0000 7f5784400640 1 -- 172.21.15.115:0/817631205 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f577c071810 con 0x7f575c06f400 2024-05-12T10:58:35.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.662+0000 7f5779600640 1 -- 172.21.15.115:0/817631205 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f577c071810 con 0x7f575c06f400 2024-05-12T10:58:35.654 INFO:teuthology.orchestra.run.smithi115.stderr:instructed osd(s) 7 to deep-scrub 2024-05-12T10:58:35.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 -- 172.21.15.115:0/817631205 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f575c06f400 msgr2=0x7f575c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f575c06f400 0x7f575c0718c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f57680b2000 tx=0x7f57680aa070 comp rx=0 tx=0).stop 2024-05-12T10:58:35.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 -- 172.21.15.115:0/817631205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577c071a30 msgr2=0x7f577c1f5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577c071a30 0x7f577c1f5290 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f577000c530 tx=0x7f577000c9f0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 -- 172.21.15.115:0/817631205 shutdown_connections 2024-05-12T10:58:35.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f575c06f400 0x7f575c0718c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f577c0cae10 0x7f577c154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f577c0b20a0 0x7f577c0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 --2- 172.21.15.115:0/817631205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f577c071a30 0x7f577c1f5290 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 -- 172.21.15.115:0/817631205 >> 172.21.15.115:0/817631205 conn(0x7f577c072050 msgr2=0x7f577c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:35.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 -- 172.21.15.115:0/817631205 shutdown_connections 2024-05-12T10:58:35.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.666+0000 7f5784400640 1 -- 172.21.15.115:0/817631205 wait complete. 2024-05-12T10:58:35.676 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:58:35.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08bc800640 1 Processor -- start 2024-05-12T10:58:35.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08bc800640 1 -- start start 2024-05-12T10:58:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08bc800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b40c5260 0x7f08b415d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08bc800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f08b40ca8c0 0x7f08b415d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08bc800640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b40c8e60 con 0x7f08b4153c90 2024-05-12T10:58:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08bc800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f08b40cf230 con 0x7f08b40ca8c0 2024-05-12T10:58:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08bc800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f08b40c93e0 con 0x7f08b40c5260 2024-05-12T10:58:35.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b9e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f08b4153c90 0x7f08b40c79d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60232/0 (socket says 172.21.15.115:60232) 2024-05-12T10:58:35.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b9e00640 1 -- 172.21.15.115:0/1854280221 learned_addr learned my addr 172.21.15.115:0/1854280221 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b9400640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b40c5260 0x7f08b415d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08ba800640 1 --2- 172.21.15.115:0/1854280221 >> v2:172.21.15.134:3300/0 conn(0x7f08b40ca8c0 0x7f08b415d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379395088 0 0) 0x7f08b40c8e60 con 0x7f08b4153c90 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f089c003530 con 0x7f08b4153c90 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 800459759 0 0) 0x7f089c003530 con 0x7f08b4153c90 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b40c5260 msgr2=0x7f08b415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b40c5260 0x7f08b415d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 >> v2:172.21.15.134:3300/0 conn(0x7f08b40ca8c0 msgr2=0x7f08b415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 --2- 172.21.15.115:0/1854280221 >> v2:172.21.15.134:3300/0 conn(0x7f08b40ca8c0 0x7f08b415d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b40cef50 con 0x7f08b4153c90 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f08a8001700 con 0x7f08b4153c90 2024-05-12T10:58:35.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 >> v1:172.21.15.115:6789/0 conn(0x7f08b4153c90 legacy=0x7f08b40c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b40c5260 0x7f089c003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c003fe0 0x7f089c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f089c004d50 0x7f089c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f08b40cf230 con 0x7f089c004d50 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08b40c93e0 con 0x7f089c003fe0 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f089c00ba20 con 0x7f08b40c5260 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08ba800640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f089c004d50 0x7f089c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b9400640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c003fe0 0x7f089c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.826+0000 7f08b9e00640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b40c5260 0x7f089c003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08ba800640 1 -- 172.21.15.115:0/1854280221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b40c5260 msgr2=0x7f089c003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08ba800640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b40c5260 0x7f089c003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08ba800640 1 -- 172.21.15.115:0/1854280221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c003fe0 msgr2=0x7f089c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08ba800640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c003fe0 0x7f089c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08ba800640 1 -- 172.21.15.115:0/1854280221 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089c003530 con 0x7f089c004d50 2024-05-12T10:58:35.822 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08ba800640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f089c004d50 0x7f089c0051d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f08b000e170 tx=0x7f08b001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15aefb124f0f62be server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.822 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b00b2070 con 0x7f089c004d50 2024-05-12T10:58:35.822 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b00a5cb0 con 0x7f089c004d50 2024-05-12T10:58:35.822 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08b8a00640 1 -- 172.21.15.115:0/1854280221 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b0009c10 con 0x7f089c004d50 2024-05-12T10:58:35.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08bc800640 1 -- 172.21.15.115:0/1854280221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f089c004d50 msgr2=0x7f089c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08bc800640 1 --2- 172.21.15.115:0/1854280221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f089c004d50 0x7f089c0051d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f08b000e170 tx=0x7f08b001cca0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08ba800640 1 -- 172.21.15.115:0/1854280221 reap_dead start 2024-05-12T10:58:35.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08bc800640 1 -- 172.21.15.115:0/1854280221 shutdown_connections 2024-05-12T10:58:35.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08bc800640 1 -- 172.21.15.115:0/1854280221 >> 172.21.15.115:0/1854280221 conn(0x7f08b40ce2c0 msgr2=0x7f08b40ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:35.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08bc800640 1 -- 172.21.15.115:0/1854280221 shutdown_connections 2024-05-12T10:58:35.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.830+0000 7f08bc800640 1 -- 172.21.15.115:0/1854280221 wait complete. 2024-05-12T10:58:35.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08bc800640 1 Processor -- start 2024-05-12T10:58:35.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08bc800640 1 -- start start 2024-05-12T10:58:35.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08bc800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c004d50 0x7f08b40cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08bc800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b414eda0 0x7f08b41f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08bc800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b414a2a0 0x7f08b41f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08bc800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f08b41541f0 con 0x7f08b414a2a0 2024-05-12T10:58:35.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08bc800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4154070 con 0x7f089c004d50 2024-05-12T10:58:35.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08bc800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f08b40c4cf0 con 0x7f08b414eda0 2024-05-12T10:58:35.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08ba800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b414a2a0 0x7f08b41f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08ba800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b414a2a0 0x7f08b41f30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58030/0 (socket says 172.21.15.115:58030) 2024-05-12T10:58:35.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08ba800640 1 -- 172.21.15.115:0/2780884996 learned_addr learned my addr 172.21.15.115:0/2780884996 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:35.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08b9400640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b414eda0 0x7f08b41f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08b9e00640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c004d50 0x7f08b40cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08ba800640 1 -- 172.21.15.115:0/2780884996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b414eda0 msgr2=0x7f08b41f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08ba800640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b414eda0 0x7f08b41f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08ba800640 1 -- 172.21.15.115:0/2780884996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c004d50 msgr2=0x7f08b40cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08ba800640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c004d50 0x7f08b40cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08ba800640 1 -- 172.21.15.115:0/2780884996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b41491b0 con 0x7f08b414a2a0 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.834+0000 7f08b9e00640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c004d50 0x7f08b40cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.838+0000 7f08ba800640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b414a2a0 0x7f08b41f30b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f08b000e170 tx=0x7f08b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.838+0000 7f08ae000640 1 -- 172.21.15.115:0/2780884996 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b00bc070 con 0x7f08b414a2a0 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.838+0000 7f08ae000640 1 -- 172.21.15.115:0/2780884996 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b00adb70 con 0x7f08b414a2a0 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.838+0000 7f08ae000640 1 -- 172.21.15.115:0/2780884996 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b00b2040 con 0x7f08b414a2a0 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.838+0000 7f08bc800640 1 -- 172.21.15.115:0/2780884996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b4149450 con 0x7f08b414a2a0 2024-05-12T10:58:35.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.838+0000 7f08bc800640 1 -- 172.21.15.115:0/2780884996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b4146ec0 con 0x7f08b414a2a0 2024-05-12T10:58:35.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.838+0000 7f08bc800640 1 -- 172.21.15.115:0/2780884996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b4069730 con 0x7f08b414a2a0 2024-05-12T10:58:35.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.838+0000 7f08ae000640 1 -- 172.21.15.115:0/2780884996 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f08b00039a0 con 0x7f08b414a2a0 2024-05-12T10:58:35.831 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.838+0000 7f08ae000640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f089806f400 0x7f08980718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.831 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.838+0000 7f08ae000640 1 -- 172.21.15.115:0/2780884996 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f08b0129500 con 0x7f08b414a2a0 2024-05-12T10:58:35.831 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.838+0000 7f08b9e00640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f089806f400 0x7f08980718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.831 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.842+0000 7f08b9e00640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f089806f400 0x7f08980718c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f08a8007e60 tx=0x7f08a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:35.842+0000 7f08ae000640 1 -- 172.21.15.115:0/2780884996 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f08b0016a30 con 0x7f08b414a2a0 2024-05-12T10:58:35.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.002+0000 7f08bc800640 1 -- 172.21.15.115:0/2780884996 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08b4151130 con 0x7f089806f400 2024-05-12T10:58:35.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.010+0000 7f08ae000640 1 -- 172.21.15.115:0/2780884996 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332434 (secure 0 0 0) 0x7f08b4151130 con 0x7f089806f400 2024-05-12T10:58:36.003 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:58:36.005 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:58:36.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 -- 172.21.15.115:0/2780884996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f089806f400 msgr2=0x7f08980718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:36.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f089806f400 0x7f08980718c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f08a8007e60 tx=0x7f08a8009040 comp rx=0 tx=0).stop 2024-05-12T10:58:36.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 -- 172.21.15.115:0/2780884996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b414a2a0 msgr2=0x7f08b41f30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:36.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b414a2a0 0x7f08b41f30b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f08b000e170 tx=0x7f08b0009750 comp rx=0 tx=0).stop 2024-05-12T10:58:36.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 -- 172.21.15.115:0/2780884996 shutdown_connections 2024-05-12T10:58:36.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f089806f400 0x7f08980718c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:36.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08b414a2a0 0x7f08b41f30b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:36.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08b414eda0 0x7f08b41f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:36.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 --2- 172.21.15.115:0/2780884996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c004d50 0x7f08b40cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:36.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 -- 172.21.15.115:0/2780884996 >> 172.21.15.115:0/2780884996 conn(0x7f08b40ce2c0 msgr2=0x7f08b4071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:36.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 -- 172.21.15.115:0/2780884996 shutdown_connections 2024-05-12T10:58:36.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:36.014+0000 7f08bc800640 1 -- 172.21.15.115:0/2780884996 wait complete. 2024-05-12T10:58:36.024 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-05-12T10:58:35.927413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4426588,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":5199,"num_read_kb":21004348,"num_write":11425,"num_write_kb":25171468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12114,"ondisk_log_size":12114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":518536,"kb_used_data":11144,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":754456184,"statfs":{"total":773094113280,"available":772563132416,"internally_reserved":0,"allocated":11411456,"data_stored":9851584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":519491121},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9047,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002939"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:17.852216+0000","last_change":"2024-05-12T10:49:54.640093+0000","last_active":"2024-05-12T10:58:17.852216+0000","last_peered":"2024-05-12T10:58:17.852216+0000","last_clean":"2024-05-12T10:58:17.852216+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:58:17.852216+0000","last_undegraded":"2024-05-12T10:58:17.852216+0000","last_fullsized":"2024-05-12T10:58:17.852216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.669950+0000","last_change":"2024-05-12T10:49:55.635928+0000","last_active":"2024-05-12T10:58:28.669950+0000","last_peered":"2024-05-12T10:58:28.669950+0000","last_clean":"2024-05-12T10:58:28.669950+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:58:28.669950+0000","last_undegraded":"2024-05-12T10:58:28.669950+0000","last_fullsized":"2024-05-12T10:58:28.669950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:41:30.909036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'315","reported_seq":515,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.842369+0000","last_change":"2024-05-12T10:50:00.396417+0000","last_active":"2024-05-12T10:58:01.842369+0000","last_peered":"2024-05-12T10:58:01.842369+0000","last_clean":"2024-05-12T10:58:01.842369+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:58:01.842369+0000","last_undegraded":"2024-05-12T10:58:01.842369+0000","last_fullsized":"2024-05-12T10:58:01.842369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:27.287617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.839501+0000","last_change":"2024-05-12T10:49:54.619268+0000","last_active":"2024-05-12T10:55:57.839501+0000","last_peered":"2024-05-12T10:55:57.839501+0000","last_clean":"2024-05-12T10:55:57.839501+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:55:57.839501+0000","last_undegraded":"2024-05-12T10:55:57.839501+0000","last_fullsized":"2024-05-12T10:55:57.839501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:50:34.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:32.126290+0000","last_change":"2024-05-12T10:58:32.126311+0000","last_active":"2024-05-12T10:58:32.126290+0000","last_peered":"2024-05-12T10:58:32.126290+0000","last_clean":"2024-05-12T10:58:32.126290+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:58:32.126290+0000","last_undegraded":"2024-05-12T10:58:32.126290+0000","last_fullsized":"2024-05-12T10:58:32.126290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:32.126224+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:32.126224+0000","last_clean_scrub_stamp":"2024-05-12T10:58:32.126224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:40:36.607439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'342","reported_seq":562,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.931276+0000","last_change":"2024-05-12T10:49:59.676139+0000","last_active":"2024-05-12T10:58:01.931276+0000","last_peered":"2024-05-12T10:58:01.931276+0000","last_clean":"2024-05-12T10:58:01.931276+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:58:01.931276+0000","last_undegraded":"2024-05-12T10:58:01.931276+0000","last_fullsized":"2024-05-12T10:58:01.931276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:24:15.396258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844325+0000","last_change":"2024-05-12T10:49:54.645331+0000","last_active":"2024-05-12T10:54:57.844325+0000","last_peered":"2024-05-12T10:54:57.844325+0000","last_clean":"2024-05-12T10:54:57.844325+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:54:57.844325+0000","last_undegraded":"2024-05-12T10:54:57.844325+0000","last_fullsized":"2024-05-12T10:54:57.844325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:38:29.023589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'9","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.703505+0000","last_change":"2024-05-12T10:49:55.642386+0000","last_active":"2024-05-12T10:58:28.703505+0000","last_peered":"2024-05-12T10:58:28.703505+0000","last_clean":"2024-05-12T10:58:28.703505+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:58:28.703505+0000","last_undegraded":"2024-05-12T10:58:28.703505+0000","last_fullsized":"2024-05-12T10:58:28.703505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:54:40.153070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'284","reported_seq":457,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.898022+0000","last_change":"2024-05-12T10:49:59.679887+0000","last_active":"2024-05-12T10:58:01.898022+0000","last_peered":"2024-05-12T10:58:01.898022+0000","last_clean":"2024-05-12T10:58:01.898022+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:58:01.898022+0000","last_undegraded":"2024-05-12T10:58:01.898022+0000","last_fullsized":"2024-05-12T10:58:01.898022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:25:43.004918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":274,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.844272+0000","last_change":"2024-05-12T10:49:54.659229+0000","last_active":"2024-05-12T10:54:57.844272+0000","last_peered":"2024-05-12T10:54:57.844272+0000","last_clean":"2024-05-12T10:54:57.844272+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:54:57.844272+0000","last_undegraded":"2024-05-12T10:54:57.844272+0000","last_fullsized":"2024-05-12T10:54:57.844272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:54:54.658165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.711856+0000","last_change":"2024-05-12T10:49:55.642157+0000","last_active":"2024-05-12T10:58:28.711856+0000","last_peered":"2024-05-12T10:58:28.711856+0000","last_clean":"2024-05-12T10:58:28.711856+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:58:28.711856+0000","last_undegraded":"2024-05-12T10:58:28.711856+0000","last_fullsized":"2024-05-12T10:58:28.711856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:16.232731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'263","reported_seq":429,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.893300+0000","last_change":"2024-05-12T10:49:59.663411+0000","last_active":"2024-05-12T10:58:01.893300+0000","last_peered":"2024-05-12T10:58:01.893300+0000","last_clean":"2024-05-12T10:58:01.893300+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:58:01.893300+0000","last_undegraded":"2024-05-12T10:58:01.893300+0000","last_fullsized":"2024-05-12T10:58:01.893300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:59.136704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.686876+0000","last_change":"2024-05-12T10:49:55.646019+0000","last_active":"2024-05-12T10:58:28.686876+0000","last_peered":"2024-05-12T10:58:28.686876+0000","last_clean":"2024-05-12T10:58:28.686876+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:58:28.686876+0000","last_undegraded":"2024-05-12T10:58:28.686876+0000","last_fullsized":"2024-05-12T10:58:28.686876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:07.957107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.835029+0000","last_change":"2024-05-12T10:49:54.642039+0000","last_active":"2024-05-12T10:54:27.835029+0000","last_peered":"2024-05-12T10:54:27.835029+0000","last_clean":"2024-05-12T10:54:27.835029+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:54:27.835029+0000","last_undegraded":"2024-05-12T10:54:27.835029+0000","last_fullsized":"2024-05-12T10:54:27.835029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:01.155569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'316","reported_seq":520,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.922676+0000","last_change":"2024-05-12T10:49:59.660274+0000","last_active":"2024-05-12T10:58:01.922676+0000","last_peered":"2024-05-12T10:58:01.922676+0000","last_clean":"2024-05-12T10:58:01.922676+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:58:01.922676+0000","last_undegraded":"2024-05-12T10:58:01.922676+0000","last_fullsized":"2024-05-12T10:58:01.922676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T10:55:12.579645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":737280,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.656918+0000","last_change":"2024-05-12T10:49:55.618128+0000","last_active":"2024-05-12T10:58:28.656918+0000","last_peered":"2024-05-12T10:58:28.656918+0000","last_clean":"2024-05-12T10:58:28.656918+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:58:28.656918+0000","last_undegraded":"2024-05-12T10:58:28.656918+0000","last_fullsized":"2024-05-12T10:58:28.656918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:45.205117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:27.869711+0000","last_change":"2024-05-12T10:49:54.619967+0000","last_active":"2024-05-12T10:56:27.869711+0000","last_peered":"2024-05-12T10:56:27.869711+0000","last_clean":"2024-05-12T10:56:27.869711+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:56:27.869711+0000","last_undegraded":"2024-05-12T10:56:27.869711+0000","last_fullsized":"2024-05-12T10:56:27.869711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'296","reported_seq":488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.884554+0000","last_change":"2024-05-12T10:49:59.681931+0000","last_active":"2024-05-12T10:58:01.884554+0000","last_peered":"2024-05-12T10:58:01.884554+0000","last_clean":"2024-05-12T10:58:01.884554+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:58:01.884554+0000","last_undegraded":"2024-05-12T10:58:01.884554+0000","last_fullsized":"2024-05-12T10:58:01.884554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:45:01.542628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'9","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.658172+0000","last_change":"2024-05-12T10:49:55.615095+0000","last_active":"2024-05-12T10:58:28.658172+0000","last_peered":"2024-05-12T10:58:28.658172+0000","last_clean":"2024-05-12T10:58:28.658172+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:58:28.658172+0000","last_undegraded":"2024-05-12T10:58:28.658172+0000","last_fullsized":"2024-05-12T10:58:28.658172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:51:19.659941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:27.869677+0000","last_change":"2024-05-12T10:49:54.639976+0000","last_active":"2024-05-12T10:56:27.869677+0000","last_peered":"2024-05-12T10:56:27.869677+0000","last_clean":"2024-05-12T10:56:27.869677+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:56:27.869677+0000","last_undegraded":"2024-05-12T10:56:27.869677+0000","last_fullsized":"2024-05-12T10:56:27.869677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'273","reported_seq":446,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.859327+0000","last_change":"2024-05-12T10:50:36.857272+0000","last_active":"2024-05-12T10:58:01.859327+0000","last_peered":"2024-05-12T10:58:01.859327+0000","last_clean":"2024-05-12T10:58:01.859327+0000","last_became_active":"2024-05-12T10:50:36.856826+0000","last_became_peered":"2024-05-12T10:50:36.856826+0000","last_unstale":"2024-05-12T10:58:01.859327+0000","last_undegraded":"2024-05-12T10:58:01.859327+0000","last_fullsized":"2024-05-12T10:58:01.859327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:39:58.339959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"28'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.640837+0000","last_change":"2024-05-12T10:49:55.622729+0000","last_active":"2024-05-12T10:58:28.640837+0000","last_peered":"2024-05-12T10:58:28.640837+0000","last_clean":"2024-05-12T10:58:28.640837+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:58:28.640837+0000","last_undegraded":"2024-05-12T10:58:28.640837+0000","last_fullsized":"2024-05-12T10:58:28.640837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:08:29.460684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:17.833425+0000","last_change":"2024-05-12T10:49:54.639564+0000","last_active":"2024-05-12T10:54:17.833425+0000","last_peered":"2024-05-12T10:54:17.833425+0000","last_clean":"2024-05-12T10:54:17.833425+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:54:17.833425+0000","last_undegraded":"2024-05-12T10:54:17.833425+0000","last_fullsized":"2024-05-12T10:54:17.833425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:54:48.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'296","reported_seq":498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.952784+0000","last_change":"2024-05-12T10:50:36.858842+0000","last_active":"2024-05-12T10:58:01.952784+0000","last_peered":"2024-05-12T10:58:01.952784+0000","last_clean":"2024-05-12T10:58:01.952784+0000","last_became_active":"2024-05-12T10:50:36.857477+0000","last_became_peered":"2024-05-12T10:50:36.857477+0000","last_unstale":"2024-05-12T10:58:01.952784+0000","last_undegraded":"2024-05-12T10:58:01.952784+0000","last_fullsized":"2024-05-12T10:58:01.952784+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:08:55.931301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":700416,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'7","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.666827+0000","last_change":"2024-05-12T10:49:55.612744+0000","last_active":"2024-05-12T10:58:28.666827+0000","last_peered":"2024-05-12T10:58:28.666827+0000","last_clean":"2024-05-12T10:58:28.666827+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:58:28.666827+0000","last_undegraded":"2024-05-12T10:58:28.666827+0000","last_fullsized":"2024-05-12T10:58:28.666827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:27.868553+0000","last_change":"2024-05-12T10:49:54.643375+0000","last_active":"2024-05-12T10:56:27.868553+0000","last_peered":"2024-05-12T10:56:27.868553+0000","last_clean":"2024-05-12T10:56:27.868553+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:56:27.868553+0000","last_undegraded":"2024-05-12T10:56:27.868553+0000","last_fullsized":"2024-05-12T10:56:27.868553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:56:43.086871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'259","reported_seq":414,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.958352+0000","last_change":"2024-05-12T10:50:00.393325+0000","last_active":"2024-05-12T10:58:01.958352+0000","last_peered":"2024-05-12T10:58:01.958352+0000","last_clean":"2024-05-12T10:58:01.958352+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:58:01.958352+0000","last_undegraded":"2024-05-12T10:58:01.958352+0000","last_fullsized":"2024-05-12T10:58:01.958352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:55.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":532480,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.665919+0000","last_change":"2024-05-12T10:49:55.629693+0000","last_active":"2024-05-12T10:58:28.665919+0000","last_peered":"2024-05-12T10:58:28.665919+0000","last_clean":"2024-05-12T10:58:28.665919+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:58:28.665919+0000","last_undegraded":"2024-05-12T10:58:28.665919+0000","last_fullsized":"2024-05-12T10:58:28.665919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:04:13.325079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'34","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.770150+0000","last_change":"2024-05-12T10:49:54.629227+0000","last_active":"2024-05-12T10:58:28.770150+0000","last_peered":"2024-05-12T10:58:28.770150+0000","last_clean":"2024-05-12T10:58:28.770150+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:58:28.770150+0000","last_undegraded":"2024-05-12T10:58:28.770150+0000","last_fullsized":"2024-05-12T10:58:28.770150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'270","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:02.118119+0000","last_change":"2024-05-12T10:50:00.396371+0000","last_active":"2024-05-12T10:58:02.118119+0000","last_peered":"2024-05-12T10:58:02.118119+0000","last_clean":"2024-05-12T10:58:02.118119+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:58:02.118119+0000","last_undegraded":"2024-05-12T10:58:02.118119+0000","last_fullsized":"2024-05-12T10:58:02.118119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:41:09.157859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'9","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.664647+0000","last_change":"2024-05-12T10:49:55.612069+0000","last_active":"2024-05-12T10:58:28.664647+0000","last_peered":"2024-05-12T10:58:28.664647+0000","last_clean":"2024-05-12T10:58:28.664647+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:58:28.664647+0000","last_undegraded":"2024-05-12T10:58:28.664647+0000","last_fullsized":"2024-05-12T10:58:28.664647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.855055+0000","last_change":"2024-05-12T10:49:54.639928+0000","last_active":"2024-05-12T10:56:12.855055+0000","last_peered":"2024-05-12T10:56:12.855055+0000","last_clean":"2024-05-12T10:56:12.855055+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:56:12.855055+0000","last_undegraded":"2024-05-12T10:56:12.855055+0000","last_fullsized":"2024-05-12T10:56:12.855055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:59.215089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'261","reported_seq":423,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:22.852853+0000","last_change":"2024-05-12T10:50:00.383605+0000","last_active":"2024-05-12T10:58:22.852853+0000","last_peered":"2024-05-12T10:58:22.852853+0000","last_clean":"2024-05-12T10:58:22.852853+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:58:22.852853+0000","last_undegraded":"2024-05-12T10:58:22.852853+0000","last_fullsized":"2024-05-12T10:58:22.852853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'5","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.707294+0000","last_change":"2024-05-12T10:49:55.621201+0000","last_active":"2024-05-12T10:58:28.707294+0000","last_peered":"2024-05-12T10:58:28.707294+0000","last_clean":"2024-05-12T10:58:28.707294+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:58:28.707294+0000","last_undegraded":"2024-05-12T10:58:28.707294+0000","last_fullsized":"2024-05-12T10:58:28.707294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:19:39.117790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:17.893987+0000","last_change":"2024-05-12T10:49:54.620329+0000","last_active":"2024-05-12T10:58:17.893987+0000","last_peered":"2024-05-12T10:58:17.893987+0000","last_clean":"2024-05-12T10:58:17.893987+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:58:17.893987+0000","last_undegraded":"2024-05-12T10:58:17.893987+0000","last_fullsized":"2024-05-12T10:58:17.893987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'282","reported_seq":466,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:22.894529+0000","last_change":"2024-05-12T10:49:59.655432+0000","last_active":"2024-05-12T10:58:22.894529+0000","last_peered":"2024-05-12T10:58:22.894529+0000","last_clean":"2024-05-12T10:58:22.894529+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:58:22.894529+0000","last_undegraded":"2024-05-12T10:58:22.894529+0000","last_fullsized":"2024-05-12T10:58:22.894529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'7","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.671422+0000","last_change":"2024-05-12T10:49:55.628221+0000","last_active":"2024-05-12T10:58:28.671422+0000","last_peered":"2024-05-12T10:58:28.671422+0000","last_clean":"2024-05-12T10:58:28.671422+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:58:28.671422+0000","last_undegraded":"2024-05-12T10:58:28.671422+0000","last_fullsized":"2024-05-12T10:58:28.671422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:54.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856655+0000","last_change":"2024-05-12T10:49:54.652499+0000","last_active":"2024-05-12T10:56:12.856655+0000","last_peered":"2024-05-12T10:56:12.856655+0000","last_clean":"2024-05-12T10:56:12.856655+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:56:12.856655+0000","last_undegraded":"2024-05-12T10:56:12.856655+0000","last_fullsized":"2024-05-12T10:56:12.856655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:14:35.180779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'269","reported_seq":443,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:22.894564+0000","last_change":"2024-05-12T10:49:59.676676+0000","last_active":"2024-05-12T10:58:22.894564+0000","last_peered":"2024-05-12T10:58:22.894564+0000","last_clean":"2024-05-12T10:58:22.894564+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:58:22.894564+0000","last_undegraded":"2024-05-12T10:58:22.894564+0000","last_fullsized":"2024-05-12T10:58:22.894564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.662974+0000","last_change":"2024-05-12T10:49:55.610830+0000","last_active":"2024-05-12T10:58:28.662974+0000","last_peered":"2024-05-12T10:58:28.662974+0000","last_clean":"2024-05-12T10:58:28.662974+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:58:28.662974+0000","last_undegraded":"2024-05-12T10:58:28.662974+0000","last_fullsized":"2024-05-12T10:58:28.662974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'11","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:29.098964+0000","last_change":"2024-05-12T10:49:54.609239+0000","last_active":"2024-05-12T10:58:29.098964+0000","last_peered":"2024-05-12T10:58:29.098964+0000","last_clean":"2024-05-12T10:58:29.098964+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:58:29.098964+0000","last_undegraded":"2024-05-12T10:58:29.098964+0000","last_fullsized":"2024-05-12T10:58:29.098964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:12:54.169428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'281","reported_seq":448,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.960628+0000","last_change":"2024-05-12T10:49:59.656739+0000","last_active":"2024-05-12T10:58:01.960628+0000","last_peered":"2024-05-12T10:58:01.960628+0000","last_clean":"2024-05-12T10:58:01.960628+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:58:01.960628+0000","last_undegraded":"2024-05-12T10:58:01.960628+0000","last_fullsized":"2024-05-12T10:58:01.960628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.680894+0000","last_change":"2024-05-12T10:49:55.626312+0000","last_active":"2024-05-12T10:58:28.680894+0000","last_peered":"2024-05-12T10:58:28.680894+0000","last_clean":"2024-05-12T10:58:28.680894+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:58:28.680894+0000","last_undegraded":"2024-05-12T10:58:28.680894+0000","last_fullsized":"2024-05-12T10:58:28.680894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:57.852660+0000","last_change":"2024-05-12T10:49:54.640819+0000","last_active":"2024-05-12T10:55:57.852660+0000","last_peered":"2024-05-12T10:55:57.852660+0000","last_clean":"2024-05-12T10:55:57.852660+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:55:57.852660+0000","last_undegraded":"2024-05-12T10:55:57.852660+0000","last_fullsized":"2024-05-12T10:55:57.852660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:01.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'345","reported_seq":556,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.917362+0000","last_change":"2024-05-12T10:50:00.384347+0000","last_active":"2024-05-12T10:58:01.917362+0000","last_peered":"2024-05-12T10:58:01.917362+0000","last_clean":"2024-05-12T10:58:01.917362+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:58:01.917362+0000","last_undegraded":"2024-05-12T10:58:01.917362+0000","last_fullsized":"2024-05-12T10:58:01.917362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.684583+0000","last_change":"2024-05-12T10:50:36.847396+0000","last_active":"2024-05-12T10:58:28.684583+0000","last_peered":"2024-05-12T10:58:28.684583+0000","last_clean":"2024-05-12T10:58:28.684583+0000","last_became_active":"2024-05-12T10:50:36.847173+0000","last_became_peered":"2024-05-12T10:50:36.847173+0000","last_unstale":"2024-05-12T10:58:28.684583+0000","last_undegraded":"2024-05-12T10:58:28.684583+0000","last_fullsized":"2024-05-12T10:58:28.684583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:33:38.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:12.856683+0000","last_change":"2024-05-12T10:49:54.648333+0000","last_active":"2024-05-12T10:56:12.856683+0000","last_peered":"2024-05-12T10:56:12.856683+0000","last_clean":"2024-05-12T10:56:12.856683+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:56:12.856683+0000","last_undegraded":"2024-05-12T10:56:12.856683+0000","last_fullsized":"2024-05-12T10:56:12.856683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:29.355444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:55:47.851335+0000","last_change":"2024-05-12T10:49:45.547469+0000","last_active":"2024-05-12T10:55:47.851335+0000","last_peered":"2024-05-12T10:55:47.851335+0000","last_clean":"2024-05-12T10:55:47.851335+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:55:47.851335+0000","last_undegraded":"2024-05-12T10:55:47.851335+0000","last_fullsized":"2024-05-12T10:55:47.851335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:43.953472+0000","last_clean_scrub_stamp":"2024-05-12T10:49:43.953472+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:44:15.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'290","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.940955+0000","last_change":"2024-05-12T10:50:00.399288+0000","last_active":"2024-05-12T10:58:01.940955+0000","last_peered":"2024-05-12T10:58:01.940955+0000","last_clean":"2024-05-12T10:58:01.940955+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:58:01.940955+0000","last_undegraded":"2024-05-12T10:58:01.940955+0000","last_fullsized":"2024-05-12T10:58:01.940955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:26.959086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.711406+0000","last_change":"2024-05-12T10:49:55.639605+0000","last_active":"2024-05-12T10:58:28.711406+0000","last_peered":"2024-05-12T10:58:28.711406+0000","last_clean":"2024-05-12T10:58:28.711406+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:58:28.711406+0000","last_undegraded":"2024-05-12T10:58:28.711406+0000","last_fullsized":"2024-05-12T10:58:28.711406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:46:26.585195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.883531+0000","last_change":"2024-05-12T10:49:54.654999+0000","last_active":"2024-05-12T10:54:27.883531+0000","last_peered":"2024-05-12T10:54:27.883531+0000","last_clean":"2024-05-12T10:54:27.883531+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:54:27.883531+0000","last_undegraded":"2024-05-12T10:54:27.883531+0000","last_fullsized":"2024-05-12T10:54:27.883531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:00:20.115739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'291","reported_seq":475,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.907983+0000","last_change":"2024-05-12T10:50:00.393017+0000","last_active":"2024-05-12T10:58:01.907983+0000","last_peered":"2024-05-12T10:58:01.907983+0000","last_clean":"2024-05-12T10:58:01.907983+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:58:01.907983+0000","last_undegraded":"2024-05-12T10:58:01.907983+0000","last_fullsized":"2024-05-12T10:58:01.907983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:01:02.394572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'6","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.652420+0000","last_change":"2024-05-12T10:50:36.844615+0000","last_active":"2024-05-12T10:58:28.652420+0000","last_peered":"2024-05-12T10:58:28.652420+0000","last_clean":"2024-05-12T10:58:28.652420+0000","last_became_active":"2024-05-12T10:50:36.844312+0000","last_became_peered":"2024-05-12T10:50:36.844312+0000","last_unstale":"2024-05-12T10:58:28.652420+0000","last_undegraded":"2024-05-12T10:58:28.652420+0000","last_fullsized":"2024-05-12T10:58:28.652420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:54:38.598097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:42.879682+0000","last_change":"2024-05-12T10:49:54.628492+0000","last_active":"2024-05-12T10:56:42.879682+0000","last_peered":"2024-05-12T10:56:42.879682+0000","last_clean":"2024-05-12T10:56:42.879682+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:56:42.879682+0000","last_undegraded":"2024-05-12T10:56:42.879682+0000","last_fullsized":"2024-05-12T10:56:42.879682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'266","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.947932+0000","last_change":"2024-05-12T10:49:59.657783+0000","last_active":"2024-05-12T10:58:01.947932+0000","last_peered":"2024-05-12T10:58:01.947932+0000","last_clean":"2024-05-12T10:58:01.947932+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:58:01.947932+0000","last_undegraded":"2024-05-12T10:58:01.947932+0000","last_fullsized":"2024-05-12T10:58:01.947932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.708595+0000","last_change":"2024-05-12T10:49:55.646246+0000","last_active":"2024-05-12T10:58:28.708595+0000","last_peered":"2024-05-12T10:58:28.708595+0000","last_clean":"2024-05-12T10:58:28.708595+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:58:28.708595+0000","last_undegraded":"2024-05-12T10:58:28.708595+0000","last_fullsized":"2024-05-12T10:58:28.708595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:32.142128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.883564+0000","last_change":"2024-05-12T10:49:54.610076+0000","last_active":"2024-05-12T10:54:27.883564+0000","last_peered":"2024-05-12T10:54:27.883564+0000","last_clean":"2024-05-12T10:54:27.883564+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:54:27.883564+0000","last_undegraded":"2024-05-12T10:54:27.883564+0000","last_fullsized":"2024-05-12T10:54:27.883564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:12:04.400894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'323","reported_seq":517,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.901879+0000","last_change":"2024-05-12T10:50:00.386172+0000","last_active":"2024-05-12T10:58:01.901879+0000","last_peered":"2024-05-12T10:58:01.901879+0000","last_clean":"2024-05-12T10:58:01.901879+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:58:01.901879+0000","last_undegraded":"2024-05-12T10:58:01.901879+0000","last_fullsized":"2024-05-12T10:58:01.901879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:06:17.550197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.707669+0000","last_change":"2024-05-12T10:49:55.646249+0000","last_active":"2024-05-12T10:58:28.707669+0000","last_peered":"2024-05-12T10:58:28.707669+0000","last_clean":"2024-05-12T10:58:28.707669+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:58:28.707669+0000","last_undegraded":"2024-05-12T10:58:28.707669+0000","last_fullsized":"2024-05-12T10:58:28.707669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:42:15.036675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:27.841354+0000","last_change":"2024-05-12T10:49:54.621293+0000","last_active":"2024-05-12T10:54:27.841354+0000","last_peered":"2024-05-12T10:54:27.841354+0000","last_clean":"2024-05-12T10:54:27.841354+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:54:27.841354+0000","last_undegraded":"2024-05-12T10:54:27.841354+0000","last_fullsized":"2024-05-12T10:54:27.841354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:45:33.341215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'269","reported_seq":427,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.764286+0000","last_change":"2024-05-12T10:49:59.673656+0000","last_active":"2024-05-12T10:58:01.764286+0000","last_peered":"2024-05-12T10:58:01.764286+0000","last_clean":"2024-05-12T10:58:01.764286+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:58:01.764286+0000","last_undegraded":"2024-05-12T10:58:01.764286+0000","last_fullsized":"2024-05-12T10:58:01.764286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:38.364434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":548864,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.708463+0000","last_change":"2024-05-12T10:49:55.646526+0000","last_active":"2024-05-12T10:58:28.708463+0000","last_peered":"2024-05-12T10:58:28.708463+0000","last_clean":"2024-05-12T10:58:28.708463+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:58:28.708463+0000","last_undegraded":"2024-05-12T10:58:28.708463+0000","last_fullsized":"2024-05-12T10:58:28.708463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:56:52.102442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'16","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:57.914605+0000","last_change":"2024-05-12T10:49:54.617906+0000","last_active":"2024-05-12T10:56:57.914605+0000","last_peered":"2024-05-12T10:56:57.914605+0000","last_clean":"2024-05-12T10:56:57.914605+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:56:57.914605+0000","last_undegraded":"2024-05-12T10:56:57.914605+0000","last_fullsized":"2024-05-12T10:56:57.914605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:26:35.150963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'374","reported_seq":599,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.963489+0000","last_change":"2024-05-12T10:49:59.671791+0000","last_active":"2024-05-12T10:58:01.963489+0000","last_peered":"2024-05-12T10:58:01.963489+0000","last_clean":"2024-05-12T10:58:01.963489+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:58:01.963489+0000","last_undegraded":"2024-05-12T10:58:01.963489+0000","last_fullsized":"2024-05-12T10:58:01.963489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":819200,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.668620+0000","last_change":"2024-05-12T10:49:55.637810+0000","last_active":"2024-05-12T10:58:28.668620+0000","last_peered":"2024-05-12T10:58:28.668620+0000","last_clean":"2024-05-12T10:58:28.668620+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:58:28.668620+0000","last_undegraded":"2024-05-12T10:58:28.668620+0000","last_fullsized":"2024-05-12T10:58:28.668620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:13:52.001497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:57.872867+0000","last_change":"2024-05-12T10:49:54.637728+0000","last_active":"2024-05-12T10:56:57.872867+0000","last_peered":"2024-05-12T10:56:57.872867+0000","last_clean":"2024-05-12T10:56:57.872867+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:56:57.872867+0000","last_undegraded":"2024-05-12T10:56:57.872867+0000","last_fullsized":"2024-05-12T10:56:57.872867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:32:39.996419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'283","reported_seq":453,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.948262+0000","last_change":"2024-05-12T10:50:00.383444+0000","last_active":"2024-05-12T10:58:01.948262+0000","last_peered":"2024-05-12T10:58:01.948262+0000","last_clean":"2024-05-12T10:58:01.948262+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:58:01.948262+0000","last_undegraded":"2024-05-12T10:58:01.948262+0000","last_fullsized":"2024-05-12T10:58:01.948262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:55:04.226848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'15","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.708771+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:58:28.708771+0000","last_peered":"2024-05-12T10:58:28.708771+0000","last_clean":"2024-05-12T10:58:28.708771+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:58:28.708771+0000","last_undegraded":"2024-05-12T10:58:28.708771+0000","last_fullsized":"2024-05-12T10:58:28.708771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:15:58.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:37.836051+0000","last_change":"2024-05-12T10:49:54.656814+0000","last_active":"2024-05-12T10:54:37.836051+0000","last_peered":"2024-05-12T10:54:37.836051+0000","last_clean":"2024-05-12T10:54:37.836051+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:54:37.836051+0000","last_undegraded":"2024-05-12T10:54:37.836051+0000","last_fullsized":"2024-05-12T10:54:37.836051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:26.660043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'279","reported_seq":450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.861231+0000","last_change":"2024-05-12T10:50:00.390308+0000","last_active":"2024-05-12T10:58:01.861231+0000","last_peered":"2024-05-12T10:58:01.861231+0000","last_clean":"2024-05-12T10:58:01.861231+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:58:01.861231+0000","last_undegraded":"2024-05-12T10:58:01.861231+0000","last_fullsized":"2024-05-12T10:58:01.861231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:43.650956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'10","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.692566+0000","last_change":"2024-05-12T10:49:55.628907+0000","last_active":"2024-05-12T10:58:28.692566+0000","last_peered":"2024-05-12T10:58:28.692566+0000","last_clean":"2024-05-12T10:58:28.692566+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:58:28.692566+0000","last_undegraded":"2024-05-12T10:58:28.692566+0000","last_fullsized":"2024-05-12T10:58:28.692566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:56:57.842416+0000","last_change":"2024-05-12T10:49:54.626002+0000","last_active":"2024-05-12T10:56:57.842416+0000","last_peered":"2024-05-12T10:56:57.842416+0000","last_clean":"2024-05-12T10:56:57.842416+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:56:57.842416+0000","last_undegraded":"2024-05-12T10:56:57.842416+0000","last_fullsized":"2024-05-12T10:56:57.842416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'329","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.813514+0000","last_change":"2024-05-12T10:50:00.387192+0000","last_active":"2024-05-12T10:58:01.813514+0000","last_peered":"2024-05-12T10:58:01.813514+0000","last_clean":"2024-05-12T10:58:01.813514+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:58:01.813514+0000","last_undegraded":"2024-05-12T10:58:01.813514+0000","last_fullsized":"2024-05-12T10:58:01.813514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:15:23.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.689888+0000","last_change":"2024-05-12T10:49:55.634551+0000","last_active":"2024-05-12T10:58:28.689888+0000","last_peered":"2024-05-12T10:58:28.689888+0000","last_clean":"2024-05-12T10:58:28.689888+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:58:28.689888+0000","last_undegraded":"2024-05-12T10:58:28.689888+0000","last_fullsized":"2024-05-12T10:58:28.689888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:10:52.477145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'1910","reported_seq":1941,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.613753+0000","last_change":"2024-05-12T10:49:54.634748+0000","last_active":"2024-05-12T10:58:28.613753+0000","last_peered":"2024-05-12T10:58:28.613753+0000","last_clean":"2024-05-12T10:58:28.613753+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:58:28.613753+0000","last_undegraded":"2024-05-12T10:58:28.613753+0000","last_fullsized":"2024-05-12T10:58:28.613753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1910,"log_dups_size":0,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:39:16.646133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3831682,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1910,"num_write_kb":3947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'296","reported_seq":481,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.943878+0000","last_change":"2024-05-12T10:49:59.671405+0000","last_active":"2024-05-12T10:58:01.943878+0000","last_peered":"2024-05-12T10:58:01.943878+0000","last_clean":"2024-05-12T10:58:01.943878+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:58:01.943878+0000","last_undegraded":"2024-05-12T10:58:01.943878+0000","last_fullsized":"2024-05-12T10:58:01.943878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'11","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.706802+0000","last_change":"2024-05-12T10:49:55.634686+0000","last_active":"2024-05-12T10:58:28.706802+0000","last_peered":"2024-05-12T10:58:28.706802+0000","last_clean":"2024-05-12T10:58:28.706802+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:58:28.706802+0000","last_undegraded":"2024-05-12T10:58:28.706802+0000","last_fullsized":"2024-05-12T10:58:28.706802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:25:04.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'10","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:29.104432+0000","last_change":"2024-05-12T10:49:54.656012+0000","last_active":"2024-05-12T10:58:29.104432+0000","last_peered":"2024-05-12T10:58:29.104432+0000","last_clean":"2024-05-12T10:58:29.104432+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:58:29.104432+0000","last_undegraded":"2024-05-12T10:58:29.104432+0000","last_fullsized":"2024-05-12T10:58:29.104432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'304","reported_seq":503,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.906496+0000","last_change":"2024-05-12T10:49:59.672820+0000","last_active":"2024-05-12T10:58:01.906496+0000","last_peered":"2024-05-12T10:58:01.906496+0000","last_clean":"2024-05-12T10:58:01.906496+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:58:01.906496+0000","last_undegraded":"2024-05-12T10:58:01.906496+0000","last_fullsized":"2024-05-12T10:58:01.906496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:49:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":716800,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.684655+0000","last_change":"2024-05-12T10:49:55.620541+0000","last_active":"2024-05-12T10:58:28.684655+0000","last_peered":"2024-05-12T10:58:28.684655+0000","last_clean":"2024-05-12T10:58:28.684655+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:58:28.684655+0000","last_undegraded":"2024-05-12T10:58:28.684655+0000","last_fullsized":"2024-05-12T10:58:28.684655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.837479+0000","last_change":"2024-05-12T10:49:54.651289+0000","last_active":"2024-05-12T10:54:47.837479+0000","last_peered":"2024-05-12T10:54:47.837479+0000","last_clean":"2024-05-12T10:54:47.837479+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:54:47.837479+0000","last_undegraded":"2024-05-12T10:54:47.837479+0000","last_fullsized":"2024-05-12T10:54:47.837479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:33:24.087763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'307","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.889067+0000","last_change":"2024-05-12T10:50:36.855844+0000","last_active":"2024-05-12T10:58:01.889067+0000","last_peered":"2024-05-12T10:58:01.889067+0000","last_clean":"2024-05-12T10:58:01.889067+0000","last_became_active":"2024-05-12T10:50:36.855397+0000","last_became_peered":"2024-05-12T10:50:36.855397+0000","last_unstale":"2024-05-12T10:58:01.889067+0000","last_undegraded":"2024-05-12T10:58:01.889067+0000","last_fullsized":"2024-05-12T10:58:01.889067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:14:10.664926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'10","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.710801+0000","last_change":"2024-05-12T10:49:55.626645+0000","last_active":"2024-05-12T10:58:28.710801+0000","last_peered":"2024-05-12T10:58:28.710801+0000","last_clean":"2024-05-12T10:58:28.710801+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:58:28.710801+0000","last_undegraded":"2024-05-12T10:58:28.710801+0000","last_fullsized":"2024-05-12T10:58:28.710801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:41.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.850647+0000","last_change":"2024-05-12T10:49:54.654822+0000","last_active":"2024-05-12T10:54:47.850647+0000","last_peered":"2024-05-12T10:54:47.850647+0000","last_clean":"2024-05-12T10:54:47.850647+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:54:47.850647+0000","last_undegraded":"2024-05-12T10:54:47.850647+0000","last_fullsized":"2024-05-12T10:54:47.850647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:52:07.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'332","reported_seq":530,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.938963+0000","last_change":"2024-05-12T10:50:00.396453+0000","last_active":"2024-05-12T10:58:01.938963+0000","last_peered":"2024-05-12T10:58:01.938963+0000","last_clean":"2024-05-12T10:58:01.938963+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:58:01.938963+0000","last_undegraded":"2024-05-12T10:58:01.938963+0000","last_fullsized":"2024-05-12T10:58:01.938963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:40.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'283","reported_seq":466,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:02.850452+0000","last_change":"2024-05-12T10:50:00.390477+0000","last_active":"2024-05-12T10:58:02.850452+0000","last_peered":"2024-05-12T10:58:02.850452+0000","last_clean":"2024-05-12T10:58:02.850452+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:58:02.850452+0000","last_undegraded":"2024-05-12T10:58:02.850452+0000","last_fullsized":"2024-05-12T10:58:02.850452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":643072,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'11","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.665147+0000","last_change":"2024-05-12T10:49:55.619984+0000","last_active":"2024-05-12T10:58:28.665147+0000","last_peered":"2024-05-12T10:58:28.665147+0000","last_clean":"2024-05-12T10:58:28.665147+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:58:28.665147+0000","last_undegraded":"2024-05-12T10:58:28.665147+0000","last_fullsized":"2024-05-12T10:58:28.665147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.837419+0000","last_change":"2024-05-12T10:49:54.656580+0000","last_active":"2024-05-12T10:54:47.837419+0000","last_peered":"2024-05-12T10:54:47.837419+0000","last_clean":"2024-05-12T10:54:47.837419+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:54:47.837419+0000","last_undegraded":"2024-05-12T10:54:47.837419+0000","last_fullsized":"2024-05-12T10:54:47.837419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:43:32.603999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'272","reported_seq":449,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.950582+0000","last_change":"2024-05-12T10:49:59.681648+0000","last_active":"2024-05-12T10:58:01.950582+0000","last_peered":"2024-05-12T10:58:01.950582+0000","last_clean":"2024-05-12T10:58:01.950582+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:58:01.950582+0000","last_undegraded":"2024-05-12T10:58:01.950582+0000","last_fullsized":"2024-05-12T10:58:01.950582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:54.912836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.662717+0000","last_change":"2024-05-12T10:49:55.617393+0000","last_active":"2024-05-12T10:58:28.662717+0000","last_peered":"2024-05-12T10:58:28.662717+0000","last_clean":"2024-05-12T10:58:28.662717+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:58:28.662717+0000","last_undegraded":"2024-05-12T10:58:28.662717+0000","last_fullsized":"2024-05-12T10:58:28.662717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:07:51.584695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:47.814701+0000","last_change":"2024-05-12T10:49:54.637393+0000","last_active":"2024-05-12T10:54:47.814701+0000","last_peered":"2024-05-12T10:54:47.814701+0000","last_clean":"2024-05-12T10:54:47.814701+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:54:47.814701+0000","last_undegraded":"2024-05-12T10:54:47.814701+0000","last_fullsized":"2024-05-12T10:54:47.814701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:44:00.856935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.852132+0000","last_change":"2024-05-12T10:49:54.636945+0000","last_active":"2024-05-12T10:54:57.852132+0000","last_peered":"2024-05-12T10:54:57.852132+0000","last_clean":"2024-05-12T10:54:57.852132+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:54:57.852132+0000","last_undegraded":"2024-05-12T10:54:57.852132+0000","last_fullsized":"2024-05-12T10:54:57.852132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:34:25.927458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'8","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.680766+0000","last_change":"2024-05-12T10:49:55.627105+0000","last_active":"2024-05-12T10:58:28.680766+0000","last_peered":"2024-05-12T10:58:28.680766+0000","last_clean":"2024-05-12T10:58:28.680766+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:58:28.680766+0000","last_undegraded":"2024-05-12T10:58:28.680766+0000","last_fullsized":"2024-05-12T10:58:28.680766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'308","reported_seq":502,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.834536+0000","last_change":"2024-05-12T10:49:59.659142+0000","last_active":"2024-05-12T10:58:01.834536+0000","last_peered":"2024-05-12T10:58:01.834536+0000","last_clean":"2024-05-12T10:58:01.834536+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:58:01.834536+0000","last_undegraded":"2024-05-12T10:58:01.834536+0000","last_fullsized":"2024-05-12T10:58:01.834536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:40.443593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:54:57.815773+0000","last_change":"2024-05-12T10:49:54.632224+0000","last_active":"2024-05-12T10:54:57.815773+0000","last_peered":"2024-05-12T10:54:57.815773+0000","last_clean":"2024-05-12T10:54:57.815773+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:54:57.815773+0000","last_undegraded":"2024-05-12T10:54:57.815773+0000","last_fullsized":"2024-05-12T10:54:57.815773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:53.579392+0000","last_clean_scrub_stamp":"2024-05-12T10:49:53.579392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:27:39.637678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.685719+0000","last_change":"2024-05-12T10:49:55.633243+0000","last_active":"2024-05-12T10:58:28.685719+0000","last_peered":"2024-05-12T10:58:28.685719+0000","last_clean":"2024-05-12T10:58:28.685719+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:58:28.685719+0000","last_undegraded":"2024-05-12T10:58:28.685719+0000","last_fullsized":"2024-05-12T10:58:28.685719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:14.239020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'317","reported_seq":514,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:01.897764+0000","last_change":"2024-05-12T10:49:59.655807+0000","last_active":"2024-05-12T10:58:01.897764+0000","last_peered":"2024-05-12T10:58:01.897764+0000","last_clean":"2024-05-12T10:58:01.897764+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:58:01.897764+0000","last_undegraded":"2024-05-12T10:58:01.897764+0000","last_fullsized":"2024-05-12T10:58:01.897764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:58.620414+0000","last_clean_scrub_stamp":"2024-05-12T10:49:58.620414+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:12.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'9","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.677050+0000","last_change":"2024-05-12T10:49:55.637106+0000","last_active":"2024-05-12T10:58:28.677050+0000","last_peered":"2024-05-12T10:58:28.677050+0000","last_clean":"2024-05-12T10:58:28.677050+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:58:28.677050+0000","last_undegraded":"2024-05-12T10:58:28.677050+0000","last_fullsized":"2024-05-12T10:58:28.677050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:22:07.477677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'12","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.692396+0000","last_change":"2024-05-12T10:49:55.618952+0000","last_active":"2024-05-12T10:58:28.692396+0000","last_peered":"2024-05-12T10:58:28.692396+0000","last_clean":"2024-05-12T10:58:28.692396+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:58:28.692396+0000","last_undegraded":"2024-05-12T10:58:28.692396+0000","last_fullsized":"2024-05-12T10:58:28.692396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:38:10.693066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'8","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.704582+0000","last_change":"2024-05-12T10:49:55.623916+0000","last_active":"2024-05-12T10:58:28.704582+0000","last_peered":"2024-05-12T10:58:28.704582+0000","last_clean":"2024-05-12T10:58:28.704582+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:58:28.704582+0000","last_undegraded":"2024-05-12T10:58:28.704582+0000","last_fullsized":"2024-05-12T10:58:28.704582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:06:14.434631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'7","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.662235+0000","last_change":"2024-05-12T10:49:55.620278+0000","last_active":"2024-05-12T10:58:28.662235+0000","last_peered":"2024-05-12T10:58:28.662235+0000","last_clean":"2024-05-12T10:58:28.662235+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:58:28.662235+0000","last_undegraded":"2024-05-12T10:58:28.662235+0000","last_fullsized":"2024-05-12T10:58:28.662235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.678377+0000","last_change":"2024-05-12T10:49:55.626216+0000","last_active":"2024-05-12T10:58:28.678377+0000","last_peered":"2024-05-12T10:58:28.678377+0000","last_clean":"2024-05-12T10:58:28.678377+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:58:28.678377+0000","last_undegraded":"2024-05-12T10:58:28.678377+0000","last_fullsized":"2024-05-12T10:58:28.678377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:52:14.438331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.663147+0000","last_change":"2024-05-12T10:49:55.622085+0000","last_active":"2024-05-12T10:58:28.663147+0000","last_peered":"2024-05-12T10:58:28.663147+0000","last_clean":"2024-05-12T10:58:28.663147+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:58:28.663147+0000","last_undegraded":"2024-05-12T10:58:28.663147+0000","last_fullsized":"2024-05-12T10:58:28.663147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'15","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.691147+0000","last_change":"2024-05-12T10:50:36.856467+0000","last_active":"2024-05-12T10:58:28.691147+0000","last_peered":"2024-05-12T10:58:28.691147+0000","last_clean":"2024-05-12T10:58:28.691147+0000","last_became_active":"2024-05-12T10:50:36.855517+0000","last_became_peered":"2024-05-12T10:50:36.855517+0000","last_unstale":"2024-05-12T10:58:28.691147+0000","last_undegraded":"2024-05-12T10:58:28.691147+0000","last_fullsized":"2024-05-12T10:58:28.691147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:35.215695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.661098+0000","last_change":"2024-05-12T10:49:55.626353+0000","last_active":"2024-05-12T10:58:28.661098+0000","last_peered":"2024-05-12T10:58:28.661098+0000","last_clean":"2024-05-12T10:58:28.661098+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:58:28.661098+0000","last_undegraded":"2024-05-12T10:58:28.661098+0000","last_fullsized":"2024-05-12T10:58:28.661098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:58.905284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.704220+0000","last_change":"2024-05-12T10:49:55.621110+0000","last_active":"2024-05-12T10:58:28.704220+0000","last_peered":"2024-05-12T10:58:28.704220+0000","last_clean":"2024-05-12T10:58:28.704220+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:58:28.704220+0000","last_undegraded":"2024-05-12T10:58:28.704220+0000","last_fullsized":"2024-05-12T10:58:28.704220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:12:36.369923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.661565+0000","last_change":"2024-05-12T10:49:55.626913+0000","last_active":"2024-05-12T10:58:28.661565+0000","last_peered":"2024-05-12T10:58:28.661565+0000","last_clean":"2024-05-12T10:58:28.661565+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:58:28.661565+0000","last_undegraded":"2024-05-12T10:58:28.661565+0000","last_fullsized":"2024-05-12T10:58:28.661565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:27:08.492294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'10","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.710604+0000","last_change":"2024-05-12T10:49:55.629992+0000","last_active":"2024-05-12T10:58:28.710604+0000","last_peered":"2024-05-12T10:58:28.710604+0000","last_clean":"2024-05-12T10:58:28.710604+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:58:28.710604+0000","last_undegraded":"2024-05-12T10:58:28.710604+0000","last_fullsized":"2024-05-12T10:58:28.710604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:31.454363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.692686+0000","last_change":"2024-05-12T10:49:55.620821+0000","last_active":"2024-05-12T10:58:28.692686+0000","last_peered":"2024-05-12T10:58:28.692686+0000","last_clean":"2024-05-12T10:58:28.692686+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:58:28.692686+0000","last_undegraded":"2024-05-12T10:58:28.692686+0000","last_fullsized":"2024-05-12T10:58:28.692686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.687932+0000","last_change":"2024-05-12T10:49:55.646368+0000","last_active":"2024-05-12T10:58:28.687932+0000","last_peered":"2024-05-12T10:58:28.687932+0000","last_clean":"2024-05-12T10:58:28.687932+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:58:28.687932+0000","last_undegraded":"2024-05-12T10:58:28.687932+0000","last_fullsized":"2024-05-12T10:58:28.687932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:21:04.313921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.698219+0000","last_change":"2024-05-12T10:49:55.633122+0000","last_active":"2024-05-12T10:58:28.698219+0000","last_peered":"2024-05-12T10:58:28.698219+0000","last_clean":"2024-05-12T10:58:28.698219+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:58:28.698219+0000","last_undegraded":"2024-05-12T10:58:28.698219+0000","last_fullsized":"2024-05-12T10:58:28.698219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:25:19.563648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'10","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.679054+0000","last_change":"2024-05-12T10:49:55.635394+0000","last_active":"2024-05-12T10:58:28.679054+0000","last_peered":"2024-05-12T10:58:28.679054+0000","last_clean":"2024-05-12T10:58:28.679054+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:58:28.679054+0000","last_undegraded":"2024-05-12T10:58:28.679054+0000","last_fullsized":"2024-05-12T10:58:28.679054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:41:58.478292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.710879+0000","last_change":"2024-05-12T10:49:55.626485+0000","last_active":"2024-05-12T10:58:28.710879+0000","last_peered":"2024-05-12T10:58:28.710879+0000","last_clean":"2024-05-12T10:58:28.710879+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:58:28.710879+0000","last_undegraded":"2024-05-12T10:58:28.710879+0000","last_fullsized":"2024-05-12T10:58:28.710879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:17.942339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'9","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.703665+0000","last_change":"2024-05-12T10:49:55.618820+0000","last_active":"2024-05-12T10:58:28.703665+0000","last_peered":"2024-05-12T10:58:28.703665+0000","last_clean":"2024-05-12T10:58:28.703665+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:58:28.703665+0000","last_undegraded":"2024-05-12T10:58:28.703665+0000","last_fullsized":"2024-05-12T10:58:28.703665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:23:00.474438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'7","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.670616+0000","last_change":"2024-05-12T10:49:55.626429+0000","last_active":"2024-05-12T10:58:28.670616+0000","last_peered":"2024-05-12T10:58:28.670616+0000","last_clean":"2024-05-12T10:58:28.670616+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:58:28.670616+0000","last_undegraded":"2024-05-12T10:58:28.670616+0000","last_fullsized":"2024-05-12T10:58:28.670616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'8","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.666867+0000","last_change":"2024-05-12T10:49:55.612139+0000","last_active":"2024-05-12T10:58:28.666867+0000","last_peered":"2024-05-12T10:58:28.666867+0000","last_clean":"2024-05-12T10:58:28.666867+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:58:28.666867+0000","last_undegraded":"2024-05-12T10:58:28.666867+0000","last_fullsized":"2024-05-12T10:58:28.666867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.668368+0000","last_change":"2024-05-12T10:49:55.631137+0000","last_active":"2024-05-12T10:58:28.668368+0000","last_peered":"2024-05-12T10:58:28.668368+0000","last_clean":"2024-05-12T10:58:28.668368+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:58:28.668368+0000","last_undegraded":"2024-05-12T10:58:28.668368+0000","last_fullsized":"2024-05-12T10:58:28.668368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:04.390314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.691665+0000","last_change":"2024-05-12T10:49:55.643416+0000","last_active":"2024-05-12T10:58:28.691665+0000","last_peered":"2024-05-12T10:58:28.691665+0000","last_clean":"2024-05-12T10:58:28.691665+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:58:28.691665+0000","last_undegraded":"2024-05-12T10:58:28.691665+0000","last_fullsized":"2024-05-12T10:58:28.691665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:58.632966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.699524+0000","last_change":"2024-05-12T10:49:55.635847+0000","last_active":"2024-05-12T10:58:28.699524+0000","last_peered":"2024-05-12T10:58:28.699524+0000","last_clean":"2024-05-12T10:58:28.699524+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:58:28.699524+0000","last_undegraded":"2024-05-12T10:58:28.699524+0000","last_fullsized":"2024-05-12T10:58:28.699524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:57:51.222099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.706585+0000","last_change":"2024-05-12T10:49:55.641921+0000","last_active":"2024-05-12T10:58:28.706585+0000","last_peered":"2024-05-12T10:58:28.706585+0000","last_clean":"2024-05-12T10:58:28.706585+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:58:28.706585+0000","last_undegraded":"2024-05-12T10:58:28.706585+0000","last_fullsized":"2024-05-12T10:58:28.706585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:44:57.787358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'11","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.711850+0000","last_change":"2024-05-12T10:49:55.635853+0000","last_active":"2024-05-12T10:58:28.711850+0000","last_peered":"2024-05-12T10:58:28.711850+0000","last_clean":"2024-05-12T10:58:28.711850+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:58:28.711850+0000","last_undegraded":"2024-05-12T10:58:28.711850+0000","last_fullsized":"2024-05-12T10:58:28.711850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:04:39.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'9","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.664481+0000","last_change":"2024-05-12T10:50:36.914559+0000","last_active":"2024-05-12T10:58:28.664481+0000","last_peered":"2024-05-12T10:58:28.664481+0000","last_clean":"2024-05-12T10:58:28.664481+0000","last_became_active":"2024-05-12T10:50:36.914327+0000","last_became_peered":"2024-05-12T10:50:36.914327+0000","last_unstale":"2024-05-12T10:58:28.664481+0000","last_undegraded":"2024-05-12T10:58:28.664481+0000","last_fullsized":"2024-05-12T10:58:28.664481+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:47:16.693858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.698786+0000","last_change":"2024-05-12T10:49:55.629001+0000","last_active":"2024-05-12T10:58:28.698786+0000","last_peered":"2024-05-12T10:58:28.698786+0000","last_clean":"2024-05-12T10:58:28.698786+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:58:28.698786+0000","last_undegraded":"2024-05-12T10:58:28.698786+0000","last_fullsized":"2024-05-12T10:58:28.698786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:42:39.042271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.706398+0000","last_change":"2024-05-12T10:49:55.625540+0000","last_active":"2024-05-12T10:58:28.706398+0000","last_peered":"2024-05-12T10:58:28.706398+0000","last_clean":"2024-05-12T10:58:28.706398+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:58:28.706398+0000","last_undegraded":"2024-05-12T10:58:28.706398+0000","last_fullsized":"2024-05-12T10:58:28.706398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:40:35.621918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.697922+0000","last_change":"2024-05-12T10:49:55.633576+0000","last_active":"2024-05-12T10:58:28.697922+0000","last_peered":"2024-05-12T10:58:28.697922+0000","last_clean":"2024-05-12T10:58:28.697922+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:58:28.697922+0000","last_undegraded":"2024-05-12T10:58:28.697922+0000","last_fullsized":"2024-05-12T10:58:28.697922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:06:16.255147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'8","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.704174+0000","last_change":"2024-05-12T10:49:55.624205+0000","last_active":"2024-05-12T10:58:28.704174+0000","last_peered":"2024-05-12T10:58:28.704174+0000","last_clean":"2024-05-12T10:58:28.704174+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:58:28.704174+0000","last_undegraded":"2024-05-12T10:58:28.704174+0000","last_fullsized":"2024-05-12T10:58:28.704174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:21.895269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'7","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.666208+0000","last_change":"2024-05-12T10:49:55.610461+0000","last_active":"2024-05-12T10:58:28.666208+0000","last_peered":"2024-05-12T10:58:28.666208+0000","last_clean":"2024-05-12T10:58:28.666208+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:58:28.666208+0000","last_undegraded":"2024-05-12T10:58:28.666208+0000","last_fullsized":"2024-05-12T10:58:28.666208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.669347+0000","last_change":"2024-05-12T10:49:55.608434+0000","last_active":"2024-05-12T10:58:28.669347+0000","last_peered":"2024-05-12T10:58:28.669347+0000","last_clean":"2024-05-12T10:58:28.669347+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:58:28.669347+0000","last_undegraded":"2024-05-12T10:58:28.669347+0000","last_fullsized":"2024-05-12T10:58:28.669347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'8","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.709651+0000","last_change":"2024-05-12T10:49:55.639296+0000","last_active":"2024-05-12T10:58:28.709651+0000","last_peered":"2024-05-12T10:58:28.709651+0000","last_clean":"2024-05-12T10:58:28.709651+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:58:28.709651+0000","last_undegraded":"2024-05-12T10:58:28.709651+0000","last_fullsized":"2024-05-12T10:58:28.709651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:47:15.862328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9475,"ondisk_log_size":9475,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3836220,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2107,"num_write_kb":4016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7831552,"data_stored":7672440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2064,"ondisk_log_size":2064,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542252,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58436,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313404,"statfs":{"total":96636764160,"available":96576925696,"internally_reserved":0,"allocated":913408,"data_stored":716485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542253,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79580,"kb_used_data":4052,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94292260,"statfs":{"total":96636764160,"available":96555274240,"internally_reserved":0,"allocated":4149248,"data_stored":3957560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542253,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53696,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318144,"statfs":{"total":96636764160,"available":96581779456,"internally_reserved":0,"allocated":319488,"data_stored":126179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542255,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45372,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326468,"statfs":{"total":96636764160,"available":96590303232,"internally_reserved":0,"allocated":315392,"data_stored":125914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542253,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97636,"kb_used_data":4060,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94274204,"statfs":{"total":96636764160,"available":96536784896,"internally_reserved":0,"allocated":4157440,"data_stored":3957724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542252,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57860,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313980,"statfs":{"total":96636764160,"available":96577515520,"internally_reserved":0,"allocated":323584,"data_stored":126148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542253,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67524,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94304316,"statfs":{"total":96636764160,"available":96567619584,"internally_reserved":0,"allocated":323584,"data_stored":125745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542253,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58432,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313408,"statfs":{"total":96636764160,"available":96576929792,"internally_reserved":0,"allocated":909312,"data_stored":715829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3858432,"data_stored":3832923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3850240,"data_stored":3832759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:58:36.032 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.032 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.032 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.032 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.032 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.032 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.032 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.033 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.033 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.033 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.033 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.033 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.033 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.033 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.033 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.033 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.033 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.034 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.034 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.034 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.034 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.034 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.034 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.034 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.034 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.034 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.035 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.035 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.035 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.035 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.035 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.035 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.035 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.035 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.035 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.035 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.036 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.036 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.036 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.036 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.036 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.036 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.036 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.036 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.036 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.036 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.037 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-12T10:49:43.953472+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=43, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.037 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.037 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.037 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.037 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.037 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.037 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.037 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.037 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.038 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.038 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.038 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.038 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.038 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.038 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.038 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.038 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.038 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.038 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.039 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.039 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.039 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.039 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.039 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.039 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.039 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.039 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.039 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.040 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.040 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.040 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.040 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.040 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.040 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.040 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.040 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.040 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.040 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.041 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.041 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.041 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.041 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.041 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.041 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.041 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.041 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.041 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.042 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-12T10:49:53.579392+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=53, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.042 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.042 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-12T10:49:58.620414+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.042 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.042 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.042 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.042 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.043 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.043 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.043 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.043 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.043 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.043 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.043 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.043 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.043 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.043 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.044 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.044 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.044 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.044 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.044 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.044 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.044 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.045 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.045 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.045 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.045 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.045 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.045 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.045 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.045 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.045 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.045 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.046 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:36.046 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-12T10:58:51.700 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:58:51.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:58:56.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:58:56.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.202+0000 7fe2e9200640 1 Processor -- start 2024-05-12T10:58:56.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.202+0000 7fe2e9200640 1 -- start start 2024-05-12T10:58:56.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e9200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e40c5dc0 0x7fe2e40723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:56.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e9200640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2e415b6e0 0x7fe2e415bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:56.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e9200640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e40c8830 con 0x7fe2e4152350 2024-05-12T10:58:56.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e9200640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e40c9fe0 con 0x7fe2e415b6e0 2024-05-12T10:58:56.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e9200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e40c8af0 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e2800640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2e415b6e0 0x7fe2e415bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:56.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e1e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe2e4152350 0x7fe2e40ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53802/0 (socket says 172.21.15.115:53802) 2024-05-12T10:58:56.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e1e00640 1 -- 172.21.15.115:0/1899613415 learned_addr learned my addr 172.21.15.115:0/1899613415 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:58:56.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e1400640 1 --2- 172.21.15.115:0/1899613415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e40c5dc0 0x7fe2e40723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:56.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e2800640 1 -- 172.21.15.115:0/1899613415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e40c5dc0 msgr2=0x7fe2e40723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:58:56.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e2800640 1 --2- 172.21.15.115:0/1899613415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e40c5dc0 0x7fe2e40723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e2800640 1 -- 172.21.15.115:0/1899613415 >> v1:172.21.15.115:6789/0 conn(0x7fe2e4152350 legacy=0x7fe2e40ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:56.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e2800640 1 -- 172.21.15.115:0/1899613415 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e40c8dd0 con 0x7fe2e415b6e0 2024-05-12T10:58:56.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e0a00640 1 -- 172.21.15.115:0/1899613415 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076301079 0 0) 0x7fe2e40c8830 con 0x7fe2e4152350 2024-05-12T10:58:56.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.206+0000 7fe2e1400640 1 --2- 172.21.15.115:0/1899613415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e40c5dc0 0x7fe2e40723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:56.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e2800640 1 --2- 172.21.15.115:0/1899613415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2e415b6e0 0x7fe2e415bb00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009d90 tx=0x7fe2dc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422d9d6d78bfd4a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:56.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e0a00640 1 -- 172.21.15.115:0/1899613415 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0a66b0 con 0x7fe2e415b6e0 2024-05-12T10:58:56.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e0a00640 1 -- 172.21.15.115:0/1899613415 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2dc0a6850 con 0x7fe2e415b6e0 2024-05-12T10:58:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e0a00640 1 -- 172.21.15.115:0/1899613415 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0a6c20 con 0x7fe2e415b6e0 2024-05-12T10:58:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e9200640 1 -- 172.21.15.115:0/1899613415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2e415b6e0 msgr2=0x7fe2e415bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e9200640 1 --2- 172.21.15.115:0/1899613415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2e415b6e0 0x7fe2e415bb00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009d90 tx=0x7fe2dc01c970 comp rx=0 tx=0).stop 2024-05-12T10:58:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e9200640 1 -- 172.21.15.115:0/1899613415 shutdown_connections 2024-05-12T10:58:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e9200640 1 --2- 172.21.15.115:0/1899613415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2e415b6e0 0x7fe2e415bb00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e9200640 1 --2- 172.21.15.115:0/1899613415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e40c5dc0 0x7fe2e40723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e9200640 1 -- 172.21.15.115:0/1899613415 >> 172.21.15.115:0/1899613415 conn(0x7fe2e40681c0 msgr2=0x7fe2e40685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e9200640 1 -- 172.21.15.115:0/1899613415 shutdown_connections 2024-05-12T10:58:56.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e9200640 1 -- 172.21.15.115:0/1899613415 wait complete. 2024-05-12T10:58:56.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e9200640 1 Processor -- start 2024-05-12T10:58:56.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.210+0000 7fe2e9200640 1 -- start start 2024-05-12T10:58:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e9200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2e40c5dc0 0x7fe2e4159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e9200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e4152350 0x7fe2e414fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e9200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2e415b6e0 0x7fe2e41501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e9200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e4152730 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e9200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e415c450 con 0x7fe2e415b6e0 2024-05-12T10:58:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e9200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e4166da0 con 0x7fe2e4152350 2024-05-12T10:58:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e1e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2e40c5dc0 0x7fe2e4159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e1e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2e40c5dc0 0x7fe2e4159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39368/0 (socket says 172.21.15.115:39368) 2024-05-12T10:58:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e1e00640 1 -- 172.21.15.115:0/2095668567 learned_addr learned my addr 172.21.15.115:0/2095668567 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:58:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e1400640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e4152350 0x7fe2e414fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:56.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e2800640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2e415b6e0 0x7fe2e41501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:56.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e1e00640 1 -- 172.21.15.115:0/2095668567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e4152350 msgr2=0x7fe2e414fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:56.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e1e00640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e4152350 0x7fe2e414fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e1e00640 1 -- 172.21.15.115:0/2095668567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2e415b6e0 msgr2=0x7fe2e41501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:56.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e1e00640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2e415b6e0 0x7fe2e41501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e1e00640 1 -- 172.21.15.115:0/2095668567 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e4166720 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e1400640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e4152350 0x7fe2e414fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:58:56.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e1e00640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2e40c5dc0 0x7fe2e4159510 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400c430 tx=0x7fe2d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:56.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2da000640 1 -- 172.21.15.115:0/2095668567 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40074e0 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2da000640 1 -- 172.21.15.115:0/2095668567 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d40047f0 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2da000640 1 -- 172.21.15.115:0/2095668567 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4004be0 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e9200640 1 -- 172.21.15.115:0/2095668567 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e4166a00 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e9200640 1 -- 172.21.15.115:0/2095668567 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e414f460 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2e9200640 1 -- 172.21.15.115:0/2095668567 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e4069730 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.214+0000 7fe2da000640 1 -- 172.21.15.115:0/2095668567 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe2d4011070 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.218+0000 7fe2da000640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe2c406f400 0x7fe2c40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:56.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.218+0000 7fe2da000640 1 -- 172.21.15.115:0/2095668567 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe2d408f3a0 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.218+0000 7fe2e1400640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe2c406f400 0x7fe2c40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:56.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.218+0000 7fe2e1400640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe2c406f400 0x7fe2c40718c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40c8870 tx=0x7fe2d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:56.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.222+0000 7fe2da000640 1 -- 172.21.15.115:0/2095668567 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe2d405bdf0 con 0x7fe2e40c5dc0 2024-05-12T10:58:56.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.374+0000 7fe2e9200640 1 -- 172.21.15.115:0/2095668567 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2e414f7b0 con 0x7fe2c406f400 2024-05-12T10:58:56.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.382+0000 7fe2da000640 1 -- 172.21.15.115:0/2095668567 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333886 (secure 0 0 0) 0x7fe2e414f7b0 con 0x7fe2c406f400 2024-05-12T10:58:56.377 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:58:56.379 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:58:56.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 -- 172.21.15.115:0/2095668567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe2c406f400 msgr2=0x7fe2c40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:56.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe2c406f400 0x7fe2c40718c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40c8870 tx=0x7fe2d0008040 comp rx=0 tx=0).stop 2024-05-12T10:58:56.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 -- 172.21.15.115:0/2095668567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2e40c5dc0 msgr2=0x7fe2e4159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:56.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2e40c5dc0 0x7fe2e4159510 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400c430 tx=0x7fe2d400c8f0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 -- 172.21.15.115:0/2095668567 shutdown_connections 2024-05-12T10:58:56.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe2c406f400 0x7fe2c40718c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2e415b6e0 0x7fe2e41501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2e4152350 0x7fe2e414fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 --2- 172.21.15.115:0/2095668567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2e40c5dc0 0x7fe2e4159510 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 -- 172.21.15.115:0/2095668567 >> 172.21.15.115:0/2095668567 conn(0x7fe2e40681c0 msgr2=0x7fe2e40c71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:56.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 -- 172.21.15.115:0/2095668567 shutdown_connections 2024-05-12T10:58:56.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:58:56.386+0000 7fe2e9200640 1 -- 172.21.15.115:0/2095668567 wait complete. 2024-05-12T10:58:56.397 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-05-12T10:58:55.932891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4427726,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":5199,"num_read_kb":21004348,"num_write":11426,"num_write_kb":25171470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12171,"ondisk_log_size":12171,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":522696,"kb_used_data":11144,"kb_used_omap":12,"kb_used_meta":511475,"kb_avail":754452024,"statfs":{"total":773094113280,"available":772558872576,"internally_reserved":0,"allocated":11411456,"data_stored":9853860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":523750961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003329"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.142617+0000","last_change":"2024-05-12T10:58:34.142674+0000","last_active":"2024-05-12T10:58:34.142617+0000","last_peered":"2024-05-12T10:58:34.142617+0000","last_clean":"2024-05-12T10:58:34.142617+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:58:34.142617+0000","last_undegraded":"2024-05-12T10:58:34.142617+0000","last_fullsized":"2024-05-12T10:58:34.142617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-05-12T10:58:34.142542+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-05-12T10:58:34.142542+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.142542+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:03:55.474574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.548194+0000","last_change":"2024-05-12T10:58:36.548219+0000","last_active":"2024-05-12T10:58:36.548194+0000","last_peered":"2024-05-12T10:58:36.548194+0000","last_clean":"2024-05-12T10:58:36.548194+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:58:36.548194+0000","last_undegraded":"2024-05-12T10:58:36.548194+0000","last_fullsized":"2024-05-12T10:58:36.548194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:36.548129+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:36.548129+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.548129+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:51:17.817269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'315","reported_seq":524,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:50.400211+0000","last_change":"2024-05-12T10:58:50.400254+0000","last_active":"2024-05-12T10:58:50.400211+0000","last_peered":"2024-05-12T10:58:50.400211+0000","last_clean":"2024-05-12T10:58:50.400211+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:58:50.400211+0000","last_undegraded":"2024-05-12T10:58:50.400211+0000","last_fullsized":"2024-05-12T10:58:50.400211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'315","last_scrub_stamp":"2024-05-12T10:58:50.400108+0000","last_deep_scrub":"28'315","last_deep_scrub_stamp":"2024-05-12T10:58:50.400108+0000","last_clean_scrub_stamp":"2024-05-12T10:58:50.400108+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:55:56.118682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.545153+0000","last_change":"2024-05-12T10:58:38.545205+0000","last_active":"2024-05-12T10:58:38.545153+0000","last_peered":"2024-05-12T10:58:38.545153+0000","last_clean":"2024-05-12T10:58:38.545153+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:58:38.545153+0000","last_undegraded":"2024-05-12T10:58:38.545153+0000","last_fullsized":"2024-05-12T10:58:38.545153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-12T10:58:38.545052+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-12T10:58:38.545052+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.545052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:44:07.311593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:32.126290+0000","last_change":"2024-05-12T10:58:32.126311+0000","last_active":"2024-05-12T10:58:32.126290+0000","last_peered":"2024-05-12T10:58:32.126290+0000","last_clean":"2024-05-12T10:58:32.126290+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:58:32.126290+0000","last_undegraded":"2024-05-12T10:58:32.126290+0000","last_fullsized":"2024-05-12T10:58:32.126290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:32.126224+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:32.126224+0000","last_clean_scrub_stamp":"2024-05-12T10:58:32.126224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:40:36.607439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'342","reported_seq":571,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.248389+0000","last_change":"2024-05-12T10:58:44.248509+0000","last_active":"2024-05-12T10:58:44.248389+0000","last_peered":"2024-05-12T10:58:44.248389+0000","last_clean":"2024-05-12T10:58:44.248389+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:58:44.248389+0000","last_undegraded":"2024-05-12T10:58:44.248389+0000","last_fullsized":"2024-05-12T10:58:44.248389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'342","last_scrub_stamp":"2024-05-12T10:58:44.248086+0000","last_deep_scrub":"28'342","last_deep_scrub_stamp":"2024-05-12T10:58:44.248086+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.248086+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:06:06.817825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'7","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.505529+0000","last_change":"2024-05-12T10:58:43.505603+0000","last_active":"2024-05-12T10:58:43.505529+0000","last_peered":"2024-05-12T10:58:43.505529+0000","last_clean":"2024-05-12T10:58:43.505529+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:58:43.505529+0000","last_undegraded":"2024-05-12T10:58:43.505529+0000","last_fullsized":"2024-05-12T10:58:43.505529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:43.505361+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:43.505361+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.505361+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:51.923759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:49.799452+0000","last_change":"2024-05-12T10:58:49.799574+0000","last_active":"2024-05-12T10:58:49.799452+0000","last_peered":"2024-05-12T10:58:49.799452+0000","last_clean":"2024-05-12T10:58:49.799452+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:58:49.799452+0000","last_undegraded":"2024-05-12T10:58:49.799452+0000","last_fullsized":"2024-05-12T10:58:49.799452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:49.799244+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:49.799244+0000","last_clean_scrub_stamp":"2024-05-12T10:58:49.799244+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:30:48.230026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'284","reported_seq":466,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.278209+0000","last_change":"2024-05-12T10:58:45.278347+0000","last_active":"2024-05-12T10:58:45.278209+0000","last_peered":"2024-05-12T10:58:45.278209+0000","last_clean":"2024-05-12T10:58:45.278209+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:58:45.278209+0000","last_undegraded":"2024-05-12T10:58:45.278209+0000","last_fullsized":"2024-05-12T10:58:45.278209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'284","last_scrub_stamp":"2024-05-12T10:58:45.277951+0000","last_deep_scrub":"28'284","last_deep_scrub_stamp":"2024-05-12T10:58:45.277951+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.277951+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:46:35.371891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":274,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.456868+0000","last_change":"2024-05-12T10:58:44.456937+0000","last_active":"2024-05-12T10:58:44.456868+0000","last_peered":"2024-05-12T10:58:44.456868+0000","last_clean":"2024-05-12T10:58:44.456868+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:58:44.456868+0000","last_undegraded":"2024-05-12T10:58:44.456868+0000","last_fullsized":"2024-05-12T10:58:44.456868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-12T10:58:44.456703+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-12T10:58:44.456703+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.456703+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:15.271302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.842844+0000","last_change":"2024-05-12T10:58:48.842901+0000","last_active":"2024-05-12T10:58:48.842844+0000","last_peered":"2024-05-12T10:58:48.842844+0000","last_clean":"2024-05-12T10:58:48.842844+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:58:48.842844+0000","last_undegraded":"2024-05-12T10:58:48.842844+0000","last_fullsized":"2024-05-12T10:58:48.842844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-05-12T10:58:48.842674+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-05-12T10:58:48.842674+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.842674+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:25:01.678597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'263","reported_seq":438,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.333612+0000","last_change":"2024-05-12T10:58:41.333677+0000","last_active":"2024-05-12T10:58:41.333612+0000","last_peered":"2024-05-12T10:58:41.333612+0000","last_clean":"2024-05-12T10:58:41.333612+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:58:41.333612+0000","last_undegraded":"2024-05-12T10:58:41.333612+0000","last_fullsized":"2024-05-12T10:58:41.333612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'263","last_scrub_stamp":"2024-05-12T10:58:41.333405+0000","last_deep_scrub":"28'263","last_deep_scrub_stamp":"2024-05-12T10:58:41.333405+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.333405+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:11:26.711105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.654598+0000","last_change":"2024-05-12T10:58:44.654656+0000","last_active":"2024-05-12T10:58:44.654598+0000","last_peered":"2024-05-12T10:58:44.654598+0000","last_clean":"2024-05-12T10:58:44.654598+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:58:44.654598+0000","last_undegraded":"2024-05-12T10:58:44.654598+0000","last_fullsized":"2024-05-12T10:58:44.654598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:44.654426+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:44.654426+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.654426+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:18.572152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'7","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.549368+0000","last_change":"2024-05-12T10:58:42.549501+0000","last_active":"2024-05-12T10:58:42.549368+0000","last_peered":"2024-05-12T10:58:42.549368+0000","last_clean":"2024-05-12T10:58:42.549368+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:58:42.549368+0000","last_undegraded":"2024-05-12T10:58:42.549368+0000","last_fullsized":"2024-05-12T10:58:42.549368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:42.549142+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:42.549142+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.549142+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:52:59.864963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'316","reported_seq":529,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.292654+0000","last_change":"2024-05-12T10:58:40.292719+0000","last_active":"2024-05-12T10:58:40.292654+0000","last_peered":"2024-05-12T10:58:40.292654+0000","last_clean":"2024-05-12T10:58:40.292654+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:58:40.292654+0000","last_undegraded":"2024-05-12T10:58:40.292654+0000","last_fullsized":"2024-05-12T10:58:40.292654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'316","last_scrub_stamp":"2024-05-12T10:58:40.292455+0000","last_deep_scrub":"28'316","last_deep_scrub_stamp":"2024-05-12T10:58:40.292455+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.292455+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:46:07.860190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":737280,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.466579+0000","last_change":"2024-05-12T10:58:43.466632+0000","last_active":"2024-05-12T10:58:43.466579+0000","last_peered":"2024-05-12T10:58:43.466579+0000","last_clean":"2024-05-12T10:58:43.466579+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:58:43.466579+0000","last_undegraded":"2024-05-12T10:58:43.466579+0000","last_fullsized":"2024-05-12T10:58:43.466579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:43.466436+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:43.466436+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.466436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:48:58.129158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:32.921958+0000","last_change":"2024-05-12T10:58:32.921958+0000","last_active":"2024-05-12T10:58:32.921958+0000","last_peered":"2024-05-12T10:58:32.921958+0000","last_clean":"2024-05-12T10:58:32.921958+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:58:32.921958+0000","last_undegraded":"2024-05-12T10:58:32.921958+0000","last_fullsized":"2024-05-12T10:58:32.921958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-05-12T10:58:32.921870+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-05-12T10:58:32.921870+0000","last_clean_scrub_stamp":"2024-05-12T10:58:32.921870+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:21:50.725784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'296","reported_seq":497,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.253179+0000","last_change":"2024-05-12T10:58:46.253244+0000","last_active":"2024-05-12T10:58:46.253179+0000","last_peered":"2024-05-12T10:58:46.253179+0000","last_clean":"2024-05-12T10:58:46.253179+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:58:46.253179+0000","last_undegraded":"2024-05-12T10:58:46.253179+0000","last_fullsized":"2024-05-12T10:58:46.253179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'296","last_scrub_stamp":"2024-05-12T10:58:46.252997+0000","last_deep_scrub":"28'296","last_deep_scrub_stamp":"2024-05-12T10:58:46.252997+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.252997+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:44:47.912927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'9","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.486498+0000","last_change":"2024-05-12T10:58:41.486526+0000","last_active":"2024-05-12T10:58:41.486498+0000","last_peered":"2024-05-12T10:58:41.486498+0000","last_clean":"2024-05-12T10:58:41.486498+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:58:41.486498+0000","last_undegraded":"2024-05-12T10:58:41.486498+0000","last_fullsized":"2024-05-12T10:58:41.486498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:41.486406+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:41.486406+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.486406+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:58:35.853670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'5","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.969020+0000","last_change":"2024-05-12T10:58:36.969020+0000","last_active":"2024-05-12T10:58:36.969020+0000","last_peered":"2024-05-12T10:58:36.969020+0000","last_clean":"2024-05-12T10:58:36.969020+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:58:36.969020+0000","last_undegraded":"2024-05-12T10:58:36.969020+0000","last_fullsized":"2024-05-12T10:58:36.969020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:36.968893+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:36.968893+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.968893+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:15:29.343502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'273","reported_seq":455,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.543889+0000","last_change":"2024-05-12T10:58:42.543914+0000","last_active":"2024-05-12T10:58:42.543889+0000","last_peered":"2024-05-12T10:58:42.543889+0000","last_clean":"2024-05-12T10:58:42.543889+0000","last_became_active":"2024-05-12T10:50:36.856826+0000","last_became_peered":"2024-05-12T10:50:36.856826+0000","last_unstale":"2024-05-12T10:58:42.543889+0000","last_undegraded":"2024-05-12T10:58:42.543889+0000","last_fullsized":"2024-05-12T10:58:42.543889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'273","last_scrub_stamp":"2024-05-12T10:58:42.543808+0000","last_deep_scrub":"28'273","last_deep_scrub_stamp":"2024-05-12T10:58:42.543808+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.543808+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:22:27.483480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"28'2","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.186977+0000","last_change":"2024-05-12T10:58:35.186977+0000","last_active":"2024-05-12T10:58:35.186977+0000","last_peered":"2024-05-12T10:58:35.186977+0000","last_clean":"2024-05-12T10:58:35.186977+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:58:35.186977+0000","last_undegraded":"2024-05-12T10:58:35.186977+0000","last_fullsized":"2024-05-12T10:58:35.186977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-05-12T10:58:35.186730+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-05-12T10:58:35.186730+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.186730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:25:07.265029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.505098+0000","last_change":"2024-05-12T10:58:39.505161+0000","last_active":"2024-05-12T10:58:39.505098+0000","last_peered":"2024-05-12T10:58:39.505098+0000","last_clean":"2024-05-12T10:58:39.505098+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:58:39.505098+0000","last_undegraded":"2024-05-12T10:58:39.505098+0000","last_fullsized":"2024-05-12T10:58:39.505098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-12T10:58:39.504923+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-12T10:58:39.504923+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.504923+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:49:06.339145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'296","reported_seq":507,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.279567+0000","last_change":"2024-05-12T10:58:48.279651+0000","last_active":"2024-05-12T10:58:48.279567+0000","last_peered":"2024-05-12T10:58:48.279567+0000","last_clean":"2024-05-12T10:58:48.279567+0000","last_became_active":"2024-05-12T10:50:36.857477+0000","last_became_peered":"2024-05-12T10:50:36.857477+0000","last_unstale":"2024-05-12T10:58:48.279567+0000","last_undegraded":"2024-05-12T10:58:48.279567+0000","last_fullsized":"2024-05-12T10:58:48.279567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'296","last_scrub_stamp":"2024-05-12T10:58:48.279374+0000","last_deep_scrub":"28'296","last_deep_scrub_stamp":"2024-05-12T10:58:48.279374+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.279374+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:31:10.570737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":700416,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.070274+0000","last_change":"2024-05-12T10:58:37.070274+0000","last_active":"2024-05-12T10:58:37.070274+0000","last_peered":"2024-05-12T10:58:37.070274+0000","last_clean":"2024-05-12T10:58:37.070274+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:58:37.070274+0000","last_undegraded":"2024-05-12T10:58:37.070274+0000","last_fullsized":"2024-05-12T10:58:37.070274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:37.070162+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:37.070162+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.070162+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:16.798385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.701947+0000","last_change":"2024-05-12T10:58:38.702019+0000","last_active":"2024-05-12T10:58:38.701947+0000","last_peered":"2024-05-12T10:58:38.701947+0000","last_clean":"2024-05-12T10:58:38.701947+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:58:38.701947+0000","last_undegraded":"2024-05-12T10:58:38.701947+0000","last_fullsized":"2024-05-12T10:58:38.701947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:38.701781+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:38.701781+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.701781+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:20.597085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'259","reported_seq":423,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.250521+0000","last_change":"2024-05-12T10:58:47.250587+0000","last_active":"2024-05-12T10:58:47.250521+0000","last_peered":"2024-05-12T10:58:47.250521+0000","last_clean":"2024-05-12T10:58:47.250521+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:58:47.250521+0000","last_undegraded":"2024-05-12T10:58:47.250521+0000","last_fullsized":"2024-05-12T10:58:47.250521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'259","last_scrub_stamp":"2024-05-12T10:58:47.250332+0000","last_deep_scrub":"28'259","last_deep_scrub_stamp":"2024-05-12T10:58:47.250332+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.250332+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:32.833130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":532480,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.549892+0000","last_change":"2024-05-12T10:58:35.549892+0000","last_active":"2024-05-12T10:58:35.549892+0000","last_peered":"2024-05-12T10:58:35.549892+0000","last_clean":"2024-05-12T10:58:35.549892+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:58:35.549892+0000","last_undegraded":"2024-05-12T10:58:35.549892+0000","last_fullsized":"2024-05-12T10:58:35.549892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:35.549734+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:35.549734+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.549734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:29.059449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'35","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.943339+0000","last_change":"2024-05-12T10:58:35.943339+0000","last_active":"2024-05-12T10:58:35.943339+0000","last_peered":"2024-05-12T10:58:35.943339+0000","last_clean":"2024-05-12T10:58:35.943339+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:58:35.943339+0000","last_undegraded":"2024-05-12T10:58:35.943339+0000","last_fullsized":"2024-05-12T10:58:35.943339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'35","last_scrub_stamp":"2024-05-12T10:58:35.943254+0000","last_deep_scrub":"28'35","last_deep_scrub_stamp":"2024-05-12T10:58:35.943254+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.943254+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:57:27.102554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'270","reported_seq":442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:49.421412+0000","last_change":"2024-05-12T10:58:49.421440+0000","last_active":"2024-05-12T10:58:49.421412+0000","last_peered":"2024-05-12T10:58:49.421412+0000","last_clean":"2024-05-12T10:58:49.421412+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:58:49.421412+0000","last_undegraded":"2024-05-12T10:58:49.421412+0000","last_fullsized":"2024-05-12T10:58:49.421412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'270","last_scrub_stamp":"2024-05-12T10:58:49.421308+0000","last_deep_scrub":"28'270","last_deep_scrub_stamp":"2024-05-12T10:58:49.421308+0000","last_clean_scrub_stamp":"2024-05-12T10:58:49.421308+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:58:03.273469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'9","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.002637+0000","last_change":"2024-05-12T10:58:41.002665+0000","last_active":"2024-05-12T10:58:41.002637+0000","last_peered":"2024-05-12T10:58:41.002637+0000","last_clean":"2024-05-12T10:58:41.002637+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:58:41.002637+0000","last_undegraded":"2024-05-12T10:58:41.002637+0000","last_fullsized":"2024-05-12T10:58:41.002637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:41.002541+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:41.002541+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.002541+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:16:13.457729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'2","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.485087+0000","last_change":"2024-05-12T10:58:40.485152+0000","last_active":"2024-05-12T10:58:40.485087+0000","last_peered":"2024-05-12T10:58:40.485087+0000","last_clean":"2024-05-12T10:58:40.485087+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:58:40.485087+0000","last_undegraded":"2024-05-12T10:58:40.485087+0000","last_fullsized":"2024-05-12T10:58:40.485087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-05-12T10:58:40.484916+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-05-12T10:58:40.484916+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.484916+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:58:05.245457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'261","reported_seq":431,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.234943+0000","last_change":"2024-05-12T10:58:46.234973+0000","last_active":"2024-05-12T10:58:46.234943+0000","last_peered":"2024-05-12T10:58:46.234943+0000","last_clean":"2024-05-12T10:58:46.234943+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:58:46.234943+0000","last_undegraded":"2024-05-12T10:58:46.234943+0000","last_fullsized":"2024-05-12T10:58:46.234943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'261","last_scrub_stamp":"2024-05-12T10:58:46.234856+0000","last_deep_scrub":"28'261","last_deep_scrub_stamp":"2024-05-12T10:58:46.234856+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.234856+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:20:49.430308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.761687+0000","last_change":"2024-05-12T10:58:43.761745+0000","last_active":"2024-05-12T10:58:43.761687+0000","last_peered":"2024-05-12T10:58:43.761687+0000","last_clean":"2024-05-12T10:58:43.761687+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:58:43.761687+0000","last_undegraded":"2024-05-12T10:58:43.761687+0000","last_fullsized":"2024-05-12T10:58:43.761687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:43.761518+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:43.761518+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.761518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:56:07.029930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:33.921531+0000","last_change":"2024-05-12T10:58:33.921550+0000","last_active":"2024-05-12T10:58:33.921531+0000","last_peered":"2024-05-12T10:58:33.921531+0000","last_clean":"2024-05-12T10:58:33.921531+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:58:33.921531+0000","last_undegraded":"2024-05-12T10:58:33.921531+0000","last_fullsized":"2024-05-12T10:58:33.921531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:58:33.921460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:58:33.921460+0000","last_clean_scrub_stamp":"2024-05-12T10:58:33.921460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:55:51.959435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'282","reported_seq":474,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.955276+0000","last_change":"2024-05-12T10:58:44.955336+0000","last_active":"2024-05-12T10:58:44.955276+0000","last_peered":"2024-05-12T10:58:44.955276+0000","last_clean":"2024-05-12T10:58:44.955276+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:58:44.955276+0000","last_undegraded":"2024-05-12T10:58:44.955276+0000","last_fullsized":"2024-05-12T10:58:44.955276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'282","last_scrub_stamp":"2024-05-12T10:58:44.955181+0000","last_deep_scrub":"28'282","last_deep_scrub_stamp":"2024-05-12T10:58:44.955181+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.955181+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:19.644683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.226913+0000","last_change":"2024-05-12T10:58:36.227027+0000","last_active":"2024-05-12T10:58:36.226913+0000","last_peered":"2024-05-12T10:58:36.226913+0000","last_clean":"2024-05-12T10:58:36.226913+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:58:36.226913+0000","last_undegraded":"2024-05-12T10:58:36.226913+0000","last_fullsized":"2024-05-12T10:58:36.226913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:36.226647+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:36.226647+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.226647+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:55.065979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.665342+0000","last_change":"2024-05-12T10:58:38.665400+0000","last_active":"2024-05-12T10:58:38.665342+0000","last_peered":"2024-05-12T10:58:38.665342+0000","last_clean":"2024-05-12T10:58:38.665342+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:58:38.665342+0000","last_undegraded":"2024-05-12T10:58:38.665342+0000","last_fullsized":"2024-05-12T10:58:38.665342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-05-12T10:58:38.665161+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-05-12T10:58:38.665161+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.665161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:43:52.510535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'269","reported_seq":451,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.926380+0000","last_change":"2024-05-12T10:58:47.926422+0000","last_active":"2024-05-12T10:58:47.926380+0000","last_peered":"2024-05-12T10:58:47.926380+0000","last_clean":"2024-05-12T10:58:47.926380+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:58:47.926380+0000","last_undegraded":"2024-05-12T10:58:47.926380+0000","last_fullsized":"2024-05-12T10:58:47.926380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'269","last_scrub_stamp":"2024-05-12T10:58:47.926288+0000","last_deep_scrub":"28'269","last_deep_scrub_stamp":"2024-05-12T10:58:47.926288+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.926288+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:15:05.111217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.975915+0000","last_change":"2024-05-12T10:58:39.975937+0000","last_active":"2024-05-12T10:58:39.975915+0000","last_peered":"2024-05-12T10:58:39.975915+0000","last_clean":"2024-05-12T10:58:39.975915+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:58:39.975915+0000","last_undegraded":"2024-05-12T10:58:39.975915+0000","last_fullsized":"2024-05-12T10:58:39.975915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:39.975813+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:39.975813+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.975813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:48:30.642170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'12","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:33.517918+0000","last_change":"2024-05-12T10:58:33.517958+0000","last_active":"2024-05-12T10:58:33.517918+0000","last_peered":"2024-05-12T10:58:33.517918+0000","last_clean":"2024-05-12T10:58:33.517918+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:58:33.517918+0000","last_undegraded":"2024-05-12T10:58:33.517918+0000","last_fullsized":"2024-05-12T10:58:33.517918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-05-12T10:58:33.517838+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-05-12T10:58:33.517838+0000","last_clean_scrub_stamp":"2024-05-12T10:58:33.517838+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:17.746513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'281","reported_seq":457,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.971196+0000","last_change":"2024-05-12T10:58:45.971222+0000","last_active":"2024-05-12T10:58:45.971196+0000","last_peered":"2024-05-12T10:58:45.971196+0000","last_clean":"2024-05-12T10:58:45.971196+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:58:45.971196+0000","last_undegraded":"2024-05-12T10:58:45.971196+0000","last_fullsized":"2024-05-12T10:58:45.971196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'281","last_scrub_stamp":"2024-05-12T10:58:45.971070+0000","last_deep_scrub":"28'281","last_deep_scrub_stamp":"2024-05-12T10:58:45.971070+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.971070+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:16:04.028036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.120071+0000","last_change":"2024-05-12T10:58:41.120097+0000","last_active":"2024-05-12T10:58:41.120071+0000","last_peered":"2024-05-12T10:58:41.120071+0000","last_clean":"2024-05-12T10:58:41.120071+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:58:41.120071+0000","last_undegraded":"2024-05-12T10:58:41.120071+0000","last_fullsized":"2024-05-12T10:58:41.120071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:41.119983+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:41.119983+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.119983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:49:02.350792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.501502+0000","last_change":"2024-05-12T10:58:41.501617+0000","last_active":"2024-05-12T10:58:41.501502+0000","last_peered":"2024-05-12T10:58:41.501502+0000","last_clean":"2024-05-12T10:58:41.501502+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:58:41.501502+0000","last_undegraded":"2024-05-12T10:58:41.501502+0000","last_fullsized":"2024-05-12T10:58:41.501502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:41.501295+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:41.501295+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.501295+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:17:39.339395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'345","reported_seq":565,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.204545+0000","last_change":"2024-05-12T10:58:47.204573+0000","last_active":"2024-05-12T10:58:47.204545+0000","last_peered":"2024-05-12T10:58:47.204545+0000","last_clean":"2024-05-12T10:58:47.204545+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:58:47.204545+0000","last_undegraded":"2024-05-12T10:58:47.204545+0000","last_fullsized":"2024-05-12T10:58:47.204545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'345","last_scrub_stamp":"2024-05-12T10:58:47.204449+0000","last_deep_scrub":"28'345","last_deep_scrub_stamp":"2024-05-12T10:58:47.204449+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.204449+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:53.469342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.523113+0000","last_change":"2024-05-12T10:58:41.523138+0000","last_active":"2024-05-12T10:58:41.523113+0000","last_peered":"2024-05-12T10:58:41.523113+0000","last_clean":"2024-05-12T10:58:41.523113+0000","last_became_active":"2024-05-12T10:50:36.847173+0000","last_became_peered":"2024-05-12T10:50:36.847173+0000","last_unstale":"2024-05-12T10:58:41.523113+0000","last_undegraded":"2024-05-12T10:58:41.523113+0000","last_fullsized":"2024-05-12T10:58:41.523113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:41.523040+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:41.523040+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.523040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:50:59.118706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.653077+0000","last_change":"2024-05-12T10:58:36.653145+0000","last_active":"2024-05-12T10:58:36.653077+0000","last_peered":"2024-05-12T10:58:36.653077+0000","last_clean":"2024-05-12T10:58:36.653077+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:58:36.653077+0000","last_undegraded":"2024-05-12T10:58:36.653077+0000","last_fullsized":"2024-05-12T10:58:36.653077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:36.652899+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:36.652899+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.652899+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:13:24.070950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'74","reported_seq":139,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.531434+0000","last_change":"2024-05-12T10:58:38.531503+0000","last_active":"2024-05-12T10:58:38.531434+0000","last_peered":"2024-05-12T10:58:38.531434+0000","last_clean":"2024-05-12T10:58:38.531434+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:58:38.531434+0000","last_undegraded":"2024-05-12T10:58:38.531434+0000","last_fullsized":"2024-05-12T10:58:38.531434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2024-05-12T10:58:38.531259+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2024-05-12T10:58:38.531259+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.531259+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:04:15.854530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'290","reported_seq":478,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.625928+0000","last_change":"2024-05-12T10:58:48.626072+0000","last_active":"2024-05-12T10:58:48.625928+0000","last_peered":"2024-05-12T10:58:48.625928+0000","last_clean":"2024-05-12T10:58:48.625928+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:58:48.625928+0000","last_undegraded":"2024-05-12T10:58:48.625928+0000","last_fullsized":"2024-05-12T10:58:48.625928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'290","last_scrub_stamp":"2024-05-12T10:58:48.625708+0000","last_deep_scrub":"28'290","last_deep_scrub_stamp":"2024-05-12T10:58:48.625708+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.625708+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:12:39.952823+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:49.340217+0000","last_change":"2024-05-12T10:58:49.340331+0000","last_active":"2024-05-12T10:58:49.340217+0000","last_peered":"2024-05-12T10:58:49.340217+0000","last_clean":"2024-05-12T10:58:49.340217+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:58:49.340217+0000","last_undegraded":"2024-05-12T10:58:49.340217+0000","last_fullsized":"2024-05-12T10:58:49.340217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:49.339996+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:49.339996+0000","last_clean_scrub_stamp":"2024-05-12T10:58:49.339996+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:51:25.811682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'5","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.503931+0000","last_change":"2024-05-12T10:58:36.503956+0000","last_active":"2024-05-12T10:58:36.503931+0000","last_peered":"2024-05-12T10:58:36.503931+0000","last_clean":"2024-05-12T10:58:36.503931+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:58:36.503931+0000","last_undegraded":"2024-05-12T10:58:36.503931+0000","last_fullsized":"2024-05-12T10:58:36.503931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:36.503858+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:36.503858+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.503858+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:43:35.691378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'291","reported_seq":485,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.601038+0000","last_change":"2024-05-12T10:58:47.601182+0000","last_active":"2024-05-12T10:58:47.601038+0000","last_peered":"2024-05-12T10:58:47.601038+0000","last_clean":"2024-05-12T10:58:47.601038+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:58:47.601038+0000","last_undegraded":"2024-05-12T10:58:47.601038+0000","last_fullsized":"2024-05-12T10:58:47.601038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'291","last_scrub_stamp":"2024-05-12T10:58:47.600742+0000","last_deep_scrub":"28'291","last_deep_scrub_stamp":"2024-05-12T10:58:47.600742+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.600742+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:49:33.870338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'6","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.484952+0000","last_change":"2024-05-12T10:58:40.484976+0000","last_active":"2024-05-12T10:58:40.484952+0000","last_peered":"2024-05-12T10:58:40.484952+0000","last_clean":"2024-05-12T10:58:40.484952+0000","last_became_active":"2024-05-12T10:50:36.844312+0000","last_became_peered":"2024-05-12T10:50:36.844312+0000","last_unstale":"2024-05-12T10:58:40.484952+0000","last_undegraded":"2024-05-12T10:58:40.484952+0000","last_fullsized":"2024-05-12T10:58:40.484952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:40.484872+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:40.484872+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.484872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:37:21.229576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.934108+0000","last_change":"2024-05-12T10:58:34.934132+0000","last_active":"2024-05-12T10:58:34.934108+0000","last_peered":"2024-05-12T10:58:34.934108+0000","last_clean":"2024-05-12T10:58:34.934108+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:58:34.934108+0000","last_undegraded":"2024-05-12T10:58:34.934108+0000","last_fullsized":"2024-05-12T10:58:34.934108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-05-12T10:58:34.934046+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-05-12T10:58:34.934046+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.934046+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:37:18.795663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'266","reported_seq":441,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.222976+0000","last_change":"2024-05-12T10:58:44.223005+0000","last_active":"2024-05-12T10:58:44.222976+0000","last_peered":"2024-05-12T10:58:44.222976+0000","last_clean":"2024-05-12T10:58:44.222976+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:58:44.222976+0000","last_undegraded":"2024-05-12T10:58:44.222976+0000","last_fullsized":"2024-05-12T10:58:44.222976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'266","last_scrub_stamp":"2024-05-12T10:58:44.222861+0000","last_deep_scrub":"28'266","last_deep_scrub_stamp":"2024-05-12T10:58:44.222861+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.222861+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:37.229174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:50.306925+0000","last_change":"2024-05-12T10:58:50.307048+0000","last_active":"2024-05-12T10:58:50.306925+0000","last_peered":"2024-05-12T10:58:50.306925+0000","last_clean":"2024-05-12T10:58:50.306925+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:58:50.306925+0000","last_undegraded":"2024-05-12T10:58:50.306925+0000","last_fullsized":"2024-05-12T10:58:50.306925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:50.306708+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:50.306708+0000","last_clean_scrub_stamp":"2024-05-12T10:58:50.306708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:18:02.507210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'3","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.500492+0000","last_change":"2024-05-12T10:58:34.500515+0000","last_active":"2024-05-12T10:58:34.500492+0000","last_peered":"2024-05-12T10:58:34.500492+0000","last_clean":"2024-05-12T10:58:34.500492+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:58:34.500492+0000","last_undegraded":"2024-05-12T10:58:34.500492+0000","last_fullsized":"2024-05-12T10:58:34.500492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-12T10:58:34.500429+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-12T10:58:34.500429+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.500429+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:01:37.307462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'323","reported_seq":527,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:50.792277+0000","last_change":"2024-05-12T10:58:50.792346+0000","last_active":"2024-05-12T10:58:50.792277+0000","last_peered":"2024-05-12T10:58:50.792277+0000","last_clean":"2024-05-12T10:58:50.792277+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:58:50.792277+0000","last_undegraded":"2024-05-12T10:58:50.792277+0000","last_fullsized":"2024-05-12T10:58:50.792277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'323","last_scrub_stamp":"2024-05-12T10:58:50.792088+0000","last_deep_scrub":"28'323","last_deep_scrub_stamp":"2024-05-12T10:58:50.792088+0000","last_clean_scrub_stamp":"2024-05-12T10:58:50.792088+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:28:43.829410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:51.282047+0000","last_change":"2024-05-12T10:58:51.282104+0000","last_active":"2024-05-12T10:58:51.282047+0000","last_peered":"2024-05-12T10:58:51.282047+0000","last_clean":"2024-05-12T10:58:51.282047+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:58:51.282047+0000","last_undegraded":"2024-05-12T10:58:51.282047+0000","last_fullsized":"2024-05-12T10:58:51.282047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:51.281872+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:51.281872+0000","last_clean_scrub_stamp":"2024-05-12T10:58:51.281872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:57:49.358852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.175582+0000","last_change":"2024-05-12T10:58:34.175686+0000","last_active":"2024-05-12T10:58:34.175582+0000","last_peered":"2024-05-12T10:58:34.175582+0000","last_clean":"2024-05-12T10:58:34.175582+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:58:34.175582+0000","last_undegraded":"2024-05-12T10:58:34.175582+0000","last_fullsized":"2024-05-12T10:58:34.175582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:34.175406+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:34.175406+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.175406+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:39:29.714881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'269","reported_seq":437,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.291846+0000","last_change":"2024-05-12T10:58:42.291846+0000","last_active":"2024-05-12T10:58:42.291846+0000","last_peered":"2024-05-12T10:58:42.291846+0000","last_clean":"2024-05-12T10:58:42.291846+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:58:42.291846+0000","last_undegraded":"2024-05-12T10:58:42.291846+0000","last_fullsized":"2024-05-12T10:58:42.291846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'269","last_scrub_stamp":"2024-05-12T10:58:42.291562+0000","last_deep_scrub":"28'269","last_deep_scrub_stamp":"2024-05-12T10:58:42.291562+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.291562+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:42:45.437146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":548864,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:52.326819+0000","last_change":"2024-05-12T10:58:52.326878+0000","last_active":"2024-05-12T10:58:52.326819+0000","last_peered":"2024-05-12T10:58:52.326819+0000","last_clean":"2024-05-12T10:58:52.326819+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:58:52.326819+0000","last_undegraded":"2024-05-12T10:58:52.326819+0000","last_fullsized":"2024-05-12T10:58:52.326819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:52.326643+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:52.326643+0000","last_clean_scrub_stamp":"2024-05-12T10:58:52.326643+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:10:51.847249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'24","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.529939+0000","last_change":"2024-05-12T10:58:35.529971+0000","last_active":"2024-05-12T10:58:35.529939+0000","last_peered":"2024-05-12T10:58:35.529939+0000","last_clean":"2024-05-12T10:58:35.529939+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:58:35.529939+0000","last_undegraded":"2024-05-12T10:58:35.529939+0000","last_fullsized":"2024-05-12T10:58:35.529939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'24","last_scrub_stamp":"2024-05-12T10:58:35.529875+0000","last_deep_scrub":"28'24","last_deep_scrub_stamp":"2024-05-12T10:58:35.529875+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.529875+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:50:24.889671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'374","reported_seq":607,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.205042+0000","last_change":"2024-05-12T10:58:45.205108+0000","last_active":"2024-05-12T10:58:45.205042+0000","last_peered":"2024-05-12T10:58:45.205042+0000","last_clean":"2024-05-12T10:58:45.205042+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:58:45.205042+0000","last_undegraded":"2024-05-12T10:58:45.205042+0000","last_fullsized":"2024-05-12T10:58:45.205042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'374","last_scrub_stamp":"2024-05-12T10:58:45.204937+0000","last_deep_scrub":"28'374","last_deep_scrub_stamp":"2024-05-12T10:58:45.204937+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.204937+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:18:15.451437+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":819200,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.614957+0000","last_change":"2024-05-12T10:58:42.615071+0000","last_active":"2024-05-12T10:58:42.614957+0000","last_peered":"2024-05-12T10:58:42.614957+0000","last_clean":"2024-05-12T10:58:42.614957+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:58:42.614957+0000","last_undegraded":"2024-05-12T10:58:42.614957+0000","last_fullsized":"2024-05-12T10:58:42.614957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:42.614735+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:42.614735+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.614735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:39:15.444141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.737194+0000","last_change":"2024-05-12T10:58:37.737258+0000","last_active":"2024-05-12T10:58:37.737194+0000","last_peered":"2024-05-12T10:58:37.737194+0000","last_clean":"2024-05-12T10:58:37.737194+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:58:37.737194+0000","last_undegraded":"2024-05-12T10:58:37.737194+0000","last_fullsized":"2024-05-12T10:58:37.737194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:37.737019+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:37.737019+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.737019+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:16:44.700464+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'283","reported_seq":462,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.470834+0000","last_change":"2024-05-12T10:58:47.470863+0000","last_active":"2024-05-12T10:58:47.470834+0000","last_peered":"2024-05-12T10:58:47.470834+0000","last_clean":"2024-05-12T10:58:47.470834+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:58:47.470834+0000","last_undegraded":"2024-05-12T10:58:47.470834+0000","last_fullsized":"2024-05-12T10:58:47.470834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'283","last_scrub_stamp":"2024-05-12T10:58:47.470732+0000","last_deep_scrub":"28'283","last_deep_scrub_stamp":"2024-05-12T10:58:47.470732+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.470732+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:04:33.461972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'15","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.708833+0000","last_change":"2024-05-12T10:49:55.646879+0000","last_active":"2024-05-12T10:58:28.708833+0000","last_peered":"2024-05-12T10:58:28.708833+0000","last_clean":"2024-05-12T10:58:28.708833+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:58:28.708833+0000","last_undegraded":"2024-05-12T10:58:28.708833+0000","last_fullsized":"2024-05-12T10:58:28.708833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'4","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.699893+0000","last_change":"2024-05-12T10:58:40.699959+0000","last_active":"2024-05-12T10:58:40.699893+0000","last_peered":"2024-05-12T10:58:40.699893+0000","last_clean":"2024-05-12T10:58:40.699893+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:58:40.699893+0000","last_undegraded":"2024-05-12T10:58:40.699893+0000","last_fullsized":"2024-05-12T10:58:40.699893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:40.699730+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:40.699730+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.699730+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:52:43.946386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'279","reported_seq":459,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.426868+0000","last_change":"2024-05-12T10:58:48.426911+0000","last_active":"2024-05-12T10:58:48.426868+0000","last_peered":"2024-05-12T10:58:48.426868+0000","last_clean":"2024-05-12T10:58:48.426868+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:58:48.426868+0000","last_undegraded":"2024-05-12T10:58:48.426868+0000","last_fullsized":"2024-05-12T10:58:48.426868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'279","last_scrub_stamp":"2024-05-12T10:58:48.426754+0000","last_deep_scrub":"28'279","last_deep_scrub_stamp":"2024-05-12T10:58:48.426754+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.426754+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:28:10.840953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.205314+0000","last_change":"2024-05-12T10:58:43.205340+0000","last_active":"2024-05-12T10:58:43.205314+0000","last_peered":"2024-05-12T10:58:43.205314+0000","last_clean":"2024-05-12T10:58:43.205314+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:58:43.205314+0000","last_undegraded":"2024-05-12T10:58:43.205314+0000","last_fullsized":"2024-05-12T10:58:43.205314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:43.205232+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:43.205232+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.205232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:55:03.331992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'10","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:33.142058+0000","last_change":"2024-05-12T10:58:33.142088+0000","last_active":"2024-05-12T10:58:33.142058+0000","last_peered":"2024-05-12T10:58:33.142058+0000","last_clean":"2024-05-12T10:58:33.142058+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:58:33.142058+0000","last_undegraded":"2024-05-12T10:58:33.142058+0000","last_fullsized":"2024-05-12T10:58:33.142058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:33.141995+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:33.141995+0000","last_clean_scrub_stamp":"2024-05-12T10:58:33.141995+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:33.971351+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'329","reported_seq":546,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:51.820275+0000","last_change":"2024-05-12T10:58:51.820386+0000","last_active":"2024-05-12T10:58:51.820275+0000","last_peered":"2024-05-12T10:58:51.820275+0000","last_clean":"2024-05-12T10:58:51.820275+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:58:51.820275+0000","last_undegraded":"2024-05-12T10:58:51.820275+0000","last_fullsized":"2024-05-12T10:58:51.820275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'329","last_scrub_stamp":"2024-05-12T10:58:51.819988+0000","last_deep_scrub":"28'329","last_deep_scrub_stamp":"2024-05-12T10:58:51.819988+0000","last_clean_scrub_stamp":"2024-05-12T10:58:51.819988+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:50.628017+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.390846+0000","last_change":"2024-05-12T10:58:46.390903+0000","last_active":"2024-05-12T10:58:46.390846+0000","last_peered":"2024-05-12T10:58:46.390846+0000","last_clean":"2024-05-12T10:58:46.390846+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:58:46.390846+0000","last_undegraded":"2024-05-12T10:58:46.390846+0000","last_fullsized":"2024-05-12T10:58:46.390846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:46.390665+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:46.390665+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.390665+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:19:23.796971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'1914","reported_seq":1954,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.790284+0000","last_change":"2024-05-12T10:58:35.790404+0000","last_active":"2024-05-12T10:58:35.790284+0000","last_peered":"2024-05-12T10:58:35.790284+0000","last_clean":"2024-05-12T10:58:35.790284+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:58:35.790284+0000","last_undegraded":"2024-05-12T10:58:35.790284+0000","last_fullsized":"2024-05-12T10:58:35.790284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1914","last_scrub_stamp":"2024-05-12T10:58:35.790113+0000","last_deep_scrub":"28'1914","last_deep_scrub_stamp":"2024-05-12T10:58:35.790113+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.790113+0000","objects_scrubbed":5,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:24:08.792024+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3832820,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1911,"num_write_kb":3949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'296","reported_seq":489,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.958590+0000","last_change":"2024-05-12T10:58:46.958614+0000","last_active":"2024-05-12T10:58:46.958590+0000","last_peered":"2024-05-12T10:58:46.958590+0000","last_clean":"2024-05-12T10:58:46.958590+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:58:46.958590+0000","last_undegraded":"2024-05-12T10:58:46.958590+0000","last_fullsized":"2024-05-12T10:58:46.958590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'296","last_scrub_stamp":"2024-05-12T10:58:46.958503+0000","last_deep_scrub":"28'296","last_deep_scrub_stamp":"2024-05-12T10:58:46.958503+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.958503+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:27:45.463828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'11","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.247701+0000","last_change":"2024-05-12T10:58:38.247766+0000","last_active":"2024-05-12T10:58:38.247701+0000","last_peered":"2024-05-12T10:58:38.247701+0000","last_clean":"2024-05-12T10:58:38.247701+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:58:38.247701+0000","last_undegraded":"2024-05-12T10:58:38.247701+0000","last_fullsized":"2024-05-12T10:58:38.247701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-12T10:58:38.247471+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-12T10:58:38.247471+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.247471+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:56:59.140286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'12","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.941442+0000","last_change":"2024-05-12T10:58:37.941471+0000","last_active":"2024-05-12T10:58:37.941442+0000","last_peered":"2024-05-12T10:58:37.941442+0000","last_clean":"2024-05-12T10:58:37.941442+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:58:37.941442+0000","last_undegraded":"2024-05-12T10:58:37.941442+0000","last_fullsized":"2024-05-12T10:58:37.941442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-05-12T10:58:37.941373+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-05-12T10:58:37.941373+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.941373+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:08:26.086626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'304","reported_seq":512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.260129+0000","last_change":"2024-05-12T10:58:43.260257+0000","last_active":"2024-05-12T10:58:43.260129+0000","last_peered":"2024-05-12T10:58:43.260129+0000","last_clean":"2024-05-12T10:58:43.260129+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:58:43.260129+0000","last_undegraded":"2024-05-12T10:58:43.260129+0000","last_fullsized":"2024-05-12T10:58:43.260129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'304","last_scrub_stamp":"2024-05-12T10:58:43.259888+0000","last_deep_scrub":"28'304","last_deep_scrub_stamp":"2024-05-12T10:58:43.259888+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.259888+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:55.771259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":716800,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.154042+0000","last_change":"2024-05-12T10:58:39.154108+0000","last_active":"2024-05-12T10:58:39.154042+0000","last_peered":"2024-05-12T10:58:39.154042+0000","last_clean":"2024-05-12T10:58:39.154042+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:58:39.154042+0000","last_undegraded":"2024-05-12T10:58:39.154042+0000","last_fullsized":"2024-05-12T10:58:39.154042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:39.153930+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:39.153930+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.153930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:59:16.276725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'3","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.672256+0000","last_change":"2024-05-12T10:58:37.672323+0000","last_active":"2024-05-12T10:58:37.672256+0000","last_peered":"2024-05-12T10:58:37.672256+0000","last_clean":"2024-05-12T10:58:37.672256+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:58:37.672256+0000","last_undegraded":"2024-05-12T10:58:37.672256+0000","last_fullsized":"2024-05-12T10:58:37.672256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-12T10:58:37.672089+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-12T10:58:37.672089+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.672089+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:18:44.318734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'307","reported_seq":499,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:52.494132+0000","last_change":"2024-05-12T10:58:52.494159+0000","last_active":"2024-05-12T10:58:52.494132+0000","last_peered":"2024-05-12T10:58:52.494132+0000","last_clean":"2024-05-12T10:58:52.494132+0000","last_became_active":"2024-05-12T10:50:36.855397+0000","last_became_peered":"2024-05-12T10:50:36.855397+0000","last_unstale":"2024-05-12T10:58:52.494132+0000","last_undegraded":"2024-05-12T10:58:52.494132+0000","last_fullsized":"2024-05-12T10:58:52.494132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'307","last_scrub_stamp":"2024-05-12T10:58:52.494037+0000","last_deep_scrub":"28'307","last_deep_scrub_stamp":"2024-05-12T10:58:52.494037+0000","last_clean_scrub_stamp":"2024-05-12T10:58:52.494037+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:00.834486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.805234+0000","last_change":"2024-05-12T10:58:46.805341+0000","last_active":"2024-05-12T10:58:46.805234+0000","last_peered":"2024-05-12T10:58:46.805234+0000","last_clean":"2024-05-12T10:58:46.805234+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:58:46.805234+0000","last_undegraded":"2024-05-12T10:58:46.805234+0000","last_fullsized":"2024-05-12T10:58:46.805234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:46.805026+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:46.805026+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.805026+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:53:00.507157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.707392+0000","last_change":"2024-05-12T10:58:39.707459+0000","last_active":"2024-05-12T10:58:39.707392+0000","last_peered":"2024-05-12T10:58:39.707392+0000","last_clean":"2024-05-12T10:58:39.707392+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:58:39.707392+0000","last_undegraded":"2024-05-12T10:58:39.707392+0000","last_fullsized":"2024-05-12T10:58:39.707392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:39.707225+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:39.707225+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.707225+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:34.520998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'332","reported_seq":539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:51.447771+0000","last_change":"2024-05-12T10:58:51.447797+0000","last_active":"2024-05-12T10:58:51.447771+0000","last_peered":"2024-05-12T10:58:51.447771+0000","last_clean":"2024-05-12T10:58:51.447771+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:58:51.447771+0000","last_undegraded":"2024-05-12T10:58:51.447771+0000","last_fullsized":"2024-05-12T10:58:51.447771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'332","last_scrub_stamp":"2024-05-12T10:58:51.447680+0000","last_deep_scrub":"28'332","last_deep_scrub_stamp":"2024-05-12T10:58:51.447680+0000","last_clean_scrub_stamp":"2024-05-12T10:58:51.447680+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:43:41.000048+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'283","reported_seq":474,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.222282+0000","last_change":"2024-05-12T10:58:48.222307+0000","last_active":"2024-05-12T10:58:48.222282+0000","last_peered":"2024-05-12T10:58:48.222282+0000","last_clean":"2024-05-12T10:58:48.222282+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:58:48.222282+0000","last_undegraded":"2024-05-12T10:58:48.222282+0000","last_fullsized":"2024-05-12T10:58:48.222282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'283","last_scrub_stamp":"2024-05-12T10:58:48.222158+0000","last_deep_scrub":"28'283","last_deep_scrub_stamp":"2024-05-12T10:58:48.222158+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.222158+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:17:59.889255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":643072,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'11","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.968431+0000","last_change":"2024-05-12T10:58:41.968461+0000","last_active":"2024-05-12T10:58:41.968431+0000","last_peered":"2024-05-12T10:58:41.968431+0000","last_clean":"2024-05-12T10:58:41.968431+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:58:41.968431+0000","last_undegraded":"2024-05-12T10:58:41.968431+0000","last_fullsized":"2024-05-12T10:58:41.968431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-12T10:58:41.968333+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-12T10:58:41.968333+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.968333+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:39:27.260863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.699080+0000","last_change":"2024-05-12T10:58:39.699191+0000","last_active":"2024-05-12T10:58:39.699080+0000","last_peered":"2024-05-12T10:58:39.699080+0000","last_clean":"2024-05-12T10:58:39.699080+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:58:39.699080+0000","last_undegraded":"2024-05-12T10:58:39.699080+0000","last_fullsized":"2024-05-12T10:58:39.699080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-05-12T10:58:39.698881+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-05-12T10:58:39.698881+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.698881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:32:34.724939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'272","reported_seq":458,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.612812+0000","last_change":"2024-05-12T10:58:46.612882+0000","last_active":"2024-05-12T10:58:46.612812+0000","last_peered":"2024-05-12T10:58:46.612812+0000","last_clean":"2024-05-12T10:58:46.612812+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:58:46.612812+0000","last_undegraded":"2024-05-12T10:58:46.612812+0000","last_fullsized":"2024-05-12T10:58:46.612812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'272","last_scrub_stamp":"2024-05-12T10:58:46.612620+0000","last_deep_scrub":"28'272","last_deep_scrub_stamp":"2024-05-12T10:58:46.612620+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.612620+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:58:00.574155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.502785+0000","last_change":"2024-05-12T10:58:42.502810+0000","last_active":"2024-05-12T10:58:42.502785+0000","last_peered":"2024-05-12T10:58:42.502785+0000","last_clean":"2024-05-12T10:58:42.502785+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:58:42.502785+0000","last_undegraded":"2024-05-12T10:58:42.502785+0000","last_fullsized":"2024-05-12T10:58:42.502785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:42.502705+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:42.502705+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.502705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:17:57.289294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.491520+0000","last_change":"2024-05-12T10:58:40.491551+0000","last_active":"2024-05-12T10:58:40.491520+0000","last_peered":"2024-05-12T10:58:40.491520+0000","last_clean":"2024-05-12T10:58:40.491520+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:58:40.491520+0000","last_undegraded":"2024-05-12T10:58:40.491520+0000","last_fullsized":"2024-05-12T10:58:40.491520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-12T10:58:40.491442+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-12T10:58:40.491442+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.491442+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:21.280853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'4","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.726609+0000","last_change":"2024-05-12T10:58:36.726678+0000","last_active":"2024-05-12T10:58:36.726609+0000","last_peered":"2024-05-12T10:58:36.726609+0000","last_clean":"2024-05-12T10:58:36.726609+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:58:36.726609+0000","last_undegraded":"2024-05-12T10:58:36.726609+0000","last_fullsized":"2024-05-12T10:58:36.726609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:36.726426+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:36.726426+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.726426+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:42:21.055693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.168439+0000","last_change":"2024-05-12T10:58:42.168479+0000","last_active":"2024-05-12T10:58:42.168439+0000","last_peered":"2024-05-12T10:58:42.168439+0000","last_clean":"2024-05-12T10:58:42.168439+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:58:42.168439+0000","last_undegraded":"2024-05-12T10:58:42.168439+0000","last_fullsized":"2024-05-12T10:58:42.168439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:42.168365+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:42.168365+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.168365+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:03.604775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'308","reported_seq":511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.497322+0000","last_change":"2024-05-12T10:58:39.497351+0000","last_active":"2024-05-12T10:58:39.497322+0000","last_peered":"2024-05-12T10:58:39.497322+0000","last_clean":"2024-05-12T10:58:39.497322+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:58:39.497322+0000","last_undegraded":"2024-05-12T10:58:39.497322+0000","last_fullsized":"2024-05-12T10:58:39.497322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'308","last_scrub_stamp":"2024-05-12T10:58:39.497198+0000","last_deep_scrub":"28'308","last_deep_scrub_stamp":"2024-05-12T10:58:39.497198+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.497198+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:34:46.775219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.523337+0000","last_change":"2024-05-12T10:58:39.523372+0000","last_active":"2024-05-12T10:58:39.523337+0000","last_peered":"2024-05-12T10:58:39.523337+0000","last_clean":"2024-05-12T10:58:39.523337+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:58:39.523337+0000","last_undegraded":"2024-05-12T10:58:39.523337+0000","last_fullsized":"2024-05-12T10:58:39.523337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:39.523249+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:39.523249+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.523249+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:37:33.589312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.227023+0000","last_change":"2024-05-12T10:58:37.227081+0000","last_active":"2024-05-12T10:58:37.227023+0000","last_peered":"2024-05-12T10:58:37.227023+0000","last_clean":"2024-05-12T10:58:37.227023+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:58:37.227023+0000","last_undegraded":"2024-05-12T10:58:37.227023+0000","last_fullsized":"2024-05-12T10:58:37.227023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:37.226847+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:37.226847+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.226847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:33:08.307918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'317","reported_seq":523,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.440518+0000","last_change":"2024-05-12T10:58:46.440550+0000","last_active":"2024-05-12T10:58:46.440518+0000","last_peered":"2024-05-12T10:58:46.440518+0000","last_clean":"2024-05-12T10:58:46.440518+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:58:46.440518+0000","last_undegraded":"2024-05-12T10:58:46.440518+0000","last_fullsized":"2024-05-12T10:58:46.440518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'317","last_scrub_stamp":"2024-05-12T10:58:46.440432+0000","last_deep_scrub":"28'317","last_deep_scrub_stamp":"2024-05-12T10:58:46.440432+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.440432+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:15:06.754152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'9","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.640198+0000","last_change":"2024-05-12T10:58:41.640263+0000","last_active":"2024-05-12T10:58:41.640198+0000","last_peered":"2024-05-12T10:58:41.640198+0000","last_clean":"2024-05-12T10:58:41.640198+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:58:41.640198+0000","last_undegraded":"2024-05-12T10:58:41.640198+0000","last_fullsized":"2024-05-12T10:58:41.640198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:41.640021+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:41.640021+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.640021+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:47:51.858802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'12","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.497625+0000","last_change":"2024-05-12T10:58:37.497649+0000","last_active":"2024-05-12T10:58:37.497625+0000","last_peered":"2024-05-12T10:58:37.497625+0000","last_clean":"2024-05-12T10:58:37.497625+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:58:37.497625+0000","last_undegraded":"2024-05-12T10:58:37.497625+0000","last_fullsized":"2024-05-12T10:58:37.497625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-05-12T10:58:37.497539+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-05-12T10:58:37.497539+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.497539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:45.672655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.681981+0000","last_change":"2024-05-12T10:58:35.682095+0000","last_active":"2024-05-12T10:58:35.681981+0000","last_peered":"2024-05-12T10:58:35.681981+0000","last_clean":"2024-05-12T10:58:35.681981+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:58:35.681981+0000","last_undegraded":"2024-05-12T10:58:35.681981+0000","last_fullsized":"2024-05-12T10:58:35.681981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:35.681718+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:35.681718+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.681718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:35:58.717683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.110864+0000","last_change":"2024-05-12T10:58:38.110888+0000","last_active":"2024-05-12T10:58:38.110864+0000","last_peered":"2024-05-12T10:58:38.110864+0000","last_clean":"2024-05-12T10:58:38.110864+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:58:38.110864+0000","last_undegraded":"2024-05-12T10:58:38.110864+0000","last_fullsized":"2024-05-12T10:58:38.110864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:38.110742+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:38.110742+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.110742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:37:47.151178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.491562+0000","last_change":"2024-05-12T10:58:44.491606+0000","last_active":"2024-05-12T10:58:44.491562+0000","last_peered":"2024-05-12T10:58:44.491562+0000","last_clean":"2024-05-12T10:58:44.491562+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:58:44.491562+0000","last_undegraded":"2024-05-12T10:58:44.491562+0000","last_fullsized":"2024-05-12T10:58:44.491562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:44.491442+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:44.491442+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.491442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:39:27.042127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.921758+0000","last_change":"2024-05-12T10:58:42.921783+0000","last_active":"2024-05-12T10:58:42.921758+0000","last_peered":"2024-05-12T10:58:42.921758+0000","last_clean":"2024-05-12T10:58:42.921758+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:58:42.921758+0000","last_undegraded":"2024-05-12T10:58:42.921758+0000","last_fullsized":"2024-05-12T10:58:42.921758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:42.921669+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:42.921669+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.921669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:44:33.196834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'15","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:49.606187+0000","last_change":"2024-05-12T10:58:49.606278+0000","last_active":"2024-05-12T10:58:49.606187+0000","last_peered":"2024-05-12T10:58:49.606187+0000","last_clean":"2024-05-12T10:58:49.606187+0000","last_became_active":"2024-05-12T10:50:36.855517+0000","last_became_peered":"2024-05-12T10:50:36.855517+0000","last_unstale":"2024-05-12T10:58:49.606187+0000","last_undegraded":"2024-05-12T10:58:49.606187+0000","last_fullsized":"2024-05-12T10:58:49.606187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-05-12T10:58:49.605946+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-05-12T10:58:49.605946+0000","last_clean_scrub_stamp":"2024-05-12T10:58:49.605946+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:30:12.847782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.478620+0000","last_change":"2024-05-12T10:58:45.478644+0000","last_active":"2024-05-12T10:58:45.478620+0000","last_peered":"2024-05-12T10:58:45.478620+0000","last_clean":"2024-05-12T10:58:45.478620+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:58:45.478620+0000","last_undegraded":"2024-05-12T10:58:45.478620+0000","last_fullsized":"2024-05-12T10:58:45.478620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-05-12T10:58:45.478541+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-05-12T10:58:45.478541+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.478541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:02:21.141626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'6","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.746137+0000","last_change":"2024-05-12T10:58:42.746246+0000","last_active":"2024-05-12T10:58:42.746137+0000","last_peered":"2024-05-12T10:58:42.746137+0000","last_clean":"2024-05-12T10:58:42.746137+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:58:42.746137+0000","last_undegraded":"2024-05-12T10:58:42.746137+0000","last_fullsized":"2024-05-12T10:58:42.746137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:42.745902+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:42.745902+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.745902+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:10:57.680054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.577593+0000","last_change":"2024-05-12T10:58:37.577620+0000","last_active":"2024-05-12T10:58:37.577593+0000","last_peered":"2024-05-12T10:58:37.577593+0000","last_clean":"2024-05-12T10:58:37.577593+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:58:37.577593+0000","last_undegraded":"2024-05-12T10:58:37.577593+0000","last_fullsized":"2024-05-12T10:58:37.577593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:37.577474+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:37.577474+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.577474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:01:38.399108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.830454+0000","last_change":"2024-05-12T10:58:47.830519+0000","last_active":"2024-05-12T10:58:47.830454+0000","last_peered":"2024-05-12T10:58:47.830454+0000","last_clean":"2024-05-12T10:58:47.830454+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:58:47.830454+0000","last_undegraded":"2024-05-12T10:58:47.830454+0000","last_fullsized":"2024-05-12T10:58:47.830454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:47.830267+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:47.830267+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.830267+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:01.645824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.153325+0000","last_change":"2024-05-12T10:58:40.153352+0000","last_active":"2024-05-12T10:58:40.153325+0000","last_peered":"2024-05-12T10:58:40.153325+0000","last_clean":"2024-05-12T10:58:40.153325+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:58:40.153325+0000","last_undegraded":"2024-05-12T10:58:40.153325+0000","last_fullsized":"2024-05-12T10:58:40.153325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-12T10:58:40.153209+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-12T10:58:40.153209+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.153209+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:50:26.637563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.639668+0000","last_change":"2024-05-12T10:58:45.639733+0000","last_active":"2024-05-12T10:58:45.639668+0000","last_peered":"2024-05-12T10:58:45.639668+0000","last_clean":"2024-05-12T10:58:45.639668+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:58:45.639668+0000","last_undegraded":"2024-05-12T10:58:45.639668+0000","last_fullsized":"2024-05-12T10:58:45.639668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:45.639461+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:45.639461+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.639461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:22:15.071614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.533462+0000","last_change":"2024-05-12T10:58:37.533525+0000","last_active":"2024-05-12T10:58:37.533462+0000","last_peered":"2024-05-12T10:58:37.533462+0000","last_clean":"2024-05-12T10:58:37.533462+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:58:37.533462+0000","last_undegraded":"2024-05-12T10:58:37.533462+0000","last_fullsized":"2024-05-12T10:58:37.533462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:37.533279+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:37.533279+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.533279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:48:02.150508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.508171+0000","last_change":"2024-05-12T10:58:38.508195+0000","last_active":"2024-05-12T10:58:38.508171+0000","last_peered":"2024-05-12T10:58:38.508171+0000","last_clean":"2024-05-12T10:58:38.508171+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:58:38.508171+0000","last_undegraded":"2024-05-12T10:58:38.508171+0000","last_fullsized":"2024-05-12T10:58:38.508171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:38.508097+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:38.508097+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.508097+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:52:27.589075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.788632+0000","last_change":"2024-05-12T10:58:45.788712+0000","last_active":"2024-05-12T10:58:45.788632+0000","last_peered":"2024-05-12T10:58:45.788632+0000","last_clean":"2024-05-12T10:58:45.788632+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:58:45.788632+0000","last_undegraded":"2024-05-12T10:58:45.788632+0000","last_fullsized":"2024-05-12T10:58:45.788632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:45.788435+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:45.788435+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.788435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:47:50.316787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.746931+0000","last_change":"2024-05-12T10:58:41.746989+0000","last_active":"2024-05-12T10:58:41.746931+0000","last_peered":"2024-05-12T10:58:41.746931+0000","last_clean":"2024-05-12T10:58:41.746931+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:58:41.746931+0000","last_undegraded":"2024-05-12T10:58:41.746931+0000","last_fullsized":"2024-05-12T10:58:41.746931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:41.746747+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:41.746747+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.746747+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:11:30.136055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.952796+0000","last_change":"2024-05-12T10:58:43.952823+0000","last_active":"2024-05-12T10:58:43.952796+0000","last_peered":"2024-05-12T10:58:43.952796+0000","last_clean":"2024-05-12T10:58:43.952796+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:58:43.952796+0000","last_undegraded":"2024-05-12T10:58:43.952796+0000","last_fullsized":"2024-05-12T10:58:43.952796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:43.952676+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:43.952676+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.952676+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:12:41.915152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.109725+0000","last_change":"2024-05-12T10:58:36.109745+0000","last_active":"2024-05-12T10:58:36.109725+0000","last_peered":"2024-05-12T10:58:36.109725+0000","last_clean":"2024-05-12T10:58:36.109725+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:58:36.109725+0000","last_undegraded":"2024-05-12T10:58:36.109725+0000","last_fullsized":"2024-05-12T10:58:36.109725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:36.109655+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:36.109655+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.109655+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:12:37.883350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.522177+0000","last_change":"2024-05-12T10:58:34.522199+0000","last_active":"2024-05-12T10:58:34.522177+0000","last_peered":"2024-05-12T10:58:34.522177+0000","last_clean":"2024-05-12T10:58:34.522177+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:58:34.522177+0000","last_undegraded":"2024-05-12T10:58:34.522177+0000","last_fullsized":"2024-05-12T10:58:34.522177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:34.522112+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:34.522112+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.522112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:11:44.263130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.286784+0000","last_change":"2024-05-12T10:58:39.286843+0000","last_active":"2024-05-12T10:58:39.286784+0000","last_peered":"2024-05-12T10:58:39.286784+0000","last_clean":"2024-05-12T10:58:39.286784+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:58:39.286784+0000","last_undegraded":"2024-05-12T10:58:39.286784+0000","last_fullsized":"2024-05-12T10:58:39.286784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:39.286579+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:39.286579+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.286579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:27:03.990339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.665250+0000","last_change":"2024-05-12T10:58:40.665311+0000","last_active":"2024-05-12T10:58:40.665250+0000","last_peered":"2024-05-12T10:58:40.665250+0000","last_clean":"2024-05-12T10:58:40.665250+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:58:40.665250+0000","last_undegraded":"2024-05-12T10:58:40.665250+0000","last_fullsized":"2024-05-12T10:58:40.665250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:40.665065+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:40.665065+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.665065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:29:17.657952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.605222+0000","last_change":"2024-05-12T10:58:43.605341+0000","last_active":"2024-05-12T10:58:43.605222+0000","last_peered":"2024-05-12T10:58:43.605222+0000","last_clean":"2024-05-12T10:58:43.605222+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:58:43.605222+0000","last_undegraded":"2024-05-12T10:58:43.605222+0000","last_fullsized":"2024-05-12T10:58:43.605222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-05-12T10:58:43.604999+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-05-12T10:58:43.604999+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.604999+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:35:01.280337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'11","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.371416+0000","last_change":"2024-05-12T10:58:47.371480+0000","last_active":"2024-05-12T10:58:47.371416+0000","last_peered":"2024-05-12T10:58:47.371416+0000","last_clean":"2024-05-12T10:58:47.371416+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:58:47.371416+0000","last_undegraded":"2024-05-12T10:58:47.371416+0000","last_fullsized":"2024-05-12T10:58:47.371416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-12T10:58:47.371239+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-12T10:58:47.371239+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.371239+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:14:38.417159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'9","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:28.669147+0000","last_change":"2024-05-12T10:50:36.914559+0000","last_active":"2024-05-12T10:58:28.669147+0000","last_peered":"2024-05-12T10:58:28.669147+0000","last_clean":"2024-05-12T10:58:28.669147+0000","last_became_active":"2024-05-12T10:50:36.914327+0000","last_became_peered":"2024-05-12T10:50:36.914327+0000","last_unstale":"2024-05-12T10:58:28.669147+0000","last_undegraded":"2024-05-12T10:58:28.669147+0000","last_fullsized":"2024-05-12T10:58:28.669147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:49:54.587538+0000","last_clean_scrub_stamp":"2024-05-12T10:49:54.587538+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.410708+0000","last_change":"2024-05-12T10:58:45.410770+0000","last_active":"2024-05-12T10:58:45.410708+0000","last_peered":"2024-05-12T10:58:45.410708+0000","last_clean":"2024-05-12T10:58:45.410708+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:58:45.410708+0000","last_undegraded":"2024-05-12T10:58:45.410708+0000","last_fullsized":"2024-05-12T10:58:45.410708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:45.410511+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:45.410511+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.410511+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:57:36.763021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.788237+0000","last_change":"2024-05-12T10:58:44.788300+0000","last_active":"2024-05-12T10:58:44.788237+0000","last_peered":"2024-05-12T10:58:44.788237+0000","last_clean":"2024-05-12T10:58:44.788237+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:58:44.788237+0000","last_undegraded":"2024-05-12T10:58:44.788237+0000","last_fullsized":"2024-05-12T10:58:44.788237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:44.788055+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:44.788055+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.788055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:59:21.765128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.557418+0000","last_change":"2024-05-12T10:58:36.557533+0000","last_active":"2024-05-12T10:58:36.557418+0000","last_peered":"2024-05-12T10:58:36.557418+0000","last_clean":"2024-05-12T10:58:36.557418+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:58:36.557418+0000","last_undegraded":"2024-05-12T10:58:36.557418+0000","last_fullsized":"2024-05-12T10:58:36.557418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:36.557152+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:36.557152+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.557152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:28:33.516575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.686494+0000","last_change":"2024-05-12T10:58:34.686557+0000","last_active":"2024-05-12T10:58:34.686494+0000","last_peered":"2024-05-12T10:58:34.686494+0000","last_clean":"2024-05-12T10:58:34.686494+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:58:34.686494+0000","last_undegraded":"2024-05-12T10:58:34.686494+0000","last_fullsized":"2024-05-12T10:58:34.686494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:34.686329+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:34.686329+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.686329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:34:08.295632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.099288+0000","last_change":"2024-05-12T10:58:35.099307+0000","last_active":"2024-05-12T10:58:35.099288+0000","last_peered":"2024-05-12T10:58:35.099288+0000","last_clean":"2024-05-12T10:58:35.099288+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:58:35.099288+0000","last_undegraded":"2024-05-12T10:58:35.099288+0000","last_fullsized":"2024-05-12T10:58:35.099288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:35.099225+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:35.099225+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.099225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:26:30.094717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.934209+0000","last_change":"2024-05-12T10:58:38.934232+0000","last_active":"2024-05-12T10:58:38.934209+0000","last_peered":"2024-05-12T10:58:38.934209+0000","last_clean":"2024-05-12T10:58:38.934209+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:58:38.934209+0000","last_undegraded":"2024-05-12T10:58:38.934209+0000","last_fullsized":"2024-05-12T10:58:38.934209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:38.934128+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:38.934128+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.934128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:07:47.338676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.371813+0000","last_change":"2024-05-12T10:58:48.371874+0000","last_active":"2024-05-12T10:58:48.371813+0000","last_peered":"2024-05-12T10:58:48.371813+0000","last_clean":"2024-05-12T10:58:48.371813+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:58:48.371813+0000","last_undegraded":"2024-05-12T10:58:48.371813+0000","last_fullsized":"2024-05-12T10:58:48.371813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:48.371633+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:48.371633+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.371633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:30.720605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9475,"ondisk_log_size":9475,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3837358,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2108,"num_write_kb":4018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7831552,"data_stored":7674716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2119,"ondisk_log_size":2119,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542256,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62596,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309244,"statfs":{"total":96636764160,"available":96572665856,"internally_reserved":0,"allocated":913408,"data_stored":716485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542257,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79580,"kb_used_data":4052,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94292260,"statfs":{"total":96636764160,"available":96555274240,"internally_reserved":0,"allocated":4149248,"data_stored":3958698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542257,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53696,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318144,"statfs":{"total":96636764160,"available":96581779456,"internally_reserved":0,"allocated":319488,"data_stored":126179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542259,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45372,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326468,"statfs":{"total":96636764160,"available":96590303232,"internally_reserved":0,"allocated":315392,"data_stored":125914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542257,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97636,"kb_used_data":4060,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94274204,"statfs":{"total":96636764160,"available":96536784896,"internally_reserved":0,"allocated":4157440,"data_stored":3958862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542256,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57860,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313980,"statfs":{"total":96636764160,"available":96577515520,"internally_reserved":0,"allocated":323584,"data_stored":126148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542257,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67524,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94304316,"statfs":{"total":96636764160,"available":96567619584,"internally_reserved":0,"allocated":323584,"data_stored":125745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542257,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58432,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313408,"statfs":{"total":96636764160,"available":96576929792,"internally_reserved":0,"allocated":909312,"data_stored":715829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3858432,"data_stored":3834061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3850240,"data_stored":3833897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:58:56.403 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:56.404 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-12T10:49:54.587538+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=49, tm_sec=54, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=10, tm_min=58, tm_sec=30, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T10:58:56.404 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-12T10:59:16.405 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T10:59:16.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.562+0000 7f4738e00640 1 Processor -- start 2024-05-12T10:59:16.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.562+0000 7f4738e00640 1 -- start start 2024-05-12T10:59:16.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.562+0000 7f4738e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f473415cb30 0x7f47340c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.562+0000 7f4738e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47340c6560 0x7f47340c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.562+0000 7f4738e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47340ca850 con 0x7f4734152a90 2024-05-12T10:59:16.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.562+0000 7f4738e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f47340c4f80 con 0x7f473415cb30 2024-05-12T10:59:16.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.562+0000 7f4738e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f47340cae10 con 0x7f47340c6560 2024-05-12T10:59:16.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.562+0000 7f4729400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f473415cb30 0x7f47340c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.562+0000 7f4732800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47340c6560 0x7f47340c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.562+0000 7f4731e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4734152a90 0x7f47341593b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.115:56134/0 (socket says 172.21.15.115:56134) 2024-05-12T10:59:16.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.566+0000 7f4731e00640 1 -- 172.21.15.115:0/2874410870 learned_addr learned my addr 172.21.15.115:0/2874410870 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:59:16.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.566+0000 7f4732800640 1 -- 172.21.15.115:0/2874410870 >> v2:172.21.15.134:3300/0 conn(0x7f473415cb30 msgr2=0x7f47340c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:16.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.566+0000 7f4732800640 1 --2- 172.21.15.115:0/2874410870 >> v2:172.21.15.134:3300/0 conn(0x7f473415cb30 0x7f47340c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.566+0000 7f4732800640 1 -- 172.21.15.115:0/2874410870 >> v1:172.21.15.134:6789/0 conn(0x7f4734152a90 legacy=0x7f47341593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:16.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.566+0000 7f4732800640 1 -- 172.21.15.115:0/2874410870 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47340cab30 con 0x7f47340c6560 2024-05-12T10:59:16.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.566+0000 7f4729400640 1 --2- 172.21.15.115:0/2874410870 >> v2:172.21.15.134:3300/0 conn(0x7f473415cb30 0x7f47340c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:59:16.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.566+0000 7f4732800640 1 --2- 172.21.15.115:0/2874410870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47340c6560 0x7f47340c8f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f472c009d90 tx=0x7f472c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3f44f26a922ee1e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:16.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4731400640 1 -- 172.21.15.115:0/2874410870 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0b2070 con 0x7f47340c6560 2024-05-12T10:59:16.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4731400640 1 -- 172.21.15.115:0/2874410870 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472c0a5830 con 0x7f47340c6560 2024-05-12T10:59:16.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4731400640 1 -- 172.21.15.115:0/2874410870 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0a5c00 con 0x7f47340c6560 2024-05-12T10:59:16.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 -- 172.21.15.115:0/2874410870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47340c6560 msgr2=0x7f47340c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:16.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 --2- 172.21.15.115:0/2874410870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47340c6560 0x7f47340c8f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f472c009d90 tx=0x7f472c01c970 comp rx=0 tx=0).stop 2024-05-12T10:59:16.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 -- 172.21.15.115:0/2874410870 shutdown_connections 2024-05-12T10:59:16.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 --2- 172.21.15.115:0/2874410870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47340c6560 0x7f47340c8f30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 --2- 172.21.15.115:0/2874410870 >> v2:172.21.15.134:3300/0 conn(0x7f473415cb30 0x7f47340c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 -- 172.21.15.115:0/2874410870 >> 172.21.15.115:0/2874410870 conn(0x7f47340681c0 msgr2=0x7f47340685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:16.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 -- 172.21.15.115:0/2874410870 shutdown_connections 2024-05-12T10:59:16.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 -- 172.21.15.115:0/2874410870 wait complete. 2024-05-12T10:59:16.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 Processor -- start 2024-05-12T10:59:16.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 -- start start 2024-05-12T10:59:16.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47340c6560 0x7f4734150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4734152a90 0x7f473414c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473415cb30 0x7f47341616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4734152ff0 con 0x7f4734152a90 2024-05-12T10:59:16.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4734152e70 con 0x7f473415cb30 2024-05-12T10:59:16.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4738e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f47340c7e20 con 0x7f47340c6560 2024-05-12T10:59:16.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4729400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4734152a90 0x7f473414c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4729400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4734152a90 0x7f473414c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40514/0 (socket says 172.21.15.115:40514) 2024-05-12T10:59:16.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4729400640 1 -- 172.21.15.115:0/982625419 learned_addr learned my addr 172.21.15.115:0/982625419 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:16.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4732800640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473415cb30 0x7f47341616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4731e00640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47340c6560 0x7f4734150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4729400640 1 -- 172.21.15.115:0/982625419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47340c6560 msgr2=0x7f4734150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:16.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4729400640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47340c6560 0x7f4734150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4729400640 1 -- 172.21.15.115:0/982625419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473415cb30 msgr2=0x7f47341616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:16.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4729400640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473415cb30 0x7f47341616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.570+0000 7f4729400640 1 -- 172.21.15.115:0/982625419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4734151a80 con 0x7f4734152a90 2024-05-12T10:59:16.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f4732800640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473415cb30 0x7f47341616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:59:16.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f4729400640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4734152a90 0x7f473414c800 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f471c00ebe0 tx=0x7f471c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:16.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f472aa00640 1 -- 172.21.15.115:0/982625419 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c017070 con 0x7f4734152a90 2024-05-12T10:59:16.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f472aa00640 1 -- 172.21.15.115:0/982625419 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f471c00cc30 con 0x7f4734152a90 2024-05-12T10:59:16.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f4738e00640 1 -- 172.21.15.115:0/982625419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4734151d60 con 0x7f4734152a90 2024-05-12T10:59:16.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f472aa00640 1 -- 172.21.15.115:0/982625419 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c013470 con 0x7f4734152a90 2024-05-12T10:59:16.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f4738e00640 1 -- 172.21.15.115:0/982625419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473414ff10 con 0x7f4734152a90 2024-05-12T10:59:16.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f4738e00640 1 -- 172.21.15.115:0/982625419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4734069730 con 0x7f4734152a90 2024-05-12T10:59:16.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f472aa00640 1 -- 172.21.15.115:0/982625419 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f471c01a070 con 0x7f4734152a90 2024-05-12T10:59:16.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f472aa00640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f471006f400 0x7f47100718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f472aa00640 1 -- 172.21.15.115:0/982625419 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f471c08f960 con 0x7f4734152a90 2024-05-12T10:59:16.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.574+0000 7f4731e00640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f471006f400 0x7f47100718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.578+0000 7f4731e00640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f471006f400 0x7f47100718c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4724007fd0 tx=0x7f4724009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:16.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.582+0000 7f472aa00640 1 -- 172.21.15.115:0/982625419 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f471c05c4d0 con 0x7f4734152a90 2024-05-12T10:59:16.728 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.738+0000 7f4738e00640 1 -- 172.21.15.115:0/982625419 --> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4734162e40 con 0x7f471006f400 2024-05-12T10:59:16.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.746+0000 7f472aa00640 1 -- 172.21.15.115:0/982625419 <== mgr.4098 v2:172.21.15.115:6832/1265716555 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333962 (secure 0 0 0) 0x7f4734162e40 con 0x7f471006f400 2024-05-12T10:59:16.739 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:59:16.742 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-05-12T10:59:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 -- 172.21.15.115:0/982625419 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f471006f400 msgr2=0x7f47100718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f471006f400 0x7f47100718c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4724007fd0 tx=0x7f4724009040 comp rx=0 tx=0).stop 2024-05-12T10:59:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 -- 172.21.15.115:0/982625419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4734152a90 msgr2=0x7f473414c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4734152a90 0x7f473414c800 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f471c00ebe0 tx=0x7f471c00c520 comp rx=0 tx=0).stop 2024-05-12T10:59:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 -- 172.21.15.115:0/982625419 shutdown_connections 2024-05-12T10:59:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f471006f400 0x7f47100718c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473415cb30 0x7f47341616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4734152a90 0x7f473414c800 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 --2- 172.21.15.115:0/982625419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47340c6560 0x7f4734150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 -- 172.21.15.115:0/982625419 >> 172.21.15.115:0/982625419 conn(0x7f47340681c0 msgr2=0x7f4734072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 -- 172.21.15.115:0/982625419 shutdown_connections 2024-05-12T10:59:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.750+0000 7f4738e00640 1 -- 172.21.15.115:0/982625419 wait complete. 2024-05-12T10:59:16.760 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-05-12T10:59:15.938826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4427726,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":5199,"num_read_kb":21004348,"num_write":11426,"num_write_kb":25171470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12171,"ondisk_log_size":12171,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":522696,"kb_used_data":11144,"kb_used_omap":12,"kb_used_meta":511475,"kb_avail":754452024,"statfs":{"total":773094113280,"available":772558872576,"internally_reserved":0,"allocated":11411456,"data_stored":9853860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":523750961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003851"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.142617+0000","last_change":"2024-05-12T10:58:34.142674+0000","last_active":"2024-05-12T10:58:34.142617+0000","last_peered":"2024-05-12T10:58:34.142617+0000","last_clean":"2024-05-12T10:58:34.142617+0000","last_became_active":"2024-05-12T10:49:54.639696+0000","last_became_peered":"2024-05-12T10:49:54.639696+0000","last_unstale":"2024-05-12T10:58:34.142617+0000","last_undegraded":"2024-05-12T10:58:34.142617+0000","last_fullsized":"2024-05-12T10:58:34.142617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-05-12T10:58:34.142542+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-05-12T10:58:34.142542+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.142542+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:03:55.474574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.548194+0000","last_change":"2024-05-12T10:58:36.548219+0000","last_active":"2024-05-12T10:58:36.548194+0000","last_peered":"2024-05-12T10:58:36.548194+0000","last_clean":"2024-05-12T10:58:36.548194+0000","last_became_active":"2024-05-12T10:49:55.635608+0000","last_became_peered":"2024-05-12T10:49:55.635608+0000","last_unstale":"2024-05-12T10:58:36.548194+0000","last_undegraded":"2024-05-12T10:58:36.548194+0000","last_fullsized":"2024-05-12T10:58:36.548194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:36.548129+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:36.548129+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.548129+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:51:17.817269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'315","reported_seq":524,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:50.400211+0000","last_change":"2024-05-12T10:58:50.400254+0000","last_active":"2024-05-12T10:58:50.400211+0000","last_peered":"2024-05-12T10:58:50.400211+0000","last_clean":"2024-05-12T10:58:50.400211+0000","last_became_active":"2024-05-12T10:50:00.395552+0000","last_became_peered":"2024-05-12T10:50:00.395552+0000","last_unstale":"2024-05-12T10:58:50.400211+0000","last_undegraded":"2024-05-12T10:58:50.400211+0000","last_fullsized":"2024-05-12T10:58:50.400211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'315","last_scrub_stamp":"2024-05-12T10:58:50.400108+0000","last_deep_scrub":"28'315","last_deep_scrub_stamp":"2024-05-12T10:58:50.400108+0000","last_clean_scrub_stamp":"2024-05-12T10:58:50.400108+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:55:56.118682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.545153+0000","last_change":"2024-05-12T10:58:38.545205+0000","last_active":"2024-05-12T10:58:38.545153+0000","last_peered":"2024-05-12T10:58:38.545153+0000","last_clean":"2024-05-12T10:58:38.545153+0000","last_became_active":"2024-05-12T10:49:54.618988+0000","last_became_peered":"2024-05-12T10:49:54.618988+0000","last_unstale":"2024-05-12T10:58:38.545153+0000","last_undegraded":"2024-05-12T10:58:38.545153+0000","last_fullsized":"2024-05-12T10:58:38.545153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-12T10:58:38.545052+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-12T10:58:38.545052+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.545052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:44:07.311593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:32.126290+0000","last_change":"2024-05-12T10:58:32.126311+0000","last_active":"2024-05-12T10:58:32.126290+0000","last_peered":"2024-05-12T10:58:32.126290+0000","last_clean":"2024-05-12T10:58:32.126290+0000","last_became_active":"2024-05-12T10:49:55.624643+0000","last_became_peered":"2024-05-12T10:49:55.624643+0000","last_unstale":"2024-05-12T10:58:32.126290+0000","last_undegraded":"2024-05-12T10:58:32.126290+0000","last_fullsized":"2024-05-12T10:58:32.126290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:32.126224+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:32.126224+0000","last_clean_scrub_stamp":"2024-05-12T10:58:32.126224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:40:36.607439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'342","reported_seq":571,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.248389+0000","last_change":"2024-05-12T10:58:44.248509+0000","last_active":"2024-05-12T10:58:44.248389+0000","last_peered":"2024-05-12T10:58:44.248389+0000","last_clean":"2024-05-12T10:58:44.248389+0000","last_became_active":"2024-05-12T10:49:59.675023+0000","last_became_peered":"2024-05-12T10:49:59.675023+0000","last_unstale":"2024-05-12T10:58:44.248389+0000","last_undegraded":"2024-05-12T10:58:44.248389+0000","last_fullsized":"2024-05-12T10:58:44.248389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'342","last_scrub_stamp":"2024-05-12T10:58:44.248086+0000","last_deep_scrub":"28'342","last_deep_scrub_stamp":"2024-05-12T10:58:44.248086+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.248086+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:06:06.817825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'7","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.505529+0000","last_change":"2024-05-12T10:58:43.505603+0000","last_active":"2024-05-12T10:58:43.505529+0000","last_peered":"2024-05-12T10:58:43.505529+0000","last_clean":"2024-05-12T10:58:43.505529+0000","last_became_active":"2024-05-12T10:49:54.644771+0000","last_became_peered":"2024-05-12T10:49:54.644771+0000","last_unstale":"2024-05-12T10:58:43.505529+0000","last_undegraded":"2024-05-12T10:58:43.505529+0000","last_fullsized":"2024-05-12T10:58:43.505529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:43.505361+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:43.505361+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.505361+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:02:51.923759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:49.799452+0000","last_change":"2024-05-12T10:58:49.799574+0000","last_active":"2024-05-12T10:58:49.799452+0000","last_peered":"2024-05-12T10:58:49.799452+0000","last_clean":"2024-05-12T10:58:49.799452+0000","last_became_active":"2024-05-12T10:49:55.642130+0000","last_became_peered":"2024-05-12T10:49:55.642130+0000","last_unstale":"2024-05-12T10:58:49.799452+0000","last_undegraded":"2024-05-12T10:58:49.799452+0000","last_fullsized":"2024-05-12T10:58:49.799452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:49.799244+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:49.799244+0000","last_clean_scrub_stamp":"2024-05-12T10:58:49.799244+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:30:48.230026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'284","reported_seq":466,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.278209+0000","last_change":"2024-05-12T10:58:45.278347+0000","last_active":"2024-05-12T10:58:45.278209+0000","last_peered":"2024-05-12T10:58:45.278209+0000","last_clean":"2024-05-12T10:58:45.278209+0000","last_became_active":"2024-05-12T10:49:59.678283+0000","last_became_peered":"2024-05-12T10:49:59.678283+0000","last_unstale":"2024-05-12T10:58:45.278209+0000","last_undegraded":"2024-05-12T10:58:45.278209+0000","last_fullsized":"2024-05-12T10:58:45.278209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'284","last_scrub_stamp":"2024-05-12T10:58:45.277951+0000","last_deep_scrub":"28'284","last_deep_scrub_stamp":"2024-05-12T10:58:45.277951+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.277951+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:46:35.371891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":274,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.456868+0000","last_change":"2024-05-12T10:58:44.456937+0000","last_active":"2024-05-12T10:58:44.456868+0000","last_peered":"2024-05-12T10:58:44.456868+0000","last_clean":"2024-05-12T10:58:44.456868+0000","last_became_active":"2024-05-12T10:49:54.658660+0000","last_became_peered":"2024-05-12T10:49:54.658660+0000","last_unstale":"2024-05-12T10:58:44.456868+0000","last_undegraded":"2024-05-12T10:58:44.456868+0000","last_fullsized":"2024-05-12T10:58:44.456868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-12T10:58:44.456703+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-12T10:58:44.456703+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.456703+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:45:15.271302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.842844+0000","last_change":"2024-05-12T10:58:48.842901+0000","last_active":"2024-05-12T10:58:48.842844+0000","last_peered":"2024-05-12T10:58:48.842844+0000","last_clean":"2024-05-12T10:58:48.842844+0000","last_became_active":"2024-05-12T10:49:55.641745+0000","last_became_peered":"2024-05-12T10:49:55.641745+0000","last_unstale":"2024-05-12T10:58:48.842844+0000","last_undegraded":"2024-05-12T10:58:48.842844+0000","last_fullsized":"2024-05-12T10:58:48.842844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-05-12T10:58:48.842674+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-05-12T10:58:48.842674+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.842674+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:25:01.678597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'263","reported_seq":438,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.333612+0000","last_change":"2024-05-12T10:58:41.333677+0000","last_active":"2024-05-12T10:58:41.333612+0000","last_peered":"2024-05-12T10:58:41.333612+0000","last_clean":"2024-05-12T10:58:41.333612+0000","last_became_active":"2024-05-12T10:49:59.662321+0000","last_became_peered":"2024-05-12T10:49:59.662321+0000","last_unstale":"2024-05-12T10:58:41.333612+0000","last_undegraded":"2024-05-12T10:58:41.333612+0000","last_fullsized":"2024-05-12T10:58:41.333612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'263","last_scrub_stamp":"2024-05-12T10:58:41.333405+0000","last_deep_scrub":"28'263","last_deep_scrub_stamp":"2024-05-12T10:58:41.333405+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.333405+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:11:26.711105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.654598+0000","last_change":"2024-05-12T10:58:44.654656+0000","last_active":"2024-05-12T10:58:44.654598+0000","last_peered":"2024-05-12T10:58:44.654598+0000","last_clean":"2024-05-12T10:58:44.654598+0000","last_became_active":"2024-05-12T10:49:55.645729+0000","last_became_peered":"2024-05-12T10:49:55.645729+0000","last_unstale":"2024-05-12T10:58:44.654598+0000","last_undegraded":"2024-05-12T10:58:44.654598+0000","last_fullsized":"2024-05-12T10:58:44.654598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:44.654426+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:44.654426+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.654426+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:06:18.572152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'7","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.549501+0000","last_change":"2024-05-12T10:58:42.549501+0000","last_active":"2024-05-12T10:58:42.549501+0000","last_peered":"2024-05-12T10:58:42.549501+0000","last_clean":"2024-05-12T10:58:42.549501+0000","last_became_active":"2024-05-12T10:49:54.641361+0000","last_became_peered":"2024-05-12T10:49:54.641361+0000","last_unstale":"2024-05-12T10:58:42.549501+0000","last_undegraded":"2024-05-12T10:58:42.549501+0000","last_fullsized":"2024-05-12T10:58:42.549501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:42.549142+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:42.549142+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.549142+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:52:59.864963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'316","reported_seq":530,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.292719+0000","last_change":"2024-05-12T10:58:40.292719+0000","last_active":"2024-05-12T10:58:40.292719+0000","last_peered":"2024-05-12T10:58:40.292719+0000","last_clean":"2024-05-12T10:58:40.292719+0000","last_became_active":"2024-05-12T10:49:59.659180+0000","last_became_peered":"2024-05-12T10:49:59.659180+0000","last_unstale":"2024-05-12T10:58:40.292719+0000","last_undegraded":"2024-05-12T10:58:40.292719+0000","last_fullsized":"2024-05-12T10:58:40.292719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'316","last_scrub_stamp":"2024-05-12T10:58:40.292455+0000","last_deep_scrub":"28'316","last_deep_scrub_stamp":"2024-05-12T10:58:40.292455+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.292455+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:46:07.860190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":737280,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.466632+0000","last_change":"2024-05-12T10:58:43.466632+0000","last_active":"2024-05-12T10:58:43.466632+0000","last_peered":"2024-05-12T10:58:43.466632+0000","last_clean":"2024-05-12T10:58:43.466632+0000","last_became_active":"2024-05-12T10:49:55.617702+0000","last_became_peered":"2024-05-12T10:49:55.617702+0000","last_unstale":"2024-05-12T10:58:43.466632+0000","last_undegraded":"2024-05-12T10:58:43.466632+0000","last_fullsized":"2024-05-12T10:58:43.466632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:43.466436+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:43.466436+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.466436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:48:58.129158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:32.921958+0000","last_change":"2024-05-12T10:58:32.921958+0000","last_active":"2024-05-12T10:58:32.921958+0000","last_peered":"2024-05-12T10:58:32.921958+0000","last_clean":"2024-05-12T10:58:32.921958+0000","last_became_active":"2024-05-12T10:49:54.619098+0000","last_became_peered":"2024-05-12T10:49:54.619098+0000","last_unstale":"2024-05-12T10:58:32.921958+0000","last_undegraded":"2024-05-12T10:58:32.921958+0000","last_fullsized":"2024-05-12T10:58:32.921958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-05-12T10:58:32.921870+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-05-12T10:58:32.921870+0000","last_clean_scrub_stamp":"2024-05-12T10:58:32.921870+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:21:50.725784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'296","reported_seq":498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.253244+0000","last_change":"2024-05-12T10:58:46.253244+0000","last_active":"2024-05-12T10:58:46.253244+0000","last_peered":"2024-05-12T10:58:46.253244+0000","last_clean":"2024-05-12T10:58:46.253244+0000","last_became_active":"2024-05-12T10:49:59.680987+0000","last_became_peered":"2024-05-12T10:49:59.680987+0000","last_unstale":"2024-05-12T10:58:46.253244+0000","last_undegraded":"2024-05-12T10:58:46.253244+0000","last_fullsized":"2024-05-12T10:58:46.253244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'296","last_scrub_stamp":"2024-05-12T10:58:46.252997+0000","last_deep_scrub":"28'296","last_deep_scrub_stamp":"2024-05-12T10:58:46.252997+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.252997+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:44:47.912927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'9","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.486498+0000","last_change":"2024-05-12T10:58:41.486526+0000","last_active":"2024-05-12T10:58:41.486498+0000","last_peered":"2024-05-12T10:58:41.486498+0000","last_clean":"2024-05-12T10:58:41.486498+0000","last_became_active":"2024-05-12T10:49:55.614855+0000","last_became_peered":"2024-05-12T10:49:55.614855+0000","last_unstale":"2024-05-12T10:58:41.486498+0000","last_undegraded":"2024-05-12T10:58:41.486498+0000","last_fullsized":"2024-05-12T10:58:41.486498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:41.486406+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:41.486406+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.486406+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:58:35.853670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'5","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.969020+0000","last_change":"2024-05-12T10:58:36.969020+0000","last_active":"2024-05-12T10:58:36.969020+0000","last_peered":"2024-05-12T10:58:36.969020+0000","last_clean":"2024-05-12T10:58:36.969020+0000","last_became_active":"2024-05-12T10:49:54.639661+0000","last_became_peered":"2024-05-12T10:49:54.639661+0000","last_unstale":"2024-05-12T10:58:36.969020+0000","last_undegraded":"2024-05-12T10:58:36.969020+0000","last_fullsized":"2024-05-12T10:58:36.969020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:36.968893+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:36.968893+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.968893+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:15:29.343502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'273","reported_seq":455,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.543889+0000","last_change":"2024-05-12T10:58:42.543914+0000","last_active":"2024-05-12T10:58:42.543889+0000","last_peered":"2024-05-12T10:58:42.543889+0000","last_clean":"2024-05-12T10:58:42.543889+0000","last_became_active":"2024-05-12T10:50:36.856826+0000","last_became_peered":"2024-05-12T10:50:36.856826+0000","last_unstale":"2024-05-12T10:58:42.543889+0000","last_undegraded":"2024-05-12T10:58:42.543889+0000","last_fullsized":"2024-05-12T10:58:42.543889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'273","last_scrub_stamp":"2024-05-12T10:58:42.543808+0000","last_deep_scrub":"28'273","last_deep_scrub_stamp":"2024-05-12T10:58:42.543808+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.543808+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:22:27.483480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"28'2","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.186977+0000","last_change":"2024-05-12T10:58:35.186977+0000","last_active":"2024-05-12T10:58:35.186977+0000","last_peered":"2024-05-12T10:58:35.186977+0000","last_clean":"2024-05-12T10:58:35.186977+0000","last_became_active":"2024-05-12T10:49:55.622248+0000","last_became_peered":"2024-05-12T10:49:55.622248+0000","last_unstale":"2024-05-12T10:58:35.186977+0000","last_undegraded":"2024-05-12T10:58:35.186977+0000","last_fullsized":"2024-05-12T10:58:35.186977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-05-12T10:58:35.186730+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-05-12T10:58:35.186730+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.186730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:25:07.265029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.505098+0000","last_change":"2024-05-12T10:58:39.505161+0000","last_active":"2024-05-12T10:58:39.505098+0000","last_peered":"2024-05-12T10:58:39.505098+0000","last_clean":"2024-05-12T10:58:39.505098+0000","last_became_active":"2024-05-12T10:49:54.638821+0000","last_became_peered":"2024-05-12T10:49:54.638821+0000","last_unstale":"2024-05-12T10:58:39.505098+0000","last_undegraded":"2024-05-12T10:58:39.505098+0000","last_fullsized":"2024-05-12T10:58:39.505098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-12T10:58:39.504923+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-12T10:58:39.504923+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.504923+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:49:06.339145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'296","reported_seq":508,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.279651+0000","last_change":"2024-05-12T10:58:48.279651+0000","last_active":"2024-05-12T10:58:48.279651+0000","last_peered":"2024-05-12T10:58:48.279651+0000","last_clean":"2024-05-12T10:58:48.279651+0000","last_became_active":"2024-05-12T10:50:36.857477+0000","last_became_peered":"2024-05-12T10:50:36.857477+0000","last_unstale":"2024-05-12T10:58:48.279651+0000","last_undegraded":"2024-05-12T10:58:48.279651+0000","last_fullsized":"2024-05-12T10:58:48.279651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'296","last_scrub_stamp":"2024-05-12T10:58:48.279374+0000","last_deep_scrub":"28'296","last_deep_scrub_stamp":"2024-05-12T10:58:48.279374+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.279374+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:31:10.570737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":700416,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.070274+0000","last_change":"2024-05-12T10:58:37.070274+0000","last_active":"2024-05-12T10:58:37.070274+0000","last_peered":"2024-05-12T10:58:37.070274+0000","last_clean":"2024-05-12T10:58:37.070274+0000","last_became_active":"2024-05-12T10:49:55.612506+0000","last_became_peered":"2024-05-12T10:49:55.612506+0000","last_unstale":"2024-05-12T10:58:37.070274+0000","last_undegraded":"2024-05-12T10:58:37.070274+0000","last_fullsized":"2024-05-12T10:58:37.070274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:37.070162+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:37.070162+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.070162+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:29:16.798385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.701947+0000","last_change":"2024-05-12T10:58:38.702019+0000","last_active":"2024-05-12T10:58:38.701947+0000","last_peered":"2024-05-12T10:58:38.701947+0000","last_clean":"2024-05-12T10:58:38.701947+0000","last_became_active":"2024-05-12T10:49:54.642592+0000","last_became_peered":"2024-05-12T10:49:54.642592+0000","last_unstale":"2024-05-12T10:58:38.701947+0000","last_undegraded":"2024-05-12T10:58:38.701947+0000","last_fullsized":"2024-05-12T10:58:38.701947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:38.701781+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:38.701781+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.701781+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:38:20.597085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'259","reported_seq":423,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.250521+0000","last_change":"2024-05-12T10:58:47.250587+0000","last_active":"2024-05-12T10:58:47.250521+0000","last_peered":"2024-05-12T10:58:47.250521+0000","last_clean":"2024-05-12T10:58:47.250521+0000","last_became_active":"2024-05-12T10:50:00.392241+0000","last_became_peered":"2024-05-12T10:50:00.392241+0000","last_unstale":"2024-05-12T10:58:47.250521+0000","last_undegraded":"2024-05-12T10:58:47.250521+0000","last_fullsized":"2024-05-12T10:58:47.250521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'259","last_scrub_stamp":"2024-05-12T10:58:47.250332+0000","last_deep_scrub":"28'259","last_deep_scrub_stamp":"2024-05-12T10:58:47.250332+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.250332+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:54:32.833130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":532480,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.549892+0000","last_change":"2024-05-12T10:58:35.549892+0000","last_active":"2024-05-12T10:58:35.549892+0000","last_peered":"2024-05-12T10:58:35.549892+0000","last_clean":"2024-05-12T10:58:35.549892+0000","last_became_active":"2024-05-12T10:49:55.629389+0000","last_became_peered":"2024-05-12T10:49:55.629389+0000","last_unstale":"2024-05-12T10:58:35.549892+0000","last_undegraded":"2024-05-12T10:58:35.549892+0000","last_fullsized":"2024-05-12T10:58:35.549892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:35.549734+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:35.549734+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.549734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:05:29.059449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'35","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.943339+0000","last_change":"2024-05-12T10:58:35.943339+0000","last_active":"2024-05-12T10:58:35.943339+0000","last_peered":"2024-05-12T10:58:35.943339+0000","last_clean":"2024-05-12T10:58:35.943339+0000","last_became_active":"2024-05-12T10:49:54.628972+0000","last_became_peered":"2024-05-12T10:49:54.628972+0000","last_unstale":"2024-05-12T10:58:35.943339+0000","last_undegraded":"2024-05-12T10:58:35.943339+0000","last_fullsized":"2024-05-12T10:58:35.943339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'35","last_scrub_stamp":"2024-05-12T10:58:35.943254+0000","last_deep_scrub":"28'35","last_deep_scrub_stamp":"2024-05-12T10:58:35.943254+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.943254+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:57:27.102554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'270","reported_seq":442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:49.421412+0000","last_change":"2024-05-12T10:58:49.421440+0000","last_active":"2024-05-12T10:58:49.421412+0000","last_peered":"2024-05-12T10:58:49.421412+0000","last_clean":"2024-05-12T10:58:49.421412+0000","last_became_active":"2024-05-12T10:50:00.395534+0000","last_became_peered":"2024-05-12T10:50:00.395534+0000","last_unstale":"2024-05-12T10:58:49.421412+0000","last_undegraded":"2024-05-12T10:58:49.421412+0000","last_fullsized":"2024-05-12T10:58:49.421412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'270","last_scrub_stamp":"2024-05-12T10:58:49.421308+0000","last_deep_scrub":"28'270","last_deep_scrub_stamp":"2024-05-12T10:58:49.421308+0000","last_clean_scrub_stamp":"2024-05-12T10:58:49.421308+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:58:03.273469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'9","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.002637+0000","last_change":"2024-05-12T10:58:41.002665+0000","last_active":"2024-05-12T10:58:41.002637+0000","last_peered":"2024-05-12T10:58:41.002637+0000","last_clean":"2024-05-12T10:58:41.002637+0000","last_became_active":"2024-05-12T10:49:55.611746+0000","last_became_peered":"2024-05-12T10:49:55.611746+0000","last_unstale":"2024-05-12T10:58:41.002637+0000","last_undegraded":"2024-05-12T10:58:41.002637+0000","last_fullsized":"2024-05-12T10:58:41.002637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:41.002541+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:41.002541+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.002541+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:16:13.457729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'2","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.485087+0000","last_change":"2024-05-12T10:58:40.485152+0000","last_active":"2024-05-12T10:58:40.485087+0000","last_peered":"2024-05-12T10:58:40.485087+0000","last_clean":"2024-05-12T10:58:40.485087+0000","last_became_active":"2024-05-12T10:49:54.639204+0000","last_became_peered":"2024-05-12T10:49:54.639204+0000","last_unstale":"2024-05-12T10:58:40.485087+0000","last_undegraded":"2024-05-12T10:58:40.485087+0000","last_fullsized":"2024-05-12T10:58:40.485087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-05-12T10:58:40.484916+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-05-12T10:58:40.484916+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.484916+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:58:05.245457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'261","reported_seq":431,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.234943+0000","last_change":"2024-05-12T10:58:46.234973+0000","last_active":"2024-05-12T10:58:46.234943+0000","last_peered":"2024-05-12T10:58:46.234943+0000","last_clean":"2024-05-12T10:58:46.234943+0000","last_became_active":"2024-05-12T10:50:00.383145+0000","last_became_peered":"2024-05-12T10:50:00.383145+0000","last_unstale":"2024-05-12T10:58:46.234943+0000","last_undegraded":"2024-05-12T10:58:46.234943+0000","last_fullsized":"2024-05-12T10:58:46.234943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'261","last_scrub_stamp":"2024-05-12T10:58:46.234856+0000","last_deep_scrub":"28'261","last_deep_scrub_stamp":"2024-05-12T10:58:46.234856+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.234856+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:20:49.430308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.761687+0000","last_change":"2024-05-12T10:58:43.761745+0000","last_active":"2024-05-12T10:58:43.761687+0000","last_peered":"2024-05-12T10:58:43.761687+0000","last_clean":"2024-05-12T10:58:43.761687+0000","last_became_active":"2024-05-12T10:49:55.620949+0000","last_became_peered":"2024-05-12T10:49:55.620949+0000","last_unstale":"2024-05-12T10:58:43.761687+0000","last_undegraded":"2024-05-12T10:58:43.761687+0000","last_fullsized":"2024-05-12T10:58:43.761687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:43.761518+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:43.761518+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.761518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:56:07.029930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:33.921531+0000","last_change":"2024-05-12T10:58:33.921550+0000","last_active":"2024-05-12T10:58:33.921531+0000","last_peered":"2024-05-12T10:58:33.921531+0000","last_clean":"2024-05-12T10:58:33.921531+0000","last_became_active":"2024-05-12T10:49:54.620022+0000","last_became_peered":"2024-05-12T10:49:54.620022+0000","last_unstale":"2024-05-12T10:58:33.921531+0000","last_undegraded":"2024-05-12T10:58:33.921531+0000","last_fullsized":"2024-05-12T10:58:33.921531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T10:58:33.921460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T10:58:33.921460+0000","last_clean_scrub_stamp":"2024-05-12T10:58:33.921460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:55:51.959435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'282","reported_seq":474,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.955276+0000","last_change":"2024-05-12T10:58:44.955336+0000","last_active":"2024-05-12T10:58:44.955276+0000","last_peered":"2024-05-12T10:58:44.955276+0000","last_clean":"2024-05-12T10:58:44.955276+0000","last_became_active":"2024-05-12T10:49:59.655016+0000","last_became_peered":"2024-05-12T10:49:59.655016+0000","last_unstale":"2024-05-12T10:58:44.955276+0000","last_undegraded":"2024-05-12T10:58:44.955276+0000","last_fullsized":"2024-05-12T10:58:44.955276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'282","last_scrub_stamp":"2024-05-12T10:58:44.955181+0000","last_deep_scrub":"28'282","last_deep_scrub_stamp":"2024-05-12T10:58:44.955181+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.955181+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:16:19.644683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.226913+0000","last_change":"2024-05-12T10:58:36.227027+0000","last_active":"2024-05-12T10:58:36.226913+0000","last_peered":"2024-05-12T10:58:36.226913+0000","last_clean":"2024-05-12T10:58:36.226913+0000","last_became_active":"2024-05-12T10:49:55.627153+0000","last_became_peered":"2024-05-12T10:49:55.627153+0000","last_unstale":"2024-05-12T10:58:36.226913+0000","last_undegraded":"2024-05-12T10:58:36.226913+0000","last_fullsized":"2024-05-12T10:58:36.226913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:36.226647+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:36.226647+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.226647+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:08:55.065979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.665342+0000","last_change":"2024-05-12T10:58:38.665400+0000","last_active":"2024-05-12T10:58:38.665342+0000","last_peered":"2024-05-12T10:58:38.665342+0000","last_clean":"2024-05-12T10:58:38.665342+0000","last_became_active":"2024-05-12T10:49:54.651181+0000","last_became_peered":"2024-05-12T10:49:54.651181+0000","last_unstale":"2024-05-12T10:58:38.665342+0000","last_undegraded":"2024-05-12T10:58:38.665342+0000","last_fullsized":"2024-05-12T10:58:38.665342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-05-12T10:58:38.665161+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-05-12T10:58:38.665161+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.665161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:43:52.510535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'269","reported_seq":451,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.926380+0000","last_change":"2024-05-12T10:58:47.926422+0000","last_active":"2024-05-12T10:58:47.926380+0000","last_peered":"2024-05-12T10:58:47.926380+0000","last_clean":"2024-05-12T10:58:47.926380+0000","last_became_active":"2024-05-12T10:49:59.676077+0000","last_became_peered":"2024-05-12T10:49:59.676077+0000","last_unstale":"2024-05-12T10:58:47.926380+0000","last_undegraded":"2024-05-12T10:58:47.926380+0000","last_fullsized":"2024-05-12T10:58:47.926380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'269","last_scrub_stamp":"2024-05-12T10:58:47.926288+0000","last_deep_scrub":"28'269","last_deep_scrub_stamp":"2024-05-12T10:58:47.926288+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.926288+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:15:05.111217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.975915+0000","last_change":"2024-05-12T10:58:39.975937+0000","last_active":"2024-05-12T10:58:39.975915+0000","last_peered":"2024-05-12T10:58:39.975915+0000","last_clean":"2024-05-12T10:58:39.975915+0000","last_became_active":"2024-05-12T10:49:55.610401+0000","last_became_peered":"2024-05-12T10:49:55.610401+0000","last_unstale":"2024-05-12T10:58:39.975915+0000","last_undegraded":"2024-05-12T10:58:39.975915+0000","last_fullsized":"2024-05-12T10:58:39.975915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:39.975813+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:39.975813+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.975813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:48:30.642170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'12","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:33.517918+0000","last_change":"2024-05-12T10:58:33.517958+0000","last_active":"2024-05-12T10:58:33.517918+0000","last_peered":"2024-05-12T10:58:33.517918+0000","last_clean":"2024-05-12T10:58:33.517918+0000","last_became_active":"2024-05-12T10:49:54.609009+0000","last_became_peered":"2024-05-12T10:49:54.609009+0000","last_unstale":"2024-05-12T10:58:33.517918+0000","last_undegraded":"2024-05-12T10:58:33.517918+0000","last_fullsized":"2024-05-12T10:58:33.517918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-05-12T10:58:33.517838+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-05-12T10:58:33.517838+0000","last_clean_scrub_stamp":"2024-05-12T10:58:33.517838+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:56:17.746513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'281","reported_seq":457,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.971196+0000","last_change":"2024-05-12T10:58:45.971222+0000","last_active":"2024-05-12T10:58:45.971196+0000","last_peered":"2024-05-12T10:58:45.971196+0000","last_clean":"2024-05-12T10:58:45.971196+0000","last_became_active":"2024-05-12T10:49:59.656310+0000","last_became_peered":"2024-05-12T10:49:59.656310+0000","last_unstale":"2024-05-12T10:58:45.971196+0000","last_undegraded":"2024-05-12T10:58:45.971196+0000","last_fullsized":"2024-05-12T10:58:45.971196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'281","last_scrub_stamp":"2024-05-12T10:58:45.971070+0000","last_deep_scrub":"28'281","last_deep_scrub_stamp":"2024-05-12T10:58:45.971070+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.971070+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:16:04.028036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.120071+0000","last_change":"2024-05-12T10:58:41.120097+0000","last_active":"2024-05-12T10:58:41.120071+0000","last_peered":"2024-05-12T10:58:41.120071+0000","last_clean":"2024-05-12T10:58:41.120071+0000","last_became_active":"2024-05-12T10:49:55.625999+0000","last_became_peered":"2024-05-12T10:49:55.625999+0000","last_unstale":"2024-05-12T10:58:41.120071+0000","last_undegraded":"2024-05-12T10:58:41.120071+0000","last_fullsized":"2024-05-12T10:58:41.120071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:41.119983+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:41.119983+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.119983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:49:02.350792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.501502+0000","last_change":"2024-05-12T10:58:41.501617+0000","last_active":"2024-05-12T10:58:41.501502+0000","last_peered":"2024-05-12T10:58:41.501502+0000","last_clean":"2024-05-12T10:58:41.501502+0000","last_became_active":"2024-05-12T10:49:54.640236+0000","last_became_peered":"2024-05-12T10:49:54.640236+0000","last_unstale":"2024-05-12T10:58:41.501502+0000","last_undegraded":"2024-05-12T10:58:41.501502+0000","last_fullsized":"2024-05-12T10:58:41.501502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:41.501295+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:41.501295+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.501295+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:17:39.339395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'345","reported_seq":565,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.204545+0000","last_change":"2024-05-12T10:58:47.204573+0000","last_active":"2024-05-12T10:58:47.204545+0000","last_peered":"2024-05-12T10:58:47.204545+0000","last_clean":"2024-05-12T10:58:47.204545+0000","last_became_active":"2024-05-12T10:50:00.383739+0000","last_became_peered":"2024-05-12T10:50:00.383739+0000","last_unstale":"2024-05-12T10:58:47.204545+0000","last_undegraded":"2024-05-12T10:58:47.204545+0000","last_fullsized":"2024-05-12T10:58:47.204545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'345","last_scrub_stamp":"2024-05-12T10:58:47.204449+0000","last_deep_scrub":"28'345","last_deep_scrub_stamp":"2024-05-12T10:58:47.204449+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.204449+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:08:53.469342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.523138+0000","last_change":"2024-05-12T10:58:41.523138+0000","last_active":"2024-05-12T10:58:41.523138+0000","last_peered":"2024-05-12T10:58:41.523138+0000","last_clean":"2024-05-12T10:58:41.523138+0000","last_became_active":"2024-05-12T10:50:36.847173+0000","last_became_peered":"2024-05-12T10:50:36.847173+0000","last_unstale":"2024-05-12T10:58:41.523138+0000","last_undegraded":"2024-05-12T10:58:41.523138+0000","last_fullsized":"2024-05-12T10:58:41.523138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:41.523040+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:41.523040+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.523040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:50:59.118706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.653077+0000","last_change":"2024-05-12T10:58:36.653145+0000","last_active":"2024-05-12T10:58:36.653077+0000","last_peered":"2024-05-12T10:58:36.653077+0000","last_clean":"2024-05-12T10:58:36.653077+0000","last_became_active":"2024-05-12T10:49:54.647576+0000","last_became_peered":"2024-05-12T10:49:54.647576+0000","last_unstale":"2024-05-12T10:58:36.653077+0000","last_undegraded":"2024-05-12T10:58:36.653077+0000","last_fullsized":"2024-05-12T10:58:36.653077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:36.652899+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:36.652899+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.652899+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:13:24.070950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'74","reported_seq":139,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.531434+0000","last_change":"2024-05-12T10:58:38.531503+0000","last_active":"2024-05-12T10:58:38.531434+0000","last_peered":"2024-05-12T10:58:38.531434+0000","last_clean":"2024-05-12T10:58:38.531434+0000","last_became_active":"2024-05-12T10:49:45.545592+0000","last_became_peered":"2024-05-12T10:49:45.545592+0000","last_unstale":"2024-05-12T10:58:38.531434+0000","last_undegraded":"2024-05-12T10:58:38.531434+0000","last_fullsized":"2024-05-12T10:58:38.531434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2024-05-12T10:58:38.531259+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2024-05-12T10:58:38.531259+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.531259+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:04:15.854530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'290","reported_seq":478,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.625928+0000","last_change":"2024-05-12T10:58:48.626072+0000","last_active":"2024-05-12T10:58:48.625928+0000","last_peered":"2024-05-12T10:58:48.625928+0000","last_clean":"2024-05-12T10:58:48.625928+0000","last_became_active":"2024-05-12T10:50:00.398122+0000","last_became_peered":"2024-05-12T10:50:00.398122+0000","last_unstale":"2024-05-12T10:58:48.625928+0000","last_undegraded":"2024-05-12T10:58:48.625928+0000","last_fullsized":"2024-05-12T10:58:48.625928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'290","last_scrub_stamp":"2024-05-12T10:58:48.625708+0000","last_deep_scrub":"28'290","last_deep_scrub_stamp":"2024-05-12T10:58:48.625708+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.625708+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:12:39.952823+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:49.340331+0000","last_change":"2024-05-12T10:58:49.340331+0000","last_active":"2024-05-12T10:58:49.340331+0000","last_peered":"2024-05-12T10:58:49.340331+0000","last_clean":"2024-05-12T10:58:49.340331+0000","last_became_active":"2024-05-12T10:49:55.634853+0000","last_became_peered":"2024-05-12T10:49:55.634853+0000","last_unstale":"2024-05-12T10:58:49.340331+0000","last_undegraded":"2024-05-12T10:58:49.340331+0000","last_fullsized":"2024-05-12T10:58:49.340331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:49.339996+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:49.339996+0000","last_clean_scrub_stamp":"2024-05-12T10:58:49.339996+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:51:25.811682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'5","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.503956+0000","last_change":"2024-05-12T10:58:36.503956+0000","last_active":"2024-05-12T10:58:36.503956+0000","last_peered":"2024-05-12T10:58:36.503956+0000","last_clean":"2024-05-12T10:58:36.503956+0000","last_became_active":"2024-05-12T10:49:54.654727+0000","last_became_peered":"2024-05-12T10:49:54.654727+0000","last_unstale":"2024-05-12T10:58:36.503956+0000","last_undegraded":"2024-05-12T10:58:36.503956+0000","last_fullsized":"2024-05-12T10:58:36.503956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:36.503858+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:36.503858+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.503858+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:43:35.691378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'291","reported_seq":485,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.601038+0000","last_change":"2024-05-12T10:58:47.601182+0000","last_active":"2024-05-12T10:58:47.601038+0000","last_peered":"2024-05-12T10:58:47.601038+0000","last_clean":"2024-05-12T10:58:47.601038+0000","last_became_active":"2024-05-12T10:50:00.392078+0000","last_became_peered":"2024-05-12T10:50:00.392078+0000","last_unstale":"2024-05-12T10:58:47.601038+0000","last_undegraded":"2024-05-12T10:58:47.601038+0000","last_fullsized":"2024-05-12T10:58:47.601038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'291","last_scrub_stamp":"2024-05-12T10:58:47.600742+0000","last_deep_scrub":"28'291","last_deep_scrub_stamp":"2024-05-12T10:58:47.600742+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.600742+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:49:33.870338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'6","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.484952+0000","last_change":"2024-05-12T10:58:40.484976+0000","last_active":"2024-05-12T10:58:40.484952+0000","last_peered":"2024-05-12T10:58:40.484952+0000","last_clean":"2024-05-12T10:58:40.484952+0000","last_became_active":"2024-05-12T10:50:36.844312+0000","last_became_peered":"2024-05-12T10:50:36.844312+0000","last_unstale":"2024-05-12T10:58:40.484952+0000","last_undegraded":"2024-05-12T10:58:40.484952+0000","last_fullsized":"2024-05-12T10:58:40.484952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:40.484872+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:40.484872+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.484872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:37:21.229576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.934132+0000","last_change":"2024-05-12T10:58:34.934132+0000","last_active":"2024-05-12T10:58:34.934132+0000","last_peered":"2024-05-12T10:58:34.934132+0000","last_clean":"2024-05-12T10:58:34.934132+0000","last_became_active":"2024-05-12T10:49:54.628184+0000","last_became_peered":"2024-05-12T10:49:54.628184+0000","last_unstale":"2024-05-12T10:58:34.934132+0000","last_undegraded":"2024-05-12T10:58:34.934132+0000","last_fullsized":"2024-05-12T10:58:34.934132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-05-12T10:58:34.934046+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-05-12T10:58:34.934046+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.934046+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:37:18.795663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'266","reported_seq":442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.223005+0000","last_change":"2024-05-12T10:58:44.223005+0000","last_active":"2024-05-12T10:58:44.223005+0000","last_peered":"2024-05-12T10:58:44.223005+0000","last_clean":"2024-05-12T10:58:44.223005+0000","last_became_active":"2024-05-12T10:49:59.657398+0000","last_became_peered":"2024-05-12T10:49:59.657398+0000","last_unstale":"2024-05-12T10:58:44.223005+0000","last_undegraded":"2024-05-12T10:58:44.223005+0000","last_fullsized":"2024-05-12T10:58:44.223005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'266","last_scrub_stamp":"2024-05-12T10:58:44.222861+0000","last_deep_scrub":"28'266","last_deep_scrub_stamp":"2024-05-12T10:58:44.222861+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.222861+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:37.229174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:50.307048+0000","last_change":"2024-05-12T10:58:50.307048+0000","last_active":"2024-05-12T10:58:50.307048+0000","last_peered":"2024-05-12T10:58:50.307048+0000","last_clean":"2024-05-12T10:58:50.307048+0000","last_became_active":"2024-05-12T10:49:55.645477+0000","last_became_peered":"2024-05-12T10:49:55.645477+0000","last_unstale":"2024-05-12T10:58:50.307048+0000","last_undegraded":"2024-05-12T10:58:50.307048+0000","last_fullsized":"2024-05-12T10:58:50.307048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:50.306708+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:50.306708+0000","last_clean_scrub_stamp":"2024-05-12T10:58:50.306708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:18:02.507210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'3","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.500515+0000","last_change":"2024-05-12T10:58:34.500515+0000","last_active":"2024-05-12T10:58:34.500515+0000","last_peered":"2024-05-12T10:58:34.500515+0000","last_clean":"2024-05-12T10:58:34.500515+0000","last_became_active":"2024-05-12T10:49:54.609747+0000","last_became_peered":"2024-05-12T10:49:54.609747+0000","last_unstale":"2024-05-12T10:58:34.500515+0000","last_undegraded":"2024-05-12T10:58:34.500515+0000","last_fullsized":"2024-05-12T10:58:34.500515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-12T10:58:34.500429+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-12T10:58:34.500429+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.500429+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:01:37.307462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'323","reported_seq":527,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:50.792277+0000","last_change":"2024-05-12T10:58:50.792346+0000","last_active":"2024-05-12T10:58:50.792277+0000","last_peered":"2024-05-12T10:58:50.792277+0000","last_clean":"2024-05-12T10:58:50.792277+0000","last_became_active":"2024-05-12T10:50:00.385032+0000","last_became_peered":"2024-05-12T10:50:00.385032+0000","last_unstale":"2024-05-12T10:58:50.792277+0000","last_undegraded":"2024-05-12T10:58:50.792277+0000","last_fullsized":"2024-05-12T10:58:50.792277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'323","last_scrub_stamp":"2024-05-12T10:58:50.792088+0000","last_deep_scrub":"28'323","last_deep_scrub_stamp":"2024-05-12T10:58:50.792088+0000","last_clean_scrub_stamp":"2024-05-12T10:58:50.792088+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:28:43.829410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'5","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:51.282104+0000","last_change":"2024-05-12T10:58:51.282104+0000","last_active":"2024-05-12T10:58:51.282104+0000","last_peered":"2024-05-12T10:58:51.282104+0000","last_clean":"2024-05-12T10:58:51.282104+0000","last_became_active":"2024-05-12T10:49:55.645903+0000","last_became_peered":"2024-05-12T10:49:55.645903+0000","last_unstale":"2024-05-12T10:58:51.282104+0000","last_undegraded":"2024-05-12T10:58:51.282104+0000","last_fullsized":"2024-05-12T10:58:51.282104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:51.281872+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:51.281872+0000","last_clean_scrub_stamp":"2024-05-12T10:58:51.281872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:57:49.358852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.175686+0000","last_change":"2024-05-12T10:58:34.175686+0000","last_active":"2024-05-12T10:58:34.175686+0000","last_peered":"2024-05-12T10:58:34.175686+0000","last_clean":"2024-05-12T10:58:34.175686+0000","last_became_active":"2024-05-12T10:49:54.620564+0000","last_became_peered":"2024-05-12T10:49:54.620564+0000","last_unstale":"2024-05-12T10:58:34.175686+0000","last_undegraded":"2024-05-12T10:58:34.175686+0000","last_fullsized":"2024-05-12T10:58:34.175686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:34.175406+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:34.175406+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.175406+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:39:29.714881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'269","reported_seq":437,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.291846+0000","last_change":"2024-05-12T10:58:42.291846+0000","last_active":"2024-05-12T10:58:42.291846+0000","last_peered":"2024-05-12T10:58:42.291846+0000","last_clean":"2024-05-12T10:58:42.291846+0000","last_became_active":"2024-05-12T10:49:59.671597+0000","last_became_peered":"2024-05-12T10:49:59.671597+0000","last_unstale":"2024-05-12T10:58:42.291846+0000","last_undegraded":"2024-05-12T10:58:42.291846+0000","last_fullsized":"2024-05-12T10:58:42.291846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'269","last_scrub_stamp":"2024-05-12T10:58:42.291562+0000","last_deep_scrub":"28'269","last_deep_scrub_stamp":"2024-05-12T10:58:42.291562+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.291562+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:42:45.437146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":548864,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:52.326819+0000","last_change":"2024-05-12T10:58:52.326878+0000","last_active":"2024-05-12T10:58:52.326819+0000","last_peered":"2024-05-12T10:58:52.326819+0000","last_clean":"2024-05-12T10:58:52.326819+0000","last_became_active":"2024-05-12T10:49:55.645836+0000","last_became_peered":"2024-05-12T10:49:55.645836+0000","last_unstale":"2024-05-12T10:58:52.326819+0000","last_undegraded":"2024-05-12T10:58:52.326819+0000","last_fullsized":"2024-05-12T10:58:52.326819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:52.326643+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:52.326643+0000","last_clean_scrub_stamp":"2024-05-12T10:58:52.326643+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:10:51.847249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'24","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.529939+0000","last_change":"2024-05-12T10:58:35.529971+0000","last_active":"2024-05-12T10:58:35.529939+0000","last_peered":"2024-05-12T10:58:35.529939+0000","last_clean":"2024-05-12T10:58:35.529939+0000","last_became_active":"2024-05-12T10:49:54.617650+0000","last_became_peered":"2024-05-12T10:49:54.617650+0000","last_unstale":"2024-05-12T10:58:35.529939+0000","last_undegraded":"2024-05-12T10:58:35.529939+0000","last_fullsized":"2024-05-12T10:58:35.529939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'24","last_scrub_stamp":"2024-05-12T10:58:35.529875+0000","last_deep_scrub":"28'24","last_deep_scrub_stamp":"2024-05-12T10:58:35.529875+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.529875+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:50:24.889671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'374","reported_seq":607,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.205042+0000","last_change":"2024-05-12T10:58:45.205108+0000","last_active":"2024-05-12T10:58:45.205042+0000","last_peered":"2024-05-12T10:58:45.205042+0000","last_clean":"2024-05-12T10:58:45.205042+0000","last_became_active":"2024-05-12T10:49:59.671443+0000","last_became_peered":"2024-05-12T10:49:59.671443+0000","last_unstale":"2024-05-12T10:58:45.205042+0000","last_undegraded":"2024-05-12T10:58:45.205042+0000","last_fullsized":"2024-05-12T10:58:45.205042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'374","last_scrub_stamp":"2024-05-12T10:58:45.204937+0000","last_deep_scrub":"28'374","last_deep_scrub_stamp":"2024-05-12T10:58:45.204937+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.204937+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:18:15.451437+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":819200,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.614957+0000","last_change":"2024-05-12T10:58:42.615071+0000","last_active":"2024-05-12T10:58:42.614957+0000","last_peered":"2024-05-12T10:58:42.614957+0000","last_clean":"2024-05-12T10:58:42.614957+0000","last_became_active":"2024-05-12T10:49:55.631689+0000","last_became_peered":"2024-05-12T10:49:55.631689+0000","last_unstale":"2024-05-12T10:58:42.614957+0000","last_undegraded":"2024-05-12T10:58:42.614957+0000","last_fullsized":"2024-05-12T10:58:42.614957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:42.614735+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:42.614735+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.614735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:39:15.444141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.737194+0000","last_change":"2024-05-12T10:58:37.737258+0000","last_active":"2024-05-12T10:58:37.737194+0000","last_peered":"2024-05-12T10:58:37.737194+0000","last_clean":"2024-05-12T10:58:37.737194+0000","last_became_active":"2024-05-12T10:49:54.636022+0000","last_became_peered":"2024-05-12T10:49:54.636022+0000","last_unstale":"2024-05-12T10:58:37.737194+0000","last_undegraded":"2024-05-12T10:58:37.737194+0000","last_fullsized":"2024-05-12T10:58:37.737194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:37.737019+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:37.737019+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.737019+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:16:44.700464+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'283","reported_seq":462,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.470834+0000","last_change":"2024-05-12T10:58:47.470863+0000","last_active":"2024-05-12T10:58:47.470834+0000","last_peered":"2024-05-12T10:58:47.470834+0000","last_clean":"2024-05-12T10:58:47.470834+0000","last_became_active":"2024-05-12T10:50:00.383039+0000","last_became_peered":"2024-05-12T10:50:00.383039+0000","last_unstale":"2024-05-12T10:58:47.470834+0000","last_undegraded":"2024-05-12T10:58:47.470834+0000","last_fullsized":"2024-05-12T10:58:47.470834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'283","last_scrub_stamp":"2024-05-12T10:58:47.470732+0000","last_deep_scrub":"28'283","last_deep_scrub_stamp":"2024-05-12T10:58:47.470732+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.470732+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:04:33.461972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'15","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:53.322414+0000","last_change":"2024-05-12T10:58:53.322474+0000","last_active":"2024-05-12T10:58:53.322414+0000","last_peered":"2024-05-12T10:58:53.322414+0000","last_clean":"2024-05-12T10:58:53.322414+0000","last_became_active":"2024-05-12T10:49:55.645743+0000","last_became_peered":"2024-05-12T10:49:55.645743+0000","last_unstale":"2024-05-12T10:58:53.322414+0000","last_undegraded":"2024-05-12T10:58:53.322414+0000","last_fullsized":"2024-05-12T10:58:53.322414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-05-12T10:58:53.322238+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-05-12T10:58:53.322238+0000","last_clean_scrub_stamp":"2024-05-12T10:58:53.322238+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:06:24.252217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'4","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.699893+0000","last_change":"2024-05-12T10:58:40.699959+0000","last_active":"2024-05-12T10:58:40.699893+0000","last_peered":"2024-05-12T10:58:40.699893+0000","last_clean":"2024-05-12T10:58:40.699893+0000","last_became_active":"2024-05-12T10:49:54.655944+0000","last_became_peered":"2024-05-12T10:49:54.655944+0000","last_unstale":"2024-05-12T10:58:40.699893+0000","last_undegraded":"2024-05-12T10:58:40.699893+0000","last_fullsized":"2024-05-12T10:58:40.699893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:40.699730+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:40.699730+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.699730+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:52:43.946386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'279","reported_seq":459,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.426868+0000","last_change":"2024-05-12T10:58:48.426911+0000","last_active":"2024-05-12T10:58:48.426868+0000","last_peered":"2024-05-12T10:58:48.426868+0000","last_clean":"2024-05-12T10:58:48.426868+0000","last_became_active":"2024-05-12T10:50:00.389863+0000","last_became_peered":"2024-05-12T10:50:00.389863+0000","last_unstale":"2024-05-12T10:58:48.426868+0000","last_undegraded":"2024-05-12T10:58:48.426868+0000","last_fullsized":"2024-05-12T10:58:48.426868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'279","last_scrub_stamp":"2024-05-12T10:58:48.426754+0000","last_deep_scrub":"28'279","last_deep_scrub_stamp":"2024-05-12T10:58:48.426754+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.426754+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:28:10.840953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.205314+0000","last_change":"2024-05-12T10:58:43.205340+0000","last_active":"2024-05-12T10:58:43.205314+0000","last_peered":"2024-05-12T10:58:43.205314+0000","last_clean":"2024-05-12T10:58:43.205314+0000","last_became_active":"2024-05-12T10:49:55.628614+0000","last_became_peered":"2024-05-12T10:49:55.628614+0000","last_unstale":"2024-05-12T10:58:43.205314+0000","last_undegraded":"2024-05-12T10:58:43.205314+0000","last_fullsized":"2024-05-12T10:58:43.205314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:43.205232+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:43.205232+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.205232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:55:03.331992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'10","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:33.142058+0000","last_change":"2024-05-12T10:58:33.142088+0000","last_active":"2024-05-12T10:58:33.142058+0000","last_peered":"2024-05-12T10:58:33.142058+0000","last_clean":"2024-05-12T10:58:33.142058+0000","last_became_active":"2024-05-12T10:49:54.625744+0000","last_became_peered":"2024-05-12T10:49:54.625744+0000","last_unstale":"2024-05-12T10:58:33.142058+0000","last_undegraded":"2024-05-12T10:58:33.142058+0000","last_fullsized":"2024-05-12T10:58:33.142058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:33.141995+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:33.141995+0000","last_clean_scrub_stamp":"2024-05-12T10:58:33.141995+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:33.971351+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'329","reported_seq":546,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:51.820275+0000","last_change":"2024-05-12T10:58:51.820386+0000","last_active":"2024-05-12T10:58:51.820275+0000","last_peered":"2024-05-12T10:58:51.820275+0000","last_clean":"2024-05-12T10:58:51.820275+0000","last_became_active":"2024-05-12T10:50:00.386106+0000","last_became_peered":"2024-05-12T10:50:00.386106+0000","last_unstale":"2024-05-12T10:58:51.820275+0000","last_undegraded":"2024-05-12T10:58:51.820275+0000","last_fullsized":"2024-05-12T10:58:51.820275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'329","last_scrub_stamp":"2024-05-12T10:58:51.819988+0000","last_deep_scrub":"28'329","last_deep_scrub_stamp":"2024-05-12T10:58:51.819988+0000","last_clean_scrub_stamp":"2024-05-12T10:58:51.819988+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:51:50.628017+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.390846+0000","last_change":"2024-05-12T10:58:46.390903+0000","last_active":"2024-05-12T10:58:46.390846+0000","last_peered":"2024-05-12T10:58:46.390846+0000","last_clean":"2024-05-12T10:58:46.390846+0000","last_became_active":"2024-05-12T10:49:55.634201+0000","last_became_peered":"2024-05-12T10:49:55.634201+0000","last_unstale":"2024-05-12T10:58:46.390846+0000","last_undegraded":"2024-05-12T10:58:46.390846+0000","last_fullsized":"2024-05-12T10:58:46.390846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:46.390665+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:46.390665+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.390665+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:19:23.796971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'1914","reported_seq":1954,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.790284+0000","last_change":"2024-05-12T10:58:35.790404+0000","last_active":"2024-05-12T10:58:35.790284+0000","last_peered":"2024-05-12T10:58:35.790284+0000","last_clean":"2024-05-12T10:58:35.790284+0000","last_became_active":"2024-05-12T10:49:54.633986+0000","last_became_peered":"2024-05-12T10:49:54.633986+0000","last_unstale":"2024-05-12T10:58:35.790284+0000","last_undegraded":"2024-05-12T10:58:35.790284+0000","last_fullsized":"2024-05-12T10:58:35.790284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1914","last_scrub_stamp":"2024-05-12T10:58:35.790113+0000","last_deep_scrub":"28'1914","last_deep_scrub_stamp":"2024-05-12T10:58:35.790113+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.790113+0000","objects_scrubbed":5,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:24:08.792024+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3832820,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1911,"num_write_kb":3949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'296","reported_seq":489,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.958590+0000","last_change":"2024-05-12T10:58:46.958614+0000","last_active":"2024-05-12T10:58:46.958590+0000","last_peered":"2024-05-12T10:58:46.958590+0000","last_clean":"2024-05-12T10:58:46.958590+0000","last_became_active":"2024-05-12T10:49:59.670938+0000","last_became_peered":"2024-05-12T10:49:59.670938+0000","last_unstale":"2024-05-12T10:58:46.958590+0000","last_undegraded":"2024-05-12T10:58:46.958590+0000","last_fullsized":"2024-05-12T10:58:46.958590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'296","last_scrub_stamp":"2024-05-12T10:58:46.958503+0000","last_deep_scrub":"28'296","last_deep_scrub_stamp":"2024-05-12T10:58:46.958503+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.958503+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:27:45.463828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'11","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.247701+0000","last_change":"2024-05-12T10:58:38.247766+0000","last_active":"2024-05-12T10:58:38.247701+0000","last_peered":"2024-05-12T10:58:38.247701+0000","last_clean":"2024-05-12T10:58:38.247701+0000","last_became_active":"2024-05-12T10:49:55.634018+0000","last_became_peered":"2024-05-12T10:49:55.634018+0000","last_unstale":"2024-05-12T10:58:38.247701+0000","last_undegraded":"2024-05-12T10:58:38.247701+0000","last_fullsized":"2024-05-12T10:58:38.247701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-12T10:58:38.247471+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-12T10:58:38.247471+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.247471+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:56:59.140286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'12","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.941442+0000","last_change":"2024-05-12T10:58:37.941471+0000","last_active":"2024-05-12T10:58:37.941442+0000","last_peered":"2024-05-12T10:58:37.941442+0000","last_clean":"2024-05-12T10:58:37.941442+0000","last_became_active":"2024-05-12T10:49:54.655729+0000","last_became_peered":"2024-05-12T10:49:54.655729+0000","last_unstale":"2024-05-12T10:58:37.941442+0000","last_undegraded":"2024-05-12T10:58:37.941442+0000","last_fullsized":"2024-05-12T10:58:37.941442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-05-12T10:58:37.941373+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-05-12T10:58:37.941373+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.941373+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:08:26.086626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'304","reported_seq":512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.260129+0000","last_change":"2024-05-12T10:58:43.260257+0000","last_active":"2024-05-12T10:58:43.260129+0000","last_peered":"2024-05-12T10:58:43.260129+0000","last_clean":"2024-05-12T10:58:43.260129+0000","last_became_active":"2024-05-12T10:49:59.671427+0000","last_became_peered":"2024-05-12T10:49:59.671427+0000","last_unstale":"2024-05-12T10:58:43.260129+0000","last_undegraded":"2024-05-12T10:58:43.260129+0000","last_fullsized":"2024-05-12T10:58:43.260129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'304","last_scrub_stamp":"2024-05-12T10:58:43.259888+0000","last_deep_scrub":"28'304","last_deep_scrub_stamp":"2024-05-12T10:58:43.259888+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.259888+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:02:55.771259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":716800,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.154042+0000","last_change":"2024-05-12T10:58:39.154108+0000","last_active":"2024-05-12T10:58:39.154042+0000","last_peered":"2024-05-12T10:58:39.154042+0000","last_clean":"2024-05-12T10:58:39.154042+0000","last_became_active":"2024-05-12T10:49:55.620272+0000","last_became_peered":"2024-05-12T10:49:55.620272+0000","last_unstale":"2024-05-12T10:58:39.154042+0000","last_undegraded":"2024-05-12T10:58:39.154042+0000","last_fullsized":"2024-05-12T10:58:39.154042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:39.153930+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:39.153930+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.153930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:59:16.276725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'3","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.672256+0000","last_change":"2024-05-12T10:58:37.672323+0000","last_active":"2024-05-12T10:58:37.672256+0000","last_peered":"2024-05-12T10:58:37.672256+0000","last_clean":"2024-05-12T10:58:37.672256+0000","last_became_active":"2024-05-12T10:49:54.648872+0000","last_became_peered":"2024-05-12T10:49:54.648872+0000","last_unstale":"2024-05-12T10:58:37.672256+0000","last_undegraded":"2024-05-12T10:58:37.672256+0000","last_fullsized":"2024-05-12T10:58:37.672256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-12T10:58:37.672089+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-12T10:58:37.672089+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.672089+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:18:44.318734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'307","reported_seq":499,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:52.494132+0000","last_change":"2024-05-12T10:58:52.494159+0000","last_active":"2024-05-12T10:58:52.494132+0000","last_peered":"2024-05-12T10:58:52.494132+0000","last_clean":"2024-05-12T10:58:52.494132+0000","last_became_active":"2024-05-12T10:50:36.855397+0000","last_became_peered":"2024-05-12T10:50:36.855397+0000","last_unstale":"2024-05-12T10:58:52.494132+0000","last_undegraded":"2024-05-12T10:58:52.494132+0000","last_fullsized":"2024-05-12T10:58:52.494132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'307","last_scrub_stamp":"2024-05-12T10:58:52.494037+0000","last_deep_scrub":"28'307","last_deep_scrub_stamp":"2024-05-12T10:58:52.494037+0000","last_clean_scrub_stamp":"2024-05-12T10:58:52.494037+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:03:00.834486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.805234+0000","last_change":"2024-05-12T10:58:46.805341+0000","last_active":"2024-05-12T10:58:46.805234+0000","last_peered":"2024-05-12T10:58:46.805234+0000","last_clean":"2024-05-12T10:58:46.805234+0000","last_became_active":"2024-05-12T10:49:55.626361+0000","last_became_peered":"2024-05-12T10:49:55.626361+0000","last_unstale":"2024-05-12T10:58:46.805234+0000","last_undegraded":"2024-05-12T10:58:46.805234+0000","last_fullsized":"2024-05-12T10:58:46.805234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:46.805026+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:46.805026+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.805026+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:53:00.507157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.707392+0000","last_change":"2024-05-12T10:58:39.707459+0000","last_active":"2024-05-12T10:58:39.707392+0000","last_peered":"2024-05-12T10:58:39.707392+0000","last_clean":"2024-05-12T10:58:39.707392+0000","last_became_active":"2024-05-12T10:49:54.654074+0000","last_became_peered":"2024-05-12T10:49:54.654074+0000","last_unstale":"2024-05-12T10:58:39.707392+0000","last_undegraded":"2024-05-12T10:58:39.707392+0000","last_fullsized":"2024-05-12T10:58:39.707392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:39.707225+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:39.707225+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.707225+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:21:34.520998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'332","reported_seq":539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:51.447771+0000","last_change":"2024-05-12T10:58:51.447797+0000","last_active":"2024-05-12T10:58:51.447771+0000","last_peered":"2024-05-12T10:58:51.447771+0000","last_clean":"2024-05-12T10:58:51.447771+0000","last_became_active":"2024-05-12T10:50:00.395485+0000","last_became_peered":"2024-05-12T10:50:00.395485+0000","last_unstale":"2024-05-12T10:58:51.447771+0000","last_undegraded":"2024-05-12T10:58:51.447771+0000","last_fullsized":"2024-05-12T10:58:51.447771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'332","last_scrub_stamp":"2024-05-12T10:58:51.447680+0000","last_deep_scrub":"28'332","last_deep_scrub_stamp":"2024-05-12T10:58:51.447680+0000","last_clean_scrub_stamp":"2024-05-12T10:58:51.447680+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:43:41.000048+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'283","reported_seq":474,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.222282+0000","last_change":"2024-05-12T10:58:48.222307+0000","last_active":"2024-05-12T10:58:48.222282+0000","last_peered":"2024-05-12T10:58:48.222282+0000","last_clean":"2024-05-12T10:58:48.222282+0000","last_became_active":"2024-05-12T10:50:00.389825+0000","last_became_peered":"2024-05-12T10:50:00.389825+0000","last_unstale":"2024-05-12T10:58:48.222282+0000","last_undegraded":"2024-05-12T10:58:48.222282+0000","last_fullsized":"2024-05-12T10:58:48.222282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'283","last_scrub_stamp":"2024-05-12T10:58:48.222158+0000","last_deep_scrub":"28'283","last_deep_scrub_stamp":"2024-05-12T10:58:48.222158+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.222158+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:17:59.889255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":643072,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'11","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.968431+0000","last_change":"2024-05-12T10:58:41.968461+0000","last_active":"2024-05-12T10:58:41.968431+0000","last_peered":"2024-05-12T10:58:41.968431+0000","last_clean":"2024-05-12T10:58:41.968431+0000","last_became_active":"2024-05-12T10:49:55.619127+0000","last_became_peered":"2024-05-12T10:49:55.619127+0000","last_unstale":"2024-05-12T10:58:41.968431+0000","last_undegraded":"2024-05-12T10:58:41.968431+0000","last_fullsized":"2024-05-12T10:58:41.968431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-12T10:58:41.968333+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-12T10:58:41.968333+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.968333+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:39:27.260863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.699080+0000","last_change":"2024-05-12T10:58:39.699191+0000","last_active":"2024-05-12T10:58:39.699080+0000","last_peered":"2024-05-12T10:58:39.699080+0000","last_clean":"2024-05-12T10:58:39.699080+0000","last_became_active":"2024-05-12T10:49:54.655779+0000","last_became_peered":"2024-05-12T10:49:54.655779+0000","last_unstale":"2024-05-12T10:58:39.699080+0000","last_undegraded":"2024-05-12T10:58:39.699080+0000","last_fullsized":"2024-05-12T10:58:39.699080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-05-12T10:58:39.698881+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-05-12T10:58:39.698881+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.698881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:32:34.724939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'272","reported_seq":458,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.612812+0000","last_change":"2024-05-12T10:58:46.612882+0000","last_active":"2024-05-12T10:58:46.612812+0000","last_peered":"2024-05-12T10:58:46.612812+0000","last_clean":"2024-05-12T10:58:46.612812+0000","last_became_active":"2024-05-12T10:49:59.680508+0000","last_became_peered":"2024-05-12T10:49:59.680508+0000","last_unstale":"2024-05-12T10:58:46.612812+0000","last_undegraded":"2024-05-12T10:58:46.612812+0000","last_fullsized":"2024-05-12T10:58:46.612812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'272","last_scrub_stamp":"2024-05-12T10:58:46.612620+0000","last_deep_scrub":"28'272","last_deep_scrub_stamp":"2024-05-12T10:58:46.612620+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.612620+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:58:00.574155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.502785+0000","last_change":"2024-05-12T10:58:42.502810+0000","last_active":"2024-05-12T10:58:42.502785+0000","last_peered":"2024-05-12T10:58:42.502785+0000","last_clean":"2024-05-12T10:58:42.502785+0000","last_became_active":"2024-05-12T10:49:55.617053+0000","last_became_peered":"2024-05-12T10:49:55.617053+0000","last_unstale":"2024-05-12T10:58:42.502785+0000","last_undegraded":"2024-05-12T10:58:42.502785+0000","last_fullsized":"2024-05-12T10:58:42.502785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:42.502705+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:42.502705+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.502705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:17:57.289294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.491520+0000","last_change":"2024-05-12T10:58:40.491551+0000","last_active":"2024-05-12T10:58:40.491520+0000","last_peered":"2024-05-12T10:58:40.491520+0000","last_clean":"2024-05-12T10:58:40.491520+0000","last_became_active":"2024-05-12T10:49:54.637168+0000","last_became_peered":"2024-05-12T10:49:54.637168+0000","last_unstale":"2024-05-12T10:58:40.491520+0000","last_undegraded":"2024-05-12T10:58:40.491520+0000","last_fullsized":"2024-05-12T10:58:40.491520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-05-12T10:58:40.491442+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-05-12T10:58:40.491442+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.491442+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:37:21.280853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'4","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.726609+0000","last_change":"2024-05-12T10:58:36.726678+0000","last_active":"2024-05-12T10:58:36.726609+0000","last_peered":"2024-05-12T10:58:36.726609+0000","last_clean":"2024-05-12T10:58:36.726609+0000","last_became_active":"2024-05-12T10:49:54.636160+0000","last_became_peered":"2024-05-12T10:49:54.636160+0000","last_unstale":"2024-05-12T10:58:36.726609+0000","last_undegraded":"2024-05-12T10:58:36.726609+0000","last_fullsized":"2024-05-12T10:58:36.726609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:36.726426+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:36.726426+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.726426+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:42:21.055693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.168439+0000","last_change":"2024-05-12T10:58:42.168479+0000","last_active":"2024-05-12T10:58:42.168439+0000","last_peered":"2024-05-12T10:58:42.168439+0000","last_clean":"2024-05-12T10:58:42.168439+0000","last_became_active":"2024-05-12T10:49:55.626805+0000","last_became_peered":"2024-05-12T10:49:55.626805+0000","last_unstale":"2024-05-12T10:58:42.168439+0000","last_undegraded":"2024-05-12T10:58:42.168439+0000","last_fullsized":"2024-05-12T10:58:42.168439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:42.168365+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:42.168365+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.168365+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:03.604775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'308","reported_seq":511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.497322+0000","last_change":"2024-05-12T10:58:39.497351+0000","last_active":"2024-05-12T10:58:39.497322+0000","last_peered":"2024-05-12T10:58:39.497322+0000","last_clean":"2024-05-12T10:58:39.497322+0000","last_became_active":"2024-05-12T10:49:59.656762+0000","last_became_peered":"2024-05-12T10:49:59.656762+0000","last_unstale":"2024-05-12T10:58:39.497322+0000","last_undegraded":"2024-05-12T10:58:39.497322+0000","last_fullsized":"2024-05-12T10:58:39.497322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'308","last_scrub_stamp":"2024-05-12T10:58:39.497198+0000","last_deep_scrub":"28'308","last_deep_scrub_stamp":"2024-05-12T10:58:39.497198+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.497198+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:34:46.775219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.523337+0000","last_change":"2024-05-12T10:58:39.523372+0000","last_active":"2024-05-12T10:58:39.523337+0000","last_peered":"2024-05-12T10:58:39.523337+0000","last_clean":"2024-05-12T10:58:39.523337+0000","last_became_active":"2024-05-12T10:49:54.631900+0000","last_became_peered":"2024-05-12T10:49:54.631900+0000","last_unstale":"2024-05-12T10:58:39.523337+0000","last_undegraded":"2024-05-12T10:58:39.523337+0000","last_fullsized":"2024-05-12T10:58:39.523337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:39.523249+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:39.523249+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.523249+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:37:33.589312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.227023+0000","last_change":"2024-05-12T10:58:37.227081+0000","last_active":"2024-05-12T10:58:37.227023+0000","last_peered":"2024-05-12T10:58:37.227023+0000","last_clean":"2024-05-12T10:58:37.227023+0000","last_became_active":"2024-05-12T10:49:55.629465+0000","last_became_peered":"2024-05-12T10:49:55.629465+0000","last_unstale":"2024-05-12T10:58:37.227023+0000","last_undegraded":"2024-05-12T10:58:37.227023+0000","last_fullsized":"2024-05-12T10:58:37.227023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:37.226847+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:37.226847+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.226847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:33:08.307918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'317","reported_seq":523,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:46.440518+0000","last_change":"2024-05-12T10:58:46.440550+0000","last_active":"2024-05-12T10:58:46.440518+0000","last_peered":"2024-05-12T10:58:46.440518+0000","last_clean":"2024-05-12T10:58:46.440518+0000","last_became_active":"2024-05-12T10:49:59.655489+0000","last_became_peered":"2024-05-12T10:49:59.655489+0000","last_unstale":"2024-05-12T10:58:46.440518+0000","last_undegraded":"2024-05-12T10:58:46.440518+0000","last_fullsized":"2024-05-12T10:58:46.440518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'317","last_scrub_stamp":"2024-05-12T10:58:46.440432+0000","last_deep_scrub":"28'317","last_deep_scrub_stamp":"2024-05-12T10:58:46.440432+0000","last_clean_scrub_stamp":"2024-05-12T10:58:46.440432+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:15:06.754152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'9","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.640198+0000","last_change":"2024-05-12T10:58:41.640263+0000","last_active":"2024-05-12T10:58:41.640198+0000","last_peered":"2024-05-12T10:58:41.640198+0000","last_clean":"2024-05-12T10:58:41.640198+0000","last_became_active":"2024-05-12T10:49:55.636331+0000","last_became_peered":"2024-05-12T10:49:55.636331+0000","last_unstale":"2024-05-12T10:58:41.640198+0000","last_undegraded":"2024-05-12T10:58:41.640198+0000","last_fullsized":"2024-05-12T10:58:41.640198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:41.640021+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:41.640021+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.640021+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:47:51.858802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'12","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.497625+0000","last_change":"2024-05-12T10:58:37.497649+0000","last_active":"2024-05-12T10:58:37.497625+0000","last_peered":"2024-05-12T10:58:37.497625+0000","last_clean":"2024-05-12T10:58:37.497625+0000","last_became_active":"2024-05-12T10:49:55.618556+0000","last_became_peered":"2024-05-12T10:49:55.618556+0000","last_unstale":"2024-05-12T10:58:37.497625+0000","last_undegraded":"2024-05-12T10:58:37.497625+0000","last_fullsized":"2024-05-12T10:58:37.497625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-05-12T10:58:37.497539+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-05-12T10:58:37.497539+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.497539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:28:45.672655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.681981+0000","last_change":"2024-05-12T10:58:35.682095+0000","last_active":"2024-05-12T10:58:35.681981+0000","last_peered":"2024-05-12T10:58:35.681981+0000","last_clean":"2024-05-12T10:58:35.681981+0000","last_became_active":"2024-05-12T10:49:55.623660+0000","last_became_peered":"2024-05-12T10:49:55.623660+0000","last_unstale":"2024-05-12T10:58:35.681981+0000","last_undegraded":"2024-05-12T10:58:35.681981+0000","last_fullsized":"2024-05-12T10:58:35.681981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:35.681718+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:35.681718+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.681718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:35:58.717683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.110864+0000","last_change":"2024-05-12T10:58:38.110888+0000","last_active":"2024-05-12T10:58:38.110864+0000","last_peered":"2024-05-12T10:58:38.110864+0000","last_clean":"2024-05-12T10:58:38.110864+0000","last_became_active":"2024-05-12T10:49:55.620005+0000","last_became_peered":"2024-05-12T10:49:55.620005+0000","last_unstale":"2024-05-12T10:58:38.110864+0000","last_undegraded":"2024-05-12T10:58:38.110864+0000","last_fullsized":"2024-05-12T10:58:38.110864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:38.110742+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:38.110742+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.110742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:37:47.151178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.491562+0000","last_change":"2024-05-12T10:58:44.491606+0000","last_active":"2024-05-12T10:58:44.491562+0000","last_peered":"2024-05-12T10:58:44.491562+0000","last_clean":"2024-05-12T10:58:44.491562+0000","last_became_active":"2024-05-12T10:49:55.625684+0000","last_became_peered":"2024-05-12T10:49:55.625684+0000","last_unstale":"2024-05-12T10:58:44.491562+0000","last_undegraded":"2024-05-12T10:58:44.491562+0000","last_fullsized":"2024-05-12T10:58:44.491562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:44.491442+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:44.491442+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.491442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:39:27.042127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.921758+0000","last_change":"2024-05-12T10:58:42.921783+0000","last_active":"2024-05-12T10:58:42.921758+0000","last_peered":"2024-05-12T10:58:42.921758+0000","last_clean":"2024-05-12T10:58:42.921758+0000","last_became_active":"2024-05-12T10:49:55.621833+0000","last_became_peered":"2024-05-12T10:49:55.621833+0000","last_unstale":"2024-05-12T10:58:42.921758+0000","last_undegraded":"2024-05-12T10:58:42.921758+0000","last_fullsized":"2024-05-12T10:58:42.921758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:42.921669+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:42.921669+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.921669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:44:33.196834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'15","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:49.606187+0000","last_change":"2024-05-12T10:58:49.606278+0000","last_active":"2024-05-12T10:58:49.606187+0000","last_peered":"2024-05-12T10:58:49.606187+0000","last_clean":"2024-05-12T10:58:49.606187+0000","last_became_active":"2024-05-12T10:50:36.855517+0000","last_became_peered":"2024-05-12T10:50:36.855517+0000","last_unstale":"2024-05-12T10:58:49.606187+0000","last_undegraded":"2024-05-12T10:58:49.606187+0000","last_fullsized":"2024-05-12T10:58:49.606187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-05-12T10:58:49.605946+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-05-12T10:58:49.605946+0000","last_clean_scrub_stamp":"2024-05-12T10:58:49.605946+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:30:12.847782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.478620+0000","last_change":"2024-05-12T10:58:45.478644+0000","last_active":"2024-05-12T10:58:45.478620+0000","last_peered":"2024-05-12T10:58:45.478620+0000","last_clean":"2024-05-12T10:58:45.478620+0000","last_became_active":"2024-05-12T10:49:55.625694+0000","last_became_peered":"2024-05-12T10:49:55.625694+0000","last_unstale":"2024-05-12T10:58:45.478620+0000","last_undegraded":"2024-05-12T10:58:45.478620+0000","last_fullsized":"2024-05-12T10:58:45.478620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-05-12T10:58:45.478541+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-05-12T10:58:45.478541+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.478541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:02:21.141626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'6","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:42.746137+0000","last_change":"2024-05-12T10:58:42.746246+0000","last_active":"2024-05-12T10:58:42.746137+0000","last_peered":"2024-05-12T10:58:42.746137+0000","last_clean":"2024-05-12T10:58:42.746137+0000","last_became_active":"2024-05-12T10:49:55.620857+0000","last_became_peered":"2024-05-12T10:49:55.620857+0000","last_unstale":"2024-05-12T10:58:42.746137+0000","last_undegraded":"2024-05-12T10:58:42.746137+0000","last_fullsized":"2024-05-12T10:58:42.746137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:42.745902+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:42.745902+0000","last_clean_scrub_stamp":"2024-05-12T10:58:42.745902+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:10:57.680054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.577620+0000","last_change":"2024-05-12T10:58:37.577620+0000","last_active":"2024-05-12T10:58:37.577620+0000","last_peered":"2024-05-12T10:58:37.577620+0000","last_clean":"2024-05-12T10:58:37.577620+0000","last_became_active":"2024-05-12T10:49:55.626626+0000","last_became_peered":"2024-05-12T10:49:55.626626+0000","last_unstale":"2024-05-12T10:58:37.577620+0000","last_undegraded":"2024-05-12T10:58:37.577620+0000","last_fullsized":"2024-05-12T10:58:37.577620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:37.577474+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:37.577474+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.577474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:01:38.399108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.830519+0000","last_change":"2024-05-12T10:58:47.830519+0000","last_active":"2024-05-12T10:58:47.830519+0000","last_peered":"2024-05-12T10:58:47.830519+0000","last_clean":"2024-05-12T10:58:47.830519+0000","last_became_active":"2024-05-12T10:49:55.629716+0000","last_became_peered":"2024-05-12T10:49:55.629716+0000","last_unstale":"2024-05-12T10:58:47.830519+0000","last_undegraded":"2024-05-12T10:58:47.830519+0000","last_fullsized":"2024-05-12T10:58:47.830519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:47.830267+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:47.830267+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.830267+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:05:01.645824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.153352+0000","last_change":"2024-05-12T10:58:40.153352+0000","last_active":"2024-05-12T10:58:40.153352+0000","last_peered":"2024-05-12T10:58:40.153352+0000","last_clean":"2024-05-12T10:58:40.153352+0000","last_became_active":"2024-05-12T10:49:55.620550+0000","last_became_peered":"2024-05-12T10:49:55.620550+0000","last_unstale":"2024-05-12T10:58:40.153352+0000","last_undegraded":"2024-05-12T10:58:40.153352+0000","last_fullsized":"2024-05-12T10:58:40.153352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-12T10:58:40.153209+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-12T10:58:40.153209+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.153209+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:50:26.637563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.639733+0000","last_change":"2024-05-12T10:58:45.639733+0000","last_active":"2024-05-12T10:58:45.639733+0000","last_peered":"2024-05-12T10:58:45.639733+0000","last_clean":"2024-05-12T10:58:45.639733+0000","last_became_active":"2024-05-12T10:49:55.645761+0000","last_became_peered":"2024-05-12T10:49:55.645761+0000","last_unstale":"2024-05-12T10:58:45.639733+0000","last_undegraded":"2024-05-12T10:58:45.639733+0000","last_fullsized":"2024-05-12T10:58:45.639733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:45.639461+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:45.639461+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.639461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:22:15.071614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:37.533525+0000","last_change":"2024-05-12T10:58:37.533525+0000","last_active":"2024-05-12T10:58:37.533525+0000","last_peered":"2024-05-12T10:58:37.533525+0000","last_clean":"2024-05-12T10:58:37.533525+0000","last_became_active":"2024-05-12T10:49:55.632888+0000","last_became_peered":"2024-05-12T10:49:55.632888+0000","last_unstale":"2024-05-12T10:58:37.533525+0000","last_undegraded":"2024-05-12T10:58:37.533525+0000","last_fullsized":"2024-05-12T10:58:37.533525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:37.533279+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:37.533279+0000","last_clean_scrub_stamp":"2024-05-12T10:58:37.533279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:48:02.150508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.508171+0000","last_change":"2024-05-12T10:58:38.508195+0000","last_active":"2024-05-12T10:58:38.508171+0000","last_peered":"2024-05-12T10:58:38.508171+0000","last_clean":"2024-05-12T10:58:38.508171+0000","last_became_active":"2024-05-12T10:49:55.635026+0000","last_became_peered":"2024-05-12T10:49:55.635026+0000","last_unstale":"2024-05-12T10:58:38.508171+0000","last_undegraded":"2024-05-12T10:58:38.508171+0000","last_fullsized":"2024-05-12T10:58:38.508171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:38.508097+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:38.508097+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.508097+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:52:27.589075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.788632+0000","last_change":"2024-05-12T10:58:45.788712+0000","last_active":"2024-05-12T10:58:45.788632+0000","last_peered":"2024-05-12T10:58:45.788632+0000","last_clean":"2024-05-12T10:58:45.788632+0000","last_became_active":"2024-05-12T10:49:55.626197+0000","last_became_peered":"2024-05-12T10:49:55.626197+0000","last_unstale":"2024-05-12T10:58:45.788632+0000","last_undegraded":"2024-05-12T10:58:45.788632+0000","last_fullsized":"2024-05-12T10:58:45.788632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:45.788435+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:45.788435+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.788435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:47:50.316787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:41.746931+0000","last_change":"2024-05-12T10:58:41.746989+0000","last_active":"2024-05-12T10:58:41.746931+0000","last_peered":"2024-05-12T10:58:41.746931+0000","last_clean":"2024-05-12T10:58:41.746931+0000","last_became_active":"2024-05-12T10:49:55.615313+0000","last_became_peered":"2024-05-12T10:49:55.615313+0000","last_unstale":"2024-05-12T10:58:41.746931+0000","last_undegraded":"2024-05-12T10:58:41.746931+0000","last_fullsized":"2024-05-12T10:58:41.746931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:41.746747+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:41.746747+0000","last_clean_scrub_stamp":"2024-05-12T10:58:41.746747+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:11:30.136055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.952796+0000","last_change":"2024-05-12T10:58:43.952823+0000","last_active":"2024-05-12T10:58:43.952796+0000","last_peered":"2024-05-12T10:58:43.952796+0000","last_clean":"2024-05-12T10:58:43.952796+0000","last_became_active":"2024-05-12T10:49:55.626163+0000","last_became_peered":"2024-05-12T10:49:55.626163+0000","last_unstale":"2024-05-12T10:58:43.952796+0000","last_undegraded":"2024-05-12T10:58:43.952796+0000","last_fullsized":"2024-05-12T10:58:43.952796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:43.952676+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:43.952676+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.952676+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:12:41.915152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.109725+0000","last_change":"2024-05-12T10:58:36.109745+0000","last_active":"2024-05-12T10:58:36.109725+0000","last_peered":"2024-05-12T10:58:36.109725+0000","last_clean":"2024-05-12T10:58:36.109725+0000","last_became_active":"2024-05-12T10:49:55.611867+0000","last_became_peered":"2024-05-12T10:49:55.611867+0000","last_unstale":"2024-05-12T10:58:36.109725+0000","last_undegraded":"2024-05-12T10:58:36.109725+0000","last_fullsized":"2024-05-12T10:58:36.109725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:36.109655+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:36.109655+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.109655+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:12:37.883350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.522177+0000","last_change":"2024-05-12T10:58:34.522199+0000","last_active":"2024-05-12T10:58:34.522177+0000","last_peered":"2024-05-12T10:58:34.522177+0000","last_clean":"2024-05-12T10:58:34.522177+0000","last_became_active":"2024-05-12T10:49:55.630930+0000","last_became_peered":"2024-05-12T10:49:55.630930+0000","last_unstale":"2024-05-12T10:58:34.522177+0000","last_undegraded":"2024-05-12T10:58:34.522177+0000","last_fullsized":"2024-05-12T10:58:34.522177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-05-12T10:58:34.522112+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-05-12T10:58:34.522112+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.522112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:11:44.263130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:39.286784+0000","last_change":"2024-05-12T10:58:39.286843+0000","last_active":"2024-05-12T10:58:39.286784+0000","last_peered":"2024-05-12T10:58:39.286784+0000","last_clean":"2024-05-12T10:58:39.286784+0000","last_became_active":"2024-05-12T10:49:55.643036+0000","last_became_peered":"2024-05-12T10:49:55.643036+0000","last_unstale":"2024-05-12T10:58:39.286784+0000","last_undegraded":"2024-05-12T10:58:39.286784+0000","last_fullsized":"2024-05-12T10:58:39.286784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:39.286579+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:39.286579+0000","last_clean_scrub_stamp":"2024-05-12T10:58:39.286579+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:27:03.990339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:40.665250+0000","last_change":"2024-05-12T10:58:40.665311+0000","last_active":"2024-05-12T10:58:40.665250+0000","last_peered":"2024-05-12T10:58:40.665250+0000","last_clean":"2024-05-12T10:58:40.665250+0000","last_became_active":"2024-05-12T10:49:55.635528+0000","last_became_peered":"2024-05-12T10:49:55.635528+0000","last_unstale":"2024-05-12T10:58:40.665250+0000","last_undegraded":"2024-05-12T10:58:40.665250+0000","last_fullsized":"2024-05-12T10:58:40.665250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:40.665065+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:40.665065+0000","last_clean_scrub_stamp":"2024-05-12T10:58:40.665065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:29:17.657952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:43.605222+0000","last_change":"2024-05-12T10:58:43.605341+0000","last_active":"2024-05-12T10:58:43.605222+0000","last_peered":"2024-05-12T10:58:43.605222+0000","last_clean":"2024-05-12T10:58:43.605222+0000","last_became_active":"2024-05-12T10:49:55.641668+0000","last_became_peered":"2024-05-12T10:49:55.641668+0000","last_unstale":"2024-05-12T10:58:43.605222+0000","last_undegraded":"2024-05-12T10:58:43.605222+0000","last_fullsized":"2024-05-12T10:58:43.605222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-05-12T10:58:43.604999+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-05-12T10:58:43.604999+0000","last_clean_scrub_stamp":"2024-05-12T10:58:43.604999+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:35:01.280337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'11","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:47.371416+0000","last_change":"2024-05-12T10:58:47.371480+0000","last_active":"2024-05-12T10:58:47.371416+0000","last_peered":"2024-05-12T10:58:47.371416+0000","last_clean":"2024-05-12T10:58:47.371416+0000","last_became_active":"2024-05-12T10:49:55.635149+0000","last_became_peered":"2024-05-12T10:49:55.635149+0000","last_unstale":"2024-05-12T10:58:47.371416+0000","last_undegraded":"2024-05-12T10:58:47.371416+0000","last_fullsized":"2024-05-12T10:58:47.371416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-05-12T10:58:47.371239+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-05-12T10:58:47.371239+0000","last_clean_scrub_stamp":"2024-05-12T10:58:47.371239+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:14:38.417159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'9","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:53.464024+0000","last_change":"2024-05-12T10:58:53.464052+0000","last_active":"2024-05-12T10:58:53.464024+0000","last_peered":"2024-05-12T10:58:53.464024+0000","last_clean":"2024-05-12T10:58:53.464024+0000","last_became_active":"2024-05-12T10:50:36.914327+0000","last_became_peered":"2024-05-12T10:50:36.914327+0000","last_unstale":"2024-05-12T10:58:53.464024+0000","last_undegraded":"2024-05-12T10:58:53.464024+0000","last_fullsized":"2024-05-12T10:58:53.464024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-05-12T10:58:53.463899+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-05-12T10:58:53.463899+0000","last_clean_scrub_stamp":"2024-05-12T10:58:53.463899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:55:43.237324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:45.410708+0000","last_change":"2024-05-12T10:58:45.410770+0000","last_active":"2024-05-12T10:58:45.410708+0000","last_peered":"2024-05-12T10:58:45.410708+0000","last_clean":"2024-05-12T10:58:45.410708+0000","last_became_active":"2024-05-12T10:49:55.628243+0000","last_became_peered":"2024-05-12T10:49:55.628243+0000","last_unstale":"2024-05-12T10:58:45.410708+0000","last_undegraded":"2024-05-12T10:58:45.410708+0000","last_fullsized":"2024-05-12T10:58:45.410708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-05-12T10:58:45.410511+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-05-12T10:58:45.410511+0000","last_clean_scrub_stamp":"2024-05-12T10:58:45.410511+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:57:36.763021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:44.788237+0000","last_change":"2024-05-12T10:58:44.788300+0000","last_active":"2024-05-12T10:58:44.788237+0000","last_peered":"2024-05-12T10:58:44.788237+0000","last_clean":"2024-05-12T10:58:44.788237+0000","last_became_active":"2024-05-12T10:49:55.625251+0000","last_became_peered":"2024-05-12T10:49:55.625251+0000","last_unstale":"2024-05-12T10:58:44.788237+0000","last_undegraded":"2024-05-12T10:58:44.788237+0000","last_fullsized":"2024-05-12T10:58:44.788237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-05-12T10:58:44.788055+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-05-12T10:58:44.788055+0000","last_clean_scrub_stamp":"2024-05-12T10:58:44.788055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:59:21.765128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:36.557418+0000","last_change":"2024-05-12T10:58:36.557533+0000","last_active":"2024-05-12T10:58:36.557418+0000","last_peered":"2024-05-12T10:58:36.557418+0000","last_clean":"2024-05-12T10:58:36.557418+0000","last_became_active":"2024-05-12T10:49:55.632758+0000","last_became_peered":"2024-05-12T10:49:55.632758+0000","last_unstale":"2024-05-12T10:58:36.557418+0000","last_undegraded":"2024-05-12T10:58:36.557418+0000","last_fullsized":"2024-05-12T10:58:36.557418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:36.557152+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:36.557152+0000","last_clean_scrub_stamp":"2024-05-12T10:58:36.557152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:28:33.516575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:34.686494+0000","last_change":"2024-05-12T10:58:34.686557+0000","last_active":"2024-05-12T10:58:34.686494+0000","last_peered":"2024-05-12T10:58:34.686494+0000","last_clean":"2024-05-12T10:58:34.686494+0000","last_became_active":"2024-05-12T10:49:55.623918+0000","last_became_peered":"2024-05-12T10:49:55.623918+0000","last_unstale":"2024-05-12T10:58:34.686494+0000","last_undegraded":"2024-05-12T10:58:34.686494+0000","last_fullsized":"2024-05-12T10:58:34.686494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:34.686329+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:34.686329+0000","last_clean_scrub_stamp":"2024-05-12T10:58:34.686329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:34:08.295632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:35.099288+0000","last_change":"2024-05-12T10:58:35.099307+0000","last_active":"2024-05-12T10:58:35.099288+0000","last_peered":"2024-05-12T10:58:35.099288+0000","last_clean":"2024-05-12T10:58:35.099288+0000","last_became_active":"2024-05-12T10:49:55.610203+0000","last_became_peered":"2024-05-12T10:49:55.610203+0000","last_unstale":"2024-05-12T10:58:35.099288+0000","last_undegraded":"2024-05-12T10:58:35.099288+0000","last_fullsized":"2024-05-12T10:58:35.099288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-05-12T10:58:35.099225+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-05-12T10:58:35.099225+0000","last_clean_scrub_stamp":"2024-05-12T10:58:35.099225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:26:30.094717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:38.934209+0000","last_change":"2024-05-12T10:58:38.934232+0000","last_active":"2024-05-12T10:58:38.934209+0000","last_peered":"2024-05-12T10:58:38.934209+0000","last_clean":"2024-05-12T10:58:38.934209+0000","last_became_active":"2024-05-12T10:49:55.608179+0000","last_became_peered":"2024-05-12T10:49:55.608179+0000","last_unstale":"2024-05-12T10:58:38.934209+0000","last_undegraded":"2024-05-12T10:58:38.934209+0000","last_fullsized":"2024-05-12T10:58:38.934209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-05-12T10:58:38.934128+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-05-12T10:58:38.934128+0000","last_clean_scrub_stamp":"2024-05-12T10:58:38.934128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:07:47.338676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-12T10:58:48.371813+0000","last_change":"2024-05-12T10:58:48.371874+0000","last_active":"2024-05-12T10:58:48.371813+0000","last_peered":"2024-05-12T10:58:48.371813+0000","last_clean":"2024-05-12T10:58:48.371813+0000","last_became_active":"2024-05-12T10:49:55.639087+0000","last_became_peered":"2024-05-12T10:49:55.639087+0000","last_unstale":"2024-05-12T10:58:48.371813+0000","last_undegraded":"2024-05-12T10:58:48.371813+0000","last_fullsized":"2024-05-12T10:58:48.371813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-05-12T10:58:48.371633+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-05-12T10:58:48.371633+0000","last_clean_scrub_stamp":"2024-05-12T10:58:48.371633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:30.720605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9475,"ondisk_log_size":9475,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3837358,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2108,"num_write_kb":4018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7831552,"data_stored":7674716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2119,"ondisk_log_size":2119,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542260,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62596,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309244,"statfs":{"total":96636764160,"available":96572665856,"internally_reserved":0,"allocated":913408,"data_stored":716485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542261,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79580,"kb_used_data":4052,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94292260,"statfs":{"total":96636764160,"available":96555274240,"internally_reserved":0,"allocated":4149248,"data_stored":3958698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542261,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53696,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318144,"statfs":{"total":96636764160,"available":96581779456,"internally_reserved":0,"allocated":319488,"data_stored":126179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542263,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45372,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326468,"statfs":{"total":96636764160,"available":96590303232,"internally_reserved":0,"allocated":315392,"data_stored":125914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542261,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97636,"kb_used_data":4060,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94274204,"statfs":{"total":96636764160,"available":96536784896,"internally_reserved":0,"allocated":4157440,"data_stored":3958862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542260,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57860,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313980,"statfs":{"total":96636764160,"available":96577515520,"internally_reserved":0,"allocated":323584,"data_stored":126148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542261,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67524,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94304316,"statfs":{"total":96636764160,"available":96567619584,"internally_reserved":0,"allocated":323584,"data_stored":125745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542261,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58432,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313408,"statfs":{"total":96636764160,"available":96576929792,"internally_reserved":0,"allocated":909312,"data_stored":715829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3858432,"data_stored":3834061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3850240,"data_stored":3833897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T10:59:16.767 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-12T10:59:16.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.946+0000 7f775b000640 1 Processor -- start 2024-05-12T10:59:16.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.946+0000 7f775b000640 1 -- start start 2024-05-12T10:59:16.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f775b000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7754152df0 0x7f7754159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f775b000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7754073820 0x7f775415c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f775b000640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775415be20 con 0x7f7754152a10 2024-05-12T10:59:16.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f775b000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7754072cf0 con 0x7f7754152df0 2024-05-12T10:59:16.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f775b000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7754072fd0 con 0x7f7754073820 2024-05-12T10:59:16.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7754152a10 0x7f7754073d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51726/0 (socket says 172.21.15.115:51726) 2024-05-12T10:59:16.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753e00640 1 -- 172.21.15.115:0/85992414 learned_addr learned my addr 172.21.15.115:0/85992414 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:59:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f774b400640 1 --2- 172.21.15.115:0/85992414 >> v2:172.21.15.134:3300/0 conn(0x7f7754152df0 0x7f7754159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7759000640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7754073820 0x7f775415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4285504920 0 0) 0x7f775415be20 con 0x7f7754152a10 2024-05-12T10:59:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7738005740 con 0x7f7754152a10 2024-05-12T10:59:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3232431167 0 0) 0x7f7738005740 con 0x7f7754152a10 2024-05-12T10:59:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7754073820 msgr2=0x7f775415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7754073820 0x7f775415c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 >> v2:172.21.15.134:3300/0 conn(0x7f7754152df0 msgr2=0x7f7754159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 --2- 172.21.15.115:0/85992414 >> v2:172.21.15.134:3300/0 conn(0x7f7754152df0 0x7f7754159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77540c4990 con 0x7f7754152a10 2024-05-12T10:59:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f7744001700 con 0x7f7754152a10 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 >> v1:172.21.15.115:6789/0 conn(0x7f7754152a10 legacy=0x7f7754073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7754073820 0x7f7738005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77380061f0 0x7f7738006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7738006f60 0x7f77380073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7754072cf0 con 0x7f77380061f0 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7754072fd0 con 0x7f7738006f60 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f773800dcc0 con 0x7f7754073820 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f774b400640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77380061f0 0x7f7738006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753e00640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7754073820 0x7f7738005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7759000640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7738006f60 0x7f77380073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f774b400640 1 -- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7754073820 msgr2=0x7f7738005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f774b400640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7754073820 0x7f7738005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f774b400640 1 -- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7738006f60 msgr2=0x7f77380073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f774b400640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7738006f60 0x7f77380073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f774b400640 1 -- 172.21.15.115:0/85992414 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7738005740 con 0x7f77380061f0 2024-05-12T10:59:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7753e00640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7754073820 0x7f7738005c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:59:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.950+0000 7f7759000640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7738006f60 0x7f77380073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:59:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f774b400640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77380061f0 0x7f7738006a20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f773c009ab0 tx=0x7f773c01cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51d1ef941486e2f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c0b2070 con 0x7f77380061f0 2024-05-12T10:59:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f773c0a5720 con 0x7f77380061f0 2024-05-12T10:59:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f7753400640 1 -- 172.21.15.115:0/85992414 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c0096b0 con 0x7f77380061f0 2024-05-12T10:59:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f775b000640 1 -- 172.21.15.115:0/85992414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77380061f0 msgr2=0x7f7738006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f775b000640 1 --2- 172.21.15.115:0/85992414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77380061f0 0x7f7738006a20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f773c009ab0 tx=0x7f773c01cb20 comp rx=0 tx=0).stop 2024-05-12T10:59:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f7759000640 1 -- 172.21.15.115:0/85992414 reap_dead start 2024-05-12T10:59:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f775b000640 1 -- 172.21.15.115:0/85992414 shutdown_connections 2024-05-12T10:59:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f775b000640 1 -- 172.21.15.115:0/85992414 >> 172.21.15.115:0/85992414 conn(0x7f7754076830 msgr2=0x7f77540681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f775b000640 1 -- 172.21.15.115:0/85992414 shutdown_connections 2024-05-12T10:59:16.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f775b000640 1 -- 172.21.15.115:0/85992414 wait complete. 2024-05-12T10:59:16.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.954+0000 7f775b000640 1 Processor -- start 2024-05-12T10:59:16.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f775b000640 1 -- start start 2024-05-12T10:59:16.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f775b000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380061f0 0x7f77541f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f775b000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7754148d80 0x7f77541491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f775b000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7754158180 0x7f7754158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f775b000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7754073460 con 0x7f7754148d80 2024-05-12T10:59:16.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f775b000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77540c4f50 con 0x7f7754158180 2024-05-12T10:59:16.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f775b000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f77540735e0 con 0x7f77380061f0 2024-05-12T10:59:16.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f774b400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7754148d80 0x7f77541491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f774b400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7754148d80 0x7f77541491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40538/0 (socket says 172.21.15.115:40538) 2024-05-12T10:59:16.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f774b400640 1 -- 172.21.15.115:0/280773751 learned_addr learned my addr 172.21.15.115:0/280773751 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f7753e00640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380061f0 0x7f77541f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f7759000640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7754158180 0x7f7754158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f774b400640 1 -- 172.21.15.115:0/280773751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380061f0 msgr2=0x7f77541f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f774b400640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380061f0 0x7f77541f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f774b400640 1 -- 172.21.15.115:0/280773751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7754158180 msgr2=0x7f7754158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f774b400640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7754158180 0x7f7754158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f774b400640 1 -- 172.21.15.115:0/280773751 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7754155ab0 con 0x7f7754148d80 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f774b400640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7754148d80 0x7f77541491e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f773c01c950 tx=0x7f7738007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f7750c00640 1 -- 172.21.15.115:0/280773751 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c0bf070 con 0x7f7754148d80 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f7750c00640 1 -- 172.21.15.115:0/280773751 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f773c004230 con 0x7f7754148d80 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f7750c00640 1 -- 172.21.15.115:0/280773751 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c0b2040 con 0x7f7754148d80 2024-05-12T10:59:16.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f775b000640 1 -- 172.21.15.115:0/280773751 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7754155d90 con 0x7f7754148d80 2024-05-12T10:59:16.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f775b000640 1 -- 172.21.15.115:0/280773751 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77541570d0 con 0x7f7754148d80 2024-05-12T10:59:16.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.958+0000 7f775b000640 1 -- 172.21.15.115:0/280773751 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7754069730 con 0x7f7754148d80 2024-05-12T10:59:16.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.962+0000 7f7750c00640 1 -- 172.21.15.115:0/280773751 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f773c003620 con 0x7f7754148d80 2024-05-12T10:59:16.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.962+0000 7f7750c00640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f773006f400 0x7f77300718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:16.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.962+0000 7f7750c00640 1 -- 172.21.15.115:0/280773751 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f773c1295f0 con 0x7f7754148d80 2024-05-12T10:59:16.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.962+0000 7f7753e00640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f773006f400 0x7f77300718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:16.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.962+0000 7f7753e00640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f773006f400 0x7f77300718c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f77440059a0 tx=0x7f7744009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:16.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:16.966+0000 7f7750c00640 1 -- 172.21.15.115:0/280773751 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f773c0167a0 con 0x7f7754148d80 2024-05-12T10:59:17.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.122+0000 7f775b000640 1 -- 172.21.15.115:0/280773751 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f77540c52f0 con 0x7f7754148d80 2024-05-12T10:59:17.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.126+0000 7f7750c00640 1 -- 172.21.15.115:0/280773751 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f773c0f5a80 con 0x7f7754148d80 2024-05-12T10:59:17.118 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.126+0000 7f7750c00640 1 -- 172.21.15.115:0/280773751 <== mon.0 v2:172.21.15.115:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f773c0f5590 con 0x7f7754148d80 2024-05-12T10:59:17.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 -- 172.21.15.115:0/280773751 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f773006f400 msgr2=0x7f77300718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f773006f400 0x7f77300718c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f77440059a0 tx=0x7f7744009040 comp rx=0 tx=0).stop 2024-05-12T10:59:17.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 -- 172.21.15.115:0/280773751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7754148d80 msgr2=0x7f77541491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7754148d80 0x7f77541491e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f773c01c950 tx=0x7f7738007a50 comp rx=0 tx=0).stop 2024-05-12T10:59:17.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 -- 172.21.15.115:0/280773751 shutdown_connections 2024-05-12T10:59:17.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f773006f400 0x7f77300718c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7754158180 0x7f7754158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7754148d80 0x7f77541491e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 --2- 172.21.15.115:0/280773751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380061f0 0x7f77541f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 -- 172.21.15.115:0/280773751 >> 172.21.15.115:0/280773751 conn(0x7f7754076830 msgr2=0x7f77540c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:17.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 -- 172.21.15.115:0/280773751 shutdown_connections 2024-05-12T10:59:17.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.130+0000 7f775b000640 1 -- 172.21.15.115:0/280773751 wait complete. 2024-05-12T10:59:17.140 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-12T10:59:17.141 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:59:17.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b9e600640 1 Processor -- start 2024-05-12T10:59:17.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b9e600640 1 -- start start 2024-05-12T10:59:17.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b9e600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0b98153de0 0x7f0b980c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b9e600640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9815ab40 con 0x7f0b980cb4e0 2024-05-12T10:59:17.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b9e600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b98159ce0 con 0x7f0b980ca040 2024-05-12T10:59:17.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b9e600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0b98159fc0 con 0x7f0b98153de0 2024-05-12T10:59:17.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b97e00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0b980cb4e0 0x7f0b980cb930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51738/0 (socket says 172.21.15.115:51738) 2024-05-12T10:59:17.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b97e00640 1 -- 172.21.15.115:0/1754251370 learned_addr learned my addr 172.21.15.115:0/1754251370 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:59:17.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b97400640 1 --2- 172.21.15.115:0/1754251370 >> v2:172.21.15.134:3300/0 conn(0x7f0b98153de0 0x7f0b980c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2757654285 0 0) 0x7f0b9815ab40 con 0x7f0b980cb4e0 2024-05-12T10:59:17.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b7c003530 con 0x7f0b980cb4e0 2024-05-12T10:59:17.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 466473550 0 0) 0x7f0b7c003530 con 0x7f0b980cb4e0 2024-05-12T10:59:17.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 >> v2:172.21.15.134:3300/0 conn(0x7f0b98153de0 msgr2=0x7f0b980c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:17.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 --2- 172.21.15.115:0/1754251370 >> v2:172.21.15.134:3300/0 conn(0x7f0b98153de0 0x7f0b980c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 >> v1:172.21.15.134:6789/0 conn(0x7f0b980ca040 legacy=0x7f0b980cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9815a2a0 con 0x7f0b980cb4e0 2024-05-12T10:59:17.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f0b90001a80 con 0x7f0b980cb4e0 2024-05-12T10:59:17.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 >> v1:172.21.15.115:6789/0 conn(0x7f0b980cb4e0 legacy=0x7f0b980cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c003a60 0x7f0b7c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b7c004810 0x7f0b7c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b7c0051d0 0x7f0b7c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0b98159fc0 con 0x7f0b7c003a60 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c00c150 con 0x7f0b7c004810 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.286+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7c00c350 con 0x7f0b7c0051d0 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b97400640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c003a60 0x7f0b7c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b97e00640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b7c0051d0 0x7f0b7c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b96a00640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b7c004810 0x7f0b7c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b97400640 1 -- 172.21.15.115:0/1754251370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b7c0051d0 msgr2=0x7f0b7c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b97400640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b7c0051d0 0x7f0b7c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b97400640 1 -- 172.21.15.115:0/1754251370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b7c004810 msgr2=0x7f0b7c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b97400640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b7c004810 0x7f0b7c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b97400640 1 -- 172.21.15.115:0/1754251370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c003530 con 0x7f0b7c003a60 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b96a00640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b7c004810 0x7f0b7c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:59:17.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b97e00640 1 -- 172.21.15.115:0/1754251370 reap_dead start 2024-05-12T10:59:17.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b97400640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c003a60 0x7f0b7c003e80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009ae0 tx=0x7f0b8801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a1f897ed0a09fe server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:17.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b880b2070 con 0x7f0b7c003a60 2024-05-12T10:59:17.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0b880a5680 con 0x7f0b7c003a60 2024-05-12T10:59:17.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b96000640 1 -- 172.21.15.115:0/1754251370 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b880096b0 con 0x7f0b7c003a60 2024-05-12T10:59:17.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b9e600640 1 -- 172.21.15.115:0/1754251370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c003a60 msgr2=0x7f0b7c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.290+0000 7f0b9e600640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c003a60 0x7f0b7c003e80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009ae0 tx=0x7f0b8801ca90 comp rx=0 tx=0).stop 2024-05-12T10:59:17.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 -- 172.21.15.115:0/1754251370 shutdown_connections 2024-05-12T10:59:17.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 --2- 172.21.15.115:0/1754251370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c003a60 0x7f0b7c003e80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 -- 172.21.15.115:0/1754251370 >> 172.21.15.115:0/1754251370 conn(0x7f0b9806c440 msgr2=0x7f0b9806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:17.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 -- 172.21.15.115:0/1754251370 shutdown_connections 2024-05-12T10:59:17.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 -- 172.21.15.115:0/1754251370 wait complete. 2024-05-12T10:59:17.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 Processor -- start 2024-05-12T10:59:17.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 -- start start 2024-05-12T10:59:17.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b7c003a60 0x7f0b981f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b980cf110 0x7f0b9806d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b98149960 0x7f0b980b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9806d0b0 con 0x7f0b980cf110 2024-05-12T10:59:17.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9815a860 con 0x7f0b98149960 2024-05-12T10:59:17.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b9e600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0b981541c0 con 0x7f0b7c003a60 2024-05-12T10:59:17.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b96a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b980cf110 0x7f0b9806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b96a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b980cf110 0x7f0b9806d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40550/0 (socket says 172.21.15.115:40550) 2024-05-12T10:59:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b96a00640 1 -- 172.21.15.115:0/276419379 learned_addr learned my addr 172.21.15.115:0/276419379 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b97400640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b7c003a60 0x7f0b981f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b97e00640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b98149960 0x7f0b980b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b96a00640 1 -- 172.21.15.115:0/276419379 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b7c003a60 msgr2=0x7f0b981f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b96a00640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b7c003a60 0x7f0b981f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b96a00640 1 -- 172.21.15.115:0/276419379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b98149960 msgr2=0x7f0b980b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b96a00640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b98149960 0x7f0b980b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b96a00640 1 -- 172.21.15.115:0/276419379 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b98158720 con 0x7f0b980cf110 2024-05-12T10:59:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b96a00640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b980cf110 0x7f0b9806d550 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400e7e0 tx=0x7f0b8400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:17.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b8f400640 1 -- 172.21.15.115:0/276419379 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b840050d0 con 0x7f0b980cf110 2024-05-12T10:59:17.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b8f400640 1 -- 172.21.15.115:0/276419379 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0b84005270 con 0x7f0b980cf110 2024-05-12T10:59:17.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.294+0000 7f0b8f400640 1 -- 172.21.15.115:0/276419379 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84005460 con 0x7f0b980cf110 2024-05-12T10:59:17.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.298+0000 7f0b9e600640 1 -- 172.21.15.115:0/276419379 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b981f5970 con 0x7f0b980cf110 2024-05-12T10:59:17.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.298+0000 7f0b9e600640 1 -- 172.21.15.115:0/276419379 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b981f2840 con 0x7f0b980cf110 2024-05-12T10:59:17.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.298+0000 7f0b9e600640 1 -- 172.21.15.115:0/276419379 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b98069730 con 0x7f0b980cf110 2024-05-12T10:59:17.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.298+0000 7f0b8f400640 1 -- 172.21.15.115:0/276419379 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0b8401a020 con 0x7f0b980cf110 2024-05-12T10:59:17.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.298+0000 7f0b8f400640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b7806f400 0x7f0b780718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.298+0000 7f0b8f400640 1 -- 172.21.15.115:0/276419379 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f0b8408ed50 con 0x7f0b980cf110 2024-05-12T10:59:17.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.298+0000 7f0b97400640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b7806f400 0x7f0b780718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.302+0000 7f0b97400640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b7806f400 0x7f0b780718c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b880af000 tx=0x7f0b880046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:17.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.302+0000 7f0b8f400640 1 -- 172.21.15.115:0/276419379 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0b8405b8c0 con 0x7f0b980cf110 2024-05-12T10:59:17.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.494+0000 7f0b9e600640 1 -- 172.21.15.115:0/276419379 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b980c5d50 con 0x7f0b980cf110 2024-05-12T10:59:17.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.494+0000 7f0b8f400640 1 -- 172.21.15.115:0/276419379 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f0b8405b1c0 con 0x7f0b980cf110 2024-05-12T10:59:17.485 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:59:17.485 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:59:17.486 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:59:17.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 -- 172.21.15.115:0/276419379 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b7806f400 msgr2=0x7f0b780718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b7806f400 0x7f0b780718c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b880af000 tx=0x7f0b880046d0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 -- 172.21.15.115:0/276419379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b980cf110 msgr2=0x7f0b9806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b980cf110 0x7f0b9806d550 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400e7e0 tx=0x7f0b8400eca0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 -- 172.21.15.115:0/276419379 shutdown_connections 2024-05-12T10:59:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0b7806f400 0x7f0b780718c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b98149960 0x7f0b980b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b980cf110 0x7f0b9806d550 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 --2- 172.21.15.115:0/276419379 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b7c003a60 0x7f0b981f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 -- 172.21.15.115:0/276419379 >> 172.21.15.115:0/276419379 conn(0x7f0b9806c440 msgr2=0x7f0b981e7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 -- 172.21.15.115:0/276419379 shutdown_connections 2024-05-12T10:59:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.498+0000 7f0b9e600640 1 -- 172.21.15.115:0/276419379 wait complete. 2024-05-12T10:59:17.507 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T10:59:17.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.650+0000 7f3ad8000640 1 Processor -- start 2024-05-12T10:59:17.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.650+0000 7f3ad8000640 1 -- start start 2024-05-12T10:59:17.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad8000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3ad0152350 0x7f3ad00723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad8000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00c5dc0 0x7f3ad00ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad8000640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad00c8830 con 0x7f3ad015b6e0 2024-05-12T10:59:17.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad8000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad00c9fe0 con 0x7f3ad0152350 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad8000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad00ca9b0 con 0x7f3ad00c5dc0 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad6000640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3ad015b6e0 0x7f3ad015bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51750/0 (socket says 172.21.15.115:51750) 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad6000640 1 -- 172.21.15.115:0/824860821 learned_addr learned my addr 172.21.15.115:0/824860821 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad4c00640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00c5dc0 0x7f3ad00ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad5600640 1 --2- 172.21.15.115:0/824860821 >> v2:172.21.15.134:3300/0 conn(0x7f3ad0152350 0x7f3ad00723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938548561 0 0) 0x7f3ad00c8830 con 0x7f3ad015b6e0 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ab8003530 con 0x7f3ad015b6e0 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2842030952 0 0) 0x7f3ab8003530 con 0x7f3ad015b6e0 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00c5dc0 msgr2=0x7f3ad00ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00c5dc0 0x7f3ad00ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 >> v2:172.21.15.134:3300/0 conn(0x7f3ad0152350 msgr2=0x7f3ad00723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 --2- 172.21.15.115:0/824860821 >> v2:172.21.15.134:3300/0 conn(0x7f3ad0152350 0x7f3ad00723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad00c8af0 con 0x7f3ad015b6e0 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7f3ac8001a80 con 0x7f3ad015b6e0 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 >> v1:172.21.15.115:6789/0 conn(0x7f3ad015b6e0 legacy=0x7f3ad015bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ab8003a10 0x7f3ab8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00c5dc0 0x7f3ab8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00c9fe0 con 0x7f3ab8004d50 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00ca9b0 con 0x7f3ab8003a10 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab800b9d0 con 0x7f3ad00c5dc0 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad6000640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad5600640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ab8003a10 0x7f3ab8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad4c00640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00c5dc0 0x7f3ab8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad6000640 1 -- 172.21.15.115:0/824860821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00c5dc0 msgr2=0x7f3ab8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad6000640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00c5dc0 0x7f3ab8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad6000640 1 -- 172.21.15.115:0/824860821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ab8003a10 msgr2=0x7f3ab8003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:17.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad6000640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ab8003a10 0x7f3ab8003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.654+0000 7f3ad6000640 1 -- 172.21.15.115:0/824860821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab8003530 con 0x7f3ab8004d50 2024-05-12T10:59:17.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.658+0000 7f3ad6000640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800a920 tx=0x7f3ac801d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5c4050c5978004 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:17.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.658+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac800a4c0 con 0x7f3ab8004d50 2024-05-12T10:59:17.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.658+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3ac80ad650 con 0x7f3ab8004d50 2024-05-12T10:59:17.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.658+0000 7f3acfe00640 1 -- 172.21.15.115:0/824860821 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80ada60 con 0x7f3ab8004d50 2024-05-12T10:59:17.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.658+0000 7f3ad8000640 1 -- 172.21.15.115:0/824860821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ab8004d50 msgr2=0x7f3ab80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.658+0000 7f3ad8000640 1 --2- 172.21.15.115:0/824860821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800a920 tx=0x7f3ac801d3a0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.658+0000 7f3ad6000640 1 -- 172.21.15.115:0/824860821 reap_dead start 2024-05-12T10:59:17.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.658+0000 7f3ad8000640 1 -- 172.21.15.115:0/824860821 shutdown_connections 2024-05-12T10:59:17.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.658+0000 7f3ad8000640 1 -- 172.21.15.115:0/824860821 >> 172.21.15.115:0/824860821 conn(0x7f3ad00681c0 msgr2=0x7f3ad00685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:17.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.658+0000 7f3ad8000640 1 -- 172.21.15.115:0/824860821 shutdown_connections 2024-05-12T10:59:17.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.658+0000 7f3ad8000640 1 -- 172.21.15.115:0/824860821 wait complete. 2024-05-12T10:59:17.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad8000640 1 Processor -- start 2024-05-12T10:59:17.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad8000640 1 -- start start 2024-05-12T10:59:17.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad8000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00cc5b0 0x7f3ad0149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad8000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ad00cc990 0x7f3ad01f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad8000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad014a790 0x7f3ad01f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad8000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00c9c70 con 0x7f3ad014a790 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad8000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00c9990 con 0x7f3ad00cc990 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad8000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad00ce1f0 con 0x7f3ad00cc5b0 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad6000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad014a790 0x7f3ad01f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad5600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00cc5b0 0x7f3ad0149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad6000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad014a790 0x7f3ad01f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40560/0 (socket says 172.21.15.115:40560) 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad6000640 1 -- 172.21.15.115:0/1802361817 learned_addr learned my addr 172.21.15.115:0/1802361817 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad4c00640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ad00cc990 0x7f3ad01f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad6000640 1 -- 172.21.15.115:0/1802361817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00cc5b0 msgr2=0x7f3ad0149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad6000640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00cc5b0 0x7f3ad0149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad6000640 1 -- 172.21.15.115:0/1802361817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ad00cc990 msgr2=0x7f3ad01f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad6000640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ad00cc990 0x7f3ad01f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad6000640 1 -- 172.21.15.115:0/1802361817 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad01f5340 con 0x7f3ad014a790 2024-05-12T10:59:17.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad6000640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad014a790 0x7f3ad01f39d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3ac801ce60 tx=0x7f3ab8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:17.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3acd600640 1 -- 172.21.15.115:0/1802361817 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80ba070 con 0x7f3ad014a790 2024-05-12T10:59:17.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3acd600640 1 -- 172.21.15.115:0/1802361817 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3ac8001840 con 0x7f3ad014a790 2024-05-12T10:59:17.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad8000640 1 -- 172.21.15.115:0/1802361817 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad01f5600 con 0x7f3ad014a790 2024-05-12T10:59:17.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3acd600640 1 -- 172.21.15.115:0/1802361817 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac800a4c0 con 0x7f3ad014a790 2024-05-12T10:59:17.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad8000640 1 -- 172.21.15.115:0/1802361817 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad01f2c90 con 0x7f3ad014a790 2024-05-12T10:59:17.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.662+0000 7f3ad8000640 1 -- 172.21.15.115:0/1802361817 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad0069730 con 0x7f3ad014a790 2024-05-12T10:59:17.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.666+0000 7f3acd600640 1 -- 172.21.15.115:0/1802361817 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3ac80bd070 con 0x7f3ad014a790 2024-05-12T10:59:17.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.666+0000 7f3acd600640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3ab006f400 0x7f3ab00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.666+0000 7f3acd600640 1 -- 172.21.15.115:0/1802361817 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f3ac81292d0 con 0x7f3ad014a790 2024-05-12T10:59:17.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.666+0000 7f3ad5600640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3ab006f400 0x7f3ab00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.666+0000 7f3ad5600640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3ab006f400 0x7f3ab00718c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4009ae0 tx=0x7f3ac4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:17.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.670+0000 7f3acd600640 1 -- 172.21.15.115:0/1802361817 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3ac8017150 con 0x7f3ad014a790 2024-05-12T10:59:17.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.862+0000 7f3ad8000640 1 -- 172.21.15.115:0/1802361817 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ad00c9560 con 0x7f3ad014a790 2024-05-12T10:59:17.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.862+0000 7f3acd600640 1 -- 172.21.15.115:0/1802361817 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6887 (secure 0 0 0) 0x7f3ac80f56d0 con 0x7f3ad014a790 2024-05-12T10:59:17.855 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:59:17.855 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6838/2759111691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2759111691},{"type":"v1","addr":"172.21.15.115:6838","nonce":2759111691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2886699729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2886699729},{"type":"v1","addr":"172.21.15.134:6833","nonce":2886699729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/3824874060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":3824874060},{"type":"v1","addr":"172.21.15.134:6837","nonce":3824874060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T10:49:54.988983+0000","modified":"2024-05-12T10:50:29.799298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4321,"mds_1":4309,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6839/3194167246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3194167246},{"type":"v1","addr":"172.21.15.115:6839","nonce":3194167246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/4177777929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4177777929},{"type":"v1","addr":"172.21.15.115:6837","nonce":4177777929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6835/1447701149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1447701149},{"type":"v1","addr":"172.21.15.134:6835","nonce":1447701149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4260,4309,4321]},"id":1}]} 2024-05-12T10:59:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 14 2024-05-12T10:59:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 -- 172.21.15.115:0/1802361817 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3ab006f400 msgr2=0x7f3ab00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3ab006f400 0x7f3ab00718c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4009ae0 tx=0x7f3ac4008040 comp rx=0 tx=0).stop 2024-05-12T10:59:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 -- 172.21.15.115:0/1802361817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad014a790 msgr2=0x7f3ad01f39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad014a790 0x7f3ad01f39d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3ac801ce60 tx=0x7f3ab8005840 comp rx=0 tx=0).stop 2024-05-12T10:59:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 -- 172.21.15.115:0/1802361817 shutdown_connections 2024-05-12T10:59:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f3ab006f400 0x7f3ab00718c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ad014a790 0x7f3ad01f39d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ad00cc990 0x7f3ad01f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 --2- 172.21.15.115:0/1802361817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ad00cc5b0 0x7f3ad0149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 -- 172.21.15.115:0/1802361817 >> 172.21.15.115:0/1802361817 conn(0x7f3ad00681c0 msgr2=0x7f3ad00685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 -- 172.21.15.115:0/1802361817 shutdown_connections 2024-05-12T10:59:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:17.866+0000 7f3ad8000640 1 -- 172.21.15.115:0/1802361817 wait complete. 2024-05-12T10:59:17.875 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T10:59:18.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efcd4a00640 1 Processor -- start 2024-05-12T10:59:18.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efcd4a00640 1 -- start start 2024-05-12T10:59:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efcd4a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcd0159430 0x7efcd00cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efcd4a00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efcd00c9fd0 0x7efcd00cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efcd4a00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd00c5050 con 0x7efcd00c45f0 2024-05-12T10:59:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efcd4a00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7efcd00c5c20 con 0x7efcd00c9fd0 2024-05-12T10:59:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efcd4a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7efcd00c52f0 con 0x7efcd0159430 2024-05-12T10:59:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efccd400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efcd00c9fd0 0x7efcd00cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efcce800640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efcd00c45f0 0x7efcd015f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51760/0 (socket says 172.21.15.115:51760) 2024-05-12T10:59:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efcce800640 1 -- 172.21.15.115:0/3715271023 learned_addr learned my addr 172.21.15.115:0/3715271023 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:59:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efccde00640 1 --2- 172.21.15.115:0/3715271023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcd0159430 0x7efcd00cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efccd400640 1 -- 172.21.15.115:0/3715271023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcd0159430 msgr2=0x7efcd00cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:18.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efccd400640 1 --2- 172.21.15.115:0/3715271023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcd0159430 0x7efcd00cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efccd400640 1 -- 172.21.15.115:0/3715271023 >> v1:172.21.15.115:6789/0 conn(0x7efcd00c45f0 legacy=0x7efcd015f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.022+0000 7efccd400640 1 -- 172.21.15.115:0/3715271023 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd00c55d0 con 0x7efcd00c9fd0 2024-05-12T10:59:18.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efccd400640 1 --2- 172.21.15.115:0/3715271023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c9fd0 0x7efcd00cfaa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0097c0 tx=0x7efcbc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6f9ae400863125 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:18.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efccca00640 1 -- 172.21.15.115:0/3715271023 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc0b5070 con 0x7efcd00c9fd0 2024-05-12T10:59:18.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efccca00640 1 -- 172.21.15.115:0/3715271023 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efcbc0a8990 con 0x7efcd00c9fd0 2024-05-12T10:59:18.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efccca00640 1 -- 172.21.15.115:0/3715271023 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc0a8d80 con 0x7efcd00c9fd0 2024-05-12T10:59:18.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efcd4a00640 1 -- 172.21.15.115:0/3715271023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c9fd0 msgr2=0x7efcd00cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efcd4a00640 1 --2- 172.21.15.115:0/3715271023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c9fd0 0x7efcd00cfaa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0097c0 tx=0x7efcbc01ec90 comp rx=0 tx=0).stop 2024-05-12T10:59:18.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efcd4a00640 1 -- 172.21.15.115:0/3715271023 shutdown_connections 2024-05-12T10:59:18.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efcd4a00640 1 --2- 172.21.15.115:0/3715271023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c9fd0 0x7efcd00cfaa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efcd4a00640 1 --2- 172.21.15.115:0/3715271023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcd0159430 0x7efcd00cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efcd4a00640 1 -- 172.21.15.115:0/3715271023 >> 172.21.15.115:0/3715271023 conn(0x7efcd006c440 msgr2=0x7efcd006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:18.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efcd4a00640 1 -- 172.21.15.115:0/3715271023 shutdown_connections 2024-05-12T10:59:18.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.026+0000 7efcd4a00640 1 -- 172.21.15.115:0/3715271023 wait complete. 2024-05-12T10:59:18.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcd4a00640 1 Processor -- start 2024-05-12T10:59:18.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcd4a00640 1 -- start start 2024-05-12T10:59:18.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcd4a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcd00c45f0 0x7efcd015d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcd4a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c9fd0 0x7efcd01584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcd4a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcd0159430 0x7efcd01f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcd4a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efcd006d180 con 0x7efcd00c9fd0 2024-05-12T10:59:18.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcd4a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efcd00ca580 con 0x7efcd0159430 2024-05-12T10:59:18.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcd4a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7efcd00cbcc0 con 0x7efcd00c45f0 2024-05-12T10:59:18.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efccd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c9fd0 0x7efcd01584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efccd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c9fd0 0x7efcd01584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40586/0 (socket says 172.21.15.115:40586) 2024-05-12T10:59:18.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efccd400640 1 -- 172.21.15.115:0/2237046336 learned_addr learned my addr 172.21.15.115:0/2237046336 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efccde00640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcd00c45f0 0x7efcd015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcce800640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcd0159430 0x7efcd01f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efccd400640 1 -- 172.21.15.115:0/2237046336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcd00c45f0 msgr2=0x7efcd015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efccd400640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcd00c45f0 0x7efcd015d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efccd400640 1 -- 172.21.15.115:0/2237046336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcd0159430 msgr2=0x7efcd01f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efccd400640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcd0159430 0x7efcd01f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efccd400640 1 -- 172.21.15.115:0/2237046336 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd015d200 con 0x7efcd00c9fd0 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efccd400640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c9fd0 0x7efcd01584e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efcbc01c8c0 tx=0x7efcbc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcc6000640 1 -- 172.21.15.115:0/2237046336 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc0bf070 con 0x7efcd00c9fd0 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcc6000640 1 -- 172.21.15.115:0/2237046336 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efcbc0b0840 con 0x7efcd00c9fd0 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcc6000640 1 -- 172.21.15.115:0/2237046336 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc0b5040 con 0x7efcd00c9fd0 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcd4a00640 1 -- 172.21.15.115:0/2237046336 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd0156e10 con 0x7efcd00c9fd0 2024-05-12T10:59:18.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.030+0000 7efcd4a00640 1 -- 172.21.15.115:0/2237046336 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd0157a00 con 0x7efcd00c9fd0 2024-05-12T10:59:18.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.034+0000 7efcd4a00640 1 -- 172.21.15.115:0/2237046336 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd0069730 con 0x7efcd00c9fd0 2024-05-12T10:59:18.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.034+0000 7efcc6000640 1 -- 172.21.15.115:0/2237046336 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efcbc0b0c50 con 0x7efcd00c9fd0 2024-05-12T10:59:18.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.034+0000 7efcc6000640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efcb006f400 0x7efcb00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.034+0000 7efcc6000640 1 -- 172.21.15.115:0/2237046336 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7efcbc12c2b0 con 0x7efcd00c9fd0 2024-05-12T10:59:18.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.034+0000 7efccde00640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efcb006f400 0x7efcb00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.034+0000 7efccde00640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efcb006f400 0x7efcb00718c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efcc0003fd0 tx=0x7efcc00039a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:18.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.038+0000 7efcc6000640 1 -- 172.21.15.115:0/2237046336 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efcbc0187f0 con 0x7efcd00c9fd0 2024-05-12T10:59:18.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.198+0000 7efcd4a00640 1 -- 172.21.15.115:0/2237046336 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcd0074a40 con 0x7efcd00c9fd0 2024-05-12T10:59:18.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcc6000640 1 -- 172.21.15.115:0/2237046336 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18937 (secure 0 0 0) 0x7efcbc0f8d00 con 0x7efcd00c9fd0 2024-05-12T10:59:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-12T10:59:18.191 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":28,"fsid":"afd333ea-2e10-495a-8d22-6858d0930293","created":"2024-05-12T10:49:30.675908+0000","modified":"2024-05-12T10:50:36.829784+0000","last_up_change":"2024-05-12T10:49:42.764006+0000","last_in_change":"2024-05-12T10:49:33.776335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T10:49:43.775255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T10:49:52.875093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T10:49:53.948934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-12T10:49:57.630868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a93a5fef-2bc2-4ae6-a802-be3c7062240d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6818","nonce":199636976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6821","nonce":199636976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6827","nonce":199636976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":199636976},{"type":"v1","addr":"172.21.15.115:6824","nonce":199636976}]},"public_addr":"172.21.15.115:6818/199636976","cluster_addr":"172.21.15.115:6821/199636976","heartbeat_back_addr":"172.21.15.115:6827/199636976","heartbeat_front_addr":"172.21.15.115:6824/199636976","state":["exists","up"]},{"osd":1,"uuid":"f712194a-ad33-462b-9529-36b3b80534eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6801","nonce":2401741239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6805","nonce":2401741239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6814","nonce":2401741239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2401741239},{"type":"v1","addr":"172.21.15.115:6810","nonce":2401741239}]},"public_addr":"172.21.15.115:6801/2401741239","cluster_addr":"172.21.15.115:6805/2401741239","heartbeat_back_addr":"172.21.15.115:6814/2401741239","heartbeat_front_addr":"172.21.15.115:6810/2401741239","state":["exists","up"]},{"osd":2,"uuid":"d412980d-26c6-43de-bc4b-83ab555bf3d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6820","nonce":332404290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6825","nonce":332404290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6831","nonce":332404290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":332404290},{"type":"v1","addr":"172.21.15.115:6829","nonce":332404290}]},"public_addr":"172.21.15.115:6820/332404290","cluster_addr":"172.21.15.115:6825/332404290","heartbeat_back_addr":"172.21.15.115:6831/332404290","heartbeat_front_addr":"172.21.15.115:6829/332404290","state":["exists","up"]},{"osd":3,"uuid":"8e841228-02a1-46d6-819a-6a1a3002468e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6804","nonce":1329544943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6807","nonce":1329544943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6815","nonce":1329544943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":1329544943},{"type":"v1","addr":"172.21.15.115:6811","nonce":1329544943}]},"public_addr":"172.21.15.115:6804/1329544943","cluster_addr":"172.21.15.115:6807/1329544943","heartbeat_back_addr":"172.21.15.115:6815/1329544943","heartbeat_front_addr":"172.21.15.115:6811/1329544943","state":["exists","up"]},{"osd":4,"uuid":"8da67b2b-0ff3-4c28-897c-a8258a921018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6801","nonce":3949181256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6803","nonce":3949181256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6807","nonce":3949181256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3949181256},{"type":"v1","addr":"172.21.15.134:6805","nonce":3949181256}]},"public_addr":"172.21.15.134:6801/3949181256","cluster_addr":"172.21.15.134:6803/3949181256","heartbeat_back_addr":"172.21.15.134:6807/3949181256","heartbeat_front_addr":"172.21.15.134:6805/3949181256","state":["exists","up"]},{"osd":5,"uuid":"fbeadb06-c696-4622-9d01-afd560a079b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6809","nonce":2656330194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6811","nonce":2656330194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6815","nonce":2656330194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2656330194},{"type":"v1","addr":"172.21.15.134:6813","nonce":2656330194}]},"public_addr":"172.21.15.134:6809/2656330194","cluster_addr":"172.21.15.134:6811/2656330194","heartbeat_back_addr":"172.21.15.134:6815/2656330194","heartbeat_front_addr":"172.21.15.134:6813/2656330194","state":["exists","up"]},{"osd":6,"uuid":"dc049525-926c-4a7e-9565-165f10c8ae86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6825","nonce":1206319910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6827","nonce":1206319910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6831","nonce":1206319910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1206319910},{"type":"v1","addr":"172.21.15.134:6829","nonce":1206319910}]},"public_addr":"172.21.15.134:6825/1206319910","cluster_addr":"172.21.15.134:6827/1206319910","heartbeat_back_addr":"172.21.15.134:6831/1206319910","heartbeat_front_addr":"172.21.15.134:6829/1206319910","state":["exists","up"]},{"osd":7,"uuid":"b2137503-2e6b-4dfd-b795-4d1906824e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6817","nonce":3958491632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6819","nonce":3958491632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6823","nonce":3958491632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3958491632},{"type":"v1","addr":"172.21.15.134:6821","nonce":3958491632}]},"public_addr":"172.21.15.134:6817/3958491632","cluster_addr":"172.21.15.134:6819/3958491632","heartbeat_back_addr":"172.21.15.134:6823/3958491632","heartbeat_front_addr":"172.21.15.134:6821/3958491632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.498491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.572737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.787969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.727510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.268339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.392317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.315271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T10:49:39.342221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T10:59:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 -- 172.21.15.115:0/2237046336 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efcb006f400 msgr2=0x7efcb00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efcb006f400 0x7efcb00718c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efcc0003fd0 tx=0x7efcc00039a0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 -- 172.21.15.115:0/2237046336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c9fd0 msgr2=0x7efcd01584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c9fd0 0x7efcd01584e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efcbc01c8c0 tx=0x7efcbc01ba30 comp rx=0 tx=0).stop 2024-05-12T10:59:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 -- 172.21.15.115:0/2237046336 shutdown_connections 2024-05-12T10:59:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7efcb006f400 0x7efcb00718c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcd0159430 0x7efcd01f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c9fd0 0x7efcd01584e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 --2- 172.21.15.115:0/2237046336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcd00c45f0 0x7efcd015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 -- 172.21.15.115:0/2237046336 >> 172.21.15.115:0/2237046336 conn(0x7efcd006c440 msgr2=0x7efcd006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:18.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 -- 172.21.15.115:0/2237046336 shutdown_connections 2024-05-12T10:59:18.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.202+0000 7efcd4a00640 1 -- 172.21.15.115:0/2237046336 wait complete. 2024-05-12T10:59:18.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-12T10:59:18.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.358+0000 7fcf1e600640 1 Processor -- start 2024-05-12T10:59:18.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.358+0000 7fcf1e600640 1 -- start start 2024-05-12T10:59:18.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.358+0000 7fcf1e600640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf180b20a0 0x7fcf1815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.358+0000 7fcf1e600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf18071a30 0x7fcf180cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.358+0000 7fcf1e600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf180ca040 con 0x7fcf180cae10 2024-05-12T10:59:18.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.358+0000 7fcf1e600640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fcf180ca980 con 0x7fcf180b20a0 2024-05-12T10:59:18.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.358+0000 7fcf1e600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcf180cbde0 con 0x7fcf18071a30 2024-05-12T10:59:18.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.358+0000 7fcf17400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf180b20a0 0x7fcf1815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.358+0000 7fcf17400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcf180b20a0 0x7fcf1815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40588/0 (socket says 172.21.15.115:40588) 2024-05-12T10:59:18.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.358+0000 7fcf17400640 1 -- 172.21.15.115:0/1604281633 learned_addr learned my addr 172.21.15.115:0/1604281633 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:18.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.362+0000 7fcf16a00640 1 --2- 172.21.15.115:0/1604281633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf18071a30 0x7fcf180cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.362+0000 7fcf17400640 1 -- 172.21.15.115:0/1604281633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf18071a30 msgr2=0x7fcf180cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:18.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.362+0000 7fcf17400640 1 --2- 172.21.15.115:0/1604281633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf18071a30 0x7fcf180cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.362+0000 7fcf17400640 1 -- 172.21.15.115:0/1604281633 >> v1:172.21.15.134:6789/0 conn(0x7fcf180cae10 legacy=0x7fcf1815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.362+0000 7fcf17400640 1 -- 172.21.15.115:0/1604281633 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf18071260 con 0x7fcf180b20a0 2024-05-12T10:59:18.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.362+0000 7fcf17400640 1 --2- 172.21.15.115:0/1604281633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf180b20a0 0x7fcf1815be00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009e50 tx=0x7fcf0801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90eef5baacd3d79e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:18.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.362+0000 7fcf16000640 1 -- 172.21.15.115:0/1604281633 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf080b4070 con 0x7fcf180b20a0 2024-05-12T10:59:18.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.362+0000 7fcf16000640 1 -- 172.21.15.115:0/1604281633 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcf080af400 con 0x7fcf180b20a0 2024-05-12T10:59:18.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.362+0000 7fcf16000640 1 -- 172.21.15.115:0/1604281633 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf080af7f0 con 0x7fcf180b20a0 2024-05-12T10:59:18.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 -- 172.21.15.115:0/1604281633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf180b20a0 msgr2=0x7fcf1815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 --2- 172.21.15.115:0/1604281633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf180b20a0 0x7fcf1815be00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009e50 tx=0x7fcf0801f210 comp rx=0 tx=0).stop 2024-05-12T10:59:18.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 -- 172.21.15.115:0/1604281633 shutdown_connections 2024-05-12T10:59:18.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 --2- 172.21.15.115:0/1604281633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf18071a30 0x7fcf180cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 --2- 172.21.15.115:0/1604281633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf180b20a0 0x7fcf1815be00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 -- 172.21.15.115:0/1604281633 >> 172.21.15.115:0/1604281633 conn(0x7fcf18072050 msgr2=0x7fcf18072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:18.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 -- 172.21.15.115:0/1604281633 shutdown_connections 2024-05-12T10:59:18.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 -- 172.21.15.115:0/1604281633 wait complete. 2024-05-12T10:59:18.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 Processor -- start 2024-05-12T10:59:18.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 -- start start 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf18071a30 0x7fcf180b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf180b20a0 0x7fcf1815b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf180cae10 0x7fcf180cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18071540 con 0x7fcf18071a30 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcf180cbb00 con 0x7fcf180cae10 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1815c340 con 0x7fcf180b20a0 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf17400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf18071a30 0x7fcf180b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf17400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf18071a30 0x7fcf180b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40596/0 (socket says 172.21.15.115:40596) 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf17400640 1 -- 172.21.15.115:0/3518621525 learned_addr learned my addr 172.21.15.115:0/3518621525 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf16a00640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf180b20a0 0x7fcf1815b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf17e00640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf180cae10 0x7fcf180cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf17400640 1 -- 172.21.15.115:0/3518621525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf180b20a0 msgr2=0x7fcf1815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf17400640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf180b20a0 0x7fcf1815b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf17400640 1 -- 172.21.15.115:0/3518621525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf180cae10 msgr2=0x7fcf180cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf17400640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf180cae10 0x7fcf180cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf17400640 1 -- 172.21.15.115:0/3518621525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf181f51d0 con 0x7fcf18071a30 2024-05-12T10:59:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf17400640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf18071a30 0x7fcf180b2480 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcf0801ce40 tx=0x7fcf0801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf0f400640 1 -- 172.21.15.115:0/3518621525 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf080bf020 con 0x7fcf18071a30 2024-05-12T10:59:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf0f400640 1 -- 172.21.15.115:0/3518621525 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcf080afe30 con 0x7fcf18071a30 2024-05-12T10:59:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf0f400640 1 -- 172.21.15.115:0/3518621525 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf080b4040 con 0x7fcf18071a30 2024-05-12T10:59:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.366+0000 7fcf1e600640 1 -- 172.21.15.115:0/3518621525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf181f54b0 con 0x7fcf18071a30 2024-05-12T10:59:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.370+0000 7fcf1e600640 1 -- 172.21.15.115:0/3518621525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf181f5a70 con 0x7fcf18071a30 2024-05-12T10:59:18.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.370+0000 7fcf1e600640 1 -- 172.21.15.115:0/3518621525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf181f1a10 con 0x7fcf18071a30 2024-05-12T10:59:18.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.370+0000 7fcf0f400640 1 -- 172.21.15.115:0/3518621525 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcf080c2070 con 0x7fcf18071a30 2024-05-12T10:59:18.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.370+0000 7fcf0f400640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcef806f430 0x7fcef80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.370+0000 7fcf0f400640 1 -- 172.21.15.115:0/3518621525 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fcf0812ce30 con 0x7fcf18071a30 2024-05-12T10:59:18.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.370+0000 7fcf16a00640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcef806f430 0x7fcef80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.374+0000 7fcf16a00640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcef806f430 0x7fcef80718f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcf180cdb00 tx=0x7fcf04008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:18.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.374+0000 7fcf0f400640 1 -- 172.21.15.115:0/3518621525 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcf181f1a10 con 0x7fcf18071a30 2024-05-12T10:59:18.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.566+0000 7fcf1e600640 1 -- 172.21.15.115:0/3518621525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcf18069730 con 0x7fcf18071a30 2024-05-12T10:59:18.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.570+0000 7fcf0f400640 1 -- 172.21.15.115:0/3518621525 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7fcf08018d70 con 0x7fcf18071a30 2024-05-12T10:59:18.560 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-12T10:59:18.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 -- 172.21.15.115:0/3518621525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcef806f430 msgr2=0x7fcef80718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcef806f430 0x7fcef80718f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcf180cdb00 tx=0x7fcf04008040 comp rx=0 tx=0).stop 2024-05-12T10:59:18.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 -- 172.21.15.115:0/3518621525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf18071a30 msgr2=0x7fcf180b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf18071a30 0x7fcf180b2480 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcf0801ce40 tx=0x7fcf0801bfb0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 -- 172.21.15.115:0/3518621525 shutdown_connections 2024-05-12T10:59:18.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fcef806f430 0x7fcef80718f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf180cae10 0x7fcf180cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf180b20a0 0x7fcf1815b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 --2- 172.21.15.115:0/3518621525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf18071a30 0x7fcf180b2480 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 -- 172.21.15.115:0/3518621525 >> 172.21.15.115:0/3518621525 conn(0x7fcf18072050 msgr2=0x7fcf180af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:18.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 -- 172.21.15.115:0/3518621525 shutdown_connections 2024-05-12T10:59:18.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.574+0000 7fcf1e600640 1 -- 172.21.15.115:0/3518621525 wait complete. 2024-05-12T10:59:18.587 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-12T10:59:18.628 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2024-05-12T10:59:18.629 INFO:tasks.ceph.mds.e.smithi115.stdout:starting mds.e at 2024-05-12T10:59:18.657 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-05-12T10:59:18.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.738+0000 7fe238e00640 1 Processor -- start 2024-05-12T10:59:18.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.738+0000 7fe238e00640 1 -- start start 2024-05-12T10:59:18.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe238e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe234152a10 0x7fe234159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe238e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe234073820 0x7fe23415c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe238e00640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe23415be20 con 0x7fe234152df0 2024-05-12T10:59:18.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe238e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe234072cf0 con 0x7fe234152a10 2024-05-12T10:59:18.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe238e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe234072fd0 con 0x7fe234073820 2024-05-12T10:59:18.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe231400640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe234152df0 0x7fe234073d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51772/0 (socket says 172.21.15.115:51772) 2024-05-12T10:59:18.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe231400640 1 -- 172.21.15.115:0/515662357 learned_addr learned my addr 172.21.15.115:0/515662357 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:59:18.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe231e00640 1 --2- 172.21.15.115:0/515662357 >> v2:172.21.15.134:3300/0 conn(0x7fe234152a10 0x7fe234159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe232800640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe234073820 0x7fe23415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522748181 0 0) 0x7fe23415be20 con 0x7fe234152df0 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe218003530 con 0x7fe234152df0 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 240886217 0 0) 0x7fe218003530 con 0x7fe234152df0 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe234073820 msgr2=0x7fe23415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe234073820 0x7fe23415c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 >> v2:172.21.15.134:3300/0 conn(0x7fe234152a10 msgr2=0x7fe234159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 --2- 172.21.15.115:0/515662357 >> v2:172.21.15.134:3300/0 conn(0x7fe234152a10 0x7fe234159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2340c4990 con 0x7fe234152df0 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fe220001700 con 0x7fe234152df0 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 >> v1:172.21.15.115:6789/0 conn(0x7fe234152df0 legacy=0x7fe234073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe218003a10 0x7fe218003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe218004810 0x7fe218004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe234073820 0x7fe2180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe234072cf0 con 0x7fe218003a10 2024-05-12T10:59:18.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe234072fd0 con 0x7fe218004810 2024-05-12T10:59:18.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe21800ba50 con 0x7fe234073820 2024-05-12T10:59:18.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe231e00640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe218003a10 0x7fe218003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe231400640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe218004810 0x7fe218004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe232800640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe234073820 0x7fe2180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe231e00640 1 -- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe234073820 msgr2=0x7fe2180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:18.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe231e00640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe234073820 0x7fe2180051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe231e00640 1 -- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe218004810 msgr2=0x7fe218004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:18.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe231e00640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe218004810 0x7fe218004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe231e00640 1 -- 172.21.15.115:0/515662357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe218003530 con 0x7fe218003a10 2024-05-12T10:59:18.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.742+0000 7fe231400640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe218004810 0x7fe218004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:59:18.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.746+0000 7fe231e00640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe218003a10 0x7fe218003e30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe224009fc0 tx=0x7fe22401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d39dd6c2f2b958 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:18.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.746+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240b2070 con 0x7fe218003a10 2024-05-12T10:59:18.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.746+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe2240a5bf0 con 0x7fe218003a10 2024-05-12T10:59:18.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.746+0000 7fe230a00640 1 -- 172.21.15.115:0/515662357 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224009c10 con 0x7fe218003a10 2024-05-12T10:59:18.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.746+0000 7fe238e00640 1 -- 172.21.15.115:0/515662357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe218003a10 msgr2=0x7fe218003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.746+0000 7fe238e00640 1 --2- 172.21.15.115:0/515662357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe218003a10 0x7fe218003e30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe224009fc0 tx=0x7fe22401ccc0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.746+0000 7fe232800640 1 -- 172.21.15.115:0/515662357 reap_dead start 2024-05-12T10:59:18.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.746+0000 7fe238e00640 1 -- 172.21.15.115:0/515662357 shutdown_connections 2024-05-12T10:59:18.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.746+0000 7fe238e00640 1 -- 172.21.15.115:0/515662357 >> 172.21.15.115:0/515662357 conn(0x7fe234076830 msgr2=0x7fe2340681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:18.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.746+0000 7fe238e00640 1 -- 172.21.15.115:0/515662357 shutdown_connections 2024-05-12T10:59:18.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.746+0000 7fe238e00640 1 -- 172.21.15.115:0/515662357 wait complete. 2024-05-12T10:59:18.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe238e00640 1 Processor -- start 2024-05-12T10:59:18.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe238e00640 1 -- start start 2024-05-12T10:59:18.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe238e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe218003a10 0x7fe23415b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe238e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe234152070 0x7fe23415a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe238e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2341f4f60 0x7fe23415a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe238e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe234073460 con 0x7fe2341f4f60 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe238e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe2340c4f50 con 0x7fe234152070 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe238e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe2340735e0 con 0x7fe218003a10 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe232800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2341f4f60 0x7fe23415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe232800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2341f4f60 0x7fe23415a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40648/0 (socket says 172.21.15.115:40648) 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe232800640 1 -- 172.21.15.115:0/3536834919 learned_addr learned my addr 172.21.15.115:0/3536834919 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe231400640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe234152070 0x7fe23415a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe231e00640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe218003a10 0x7fe23415b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe232800640 1 -- 172.21.15.115:0/3536834919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe218003a10 msgr2=0x7fe23415b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe232800640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe218003a10 0x7fe23415b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe232800640 1 -- 172.21.15.115:0/3536834919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe234152070 msgr2=0x7fe23415a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe232800640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe234152070 0x7fe23415a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe232800640 1 -- 172.21.15.115:0/3536834919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2341f5480 con 0x7fe2341f4f60 2024-05-12T10:59:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe231e00640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe218003a10 0x7fe23415b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:59:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe231400640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe234152070 0x7fe23415a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:59:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe232800640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2341f4f60 0x7fe23415a580 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe2340cb320 tx=0x7fe22c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe22a000640 1 -- 172.21.15.115:0/3536834919 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c003620 con 0x7fe2341f4f60 2024-05-12T10:59:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe22a000640 1 -- 172.21.15.115:0/3536834919 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe22c01b070 con 0x7fe2341f4f60 2024-05-12T10:59:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe22a000640 1 -- 172.21.15.115:0/3536834919 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c003a60 con 0x7fe2341f4f60 2024-05-12T10:59:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe238e00640 1 -- 172.21.15.115:0/3536834919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe234150ef0 con 0x7fe2341f4f60 2024-05-12T10:59:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe238e00640 1 -- 172.21.15.115:0/3536834919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2341514b0 con 0x7fe2341f4f60 2024-05-12T10:59:18.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.750+0000 7fe238e00640 1 -- 172.21.15.115:0/3536834919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe234069730 con 0x7fe2341f4f60 2024-05-12T10:59:18.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.754+0000 7fe22a000640 1 -- 172.21.15.115:0/3536834919 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe22c003c00 con 0x7fe2341f4f60 2024-05-12T10:59:18.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.754+0000 7fe22a000640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe21406f430 0x7fe2140718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:18.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.754+0000 7fe22a000640 1 -- 172.21.15.115:0/3536834919 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6993+0+0 (secure 0 0 0) 0x7fe22c08f640 con 0x7fe2341f4f60 2024-05-12T10:59:18.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.754+0000 7fe231e00640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe21406f430 0x7fe2140718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:18.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.754+0000 7fe231e00640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe21406f430 0x7fe2140718f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe2240af000 tx=0x7fe2240a7040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:18.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.758+0000 7fe22a000640 1 -- 172.21.15.115:0/3536834919 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe22c024020 con 0x7fe2341f4f60 2024-05-12T10:59:18.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:18.950+0000 7fe238e00640 1 -- 172.21.15.115:0/3536834919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe2340c52f0 con 0x7fe2341f4f60 2024-05-12T10:59:19.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.570+0000 7fe22a000640 1 -- 172.21.15.115:0/3536834919 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7fe22c05c020 con 0x7fe2341f4f60 2024-05-12T10:59:19.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 -- 172.21.15.115:0/3536834919 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe21406f430 msgr2=0x7fe2140718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:19.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe21406f430 0x7fe2140718f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe2240af000 tx=0x7fe2240a7040 comp rx=0 tx=0).stop 2024-05-12T10:59:19.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 -- 172.21.15.115:0/3536834919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2341f4f60 msgr2=0x7fe23415a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:19.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2341f4f60 0x7fe23415a580 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe2340cb320 tx=0x7fe22c011920 comp rx=0 tx=0).stop 2024-05-12T10:59:19.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 -- 172.21.15.115:0/3536834919 shutdown_connections 2024-05-12T10:59:19.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fe21406f430 0x7fe2140718f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:19.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2341f4f60 0x7fe23415a580 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:19.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe234152070 0x7fe23415a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:19.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 --2- 172.21.15.115:0/3536834919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe218003a10 0x7fe23415b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:19.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 -- 172.21.15.115:0/3536834919 >> 172.21.15.115:0/3536834919 conn(0x7fe234076830 msgr2=0x7fe2340ca430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:19.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 -- 172.21.15.115:0/3536834919 shutdown_connections 2024-05-12T10:59:19.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.574+0000 7fe238e00640 1 -- 172.21.15.115:0/3536834919 wait complete. 2024-05-12T10:59:19.589 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-12T10:59:19.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.790+0000 7fdc94000640 1 Processor -- start 2024-05-12T10:59:19.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.790+0000 7fdc94000640 1 -- start start 2024-05-12T10:59:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.790+0000 7fdc94000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdc8c15a560 0x7fdc8c071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.790+0000 7fdc94000640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8c0c45f0 con 0x7fdc8c142bc0 2024-05-12T10:59:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.790+0000 7fdc94000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8c0c48d0 con 0x7fdc8c0b4c10 2024-05-12T10:59:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.790+0000 7fdc94000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fdc8c0c4bb0 con 0x7fdc8c15a560 2024-05-12T10:59:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.790+0000 7fdc90c00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdc8c142bc0 0x7fdc8c159e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51776/0 (socket says 172.21.15.115:51776) 2024-05-12T10:59:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.790+0000 7fdc90c00640 1 -- 172.21.15.115:0/881074894 learned_addr learned my addr 172.21.15.115:0/881074894 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:59:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc92000640 1 --2- 172.21.15.115:0/881074894 >> v2:172.21.15.134:3300/0 conn(0x7fdc8c15a560 0x7fdc8c071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1663102136 0 0) 0x7fdc8c0c45f0 con 0x7fdc8c142bc0 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc74003530 con 0x7fdc8c142bc0 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3389958231 0 0) 0x7fdc74003530 con 0x7fdc8c142bc0 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 >> v2:172.21.15.134:3300/0 conn(0x7fdc8c15a560 msgr2=0x7fdc8c071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 --2- 172.21.15.115:0/881074894 >> v2:172.21.15.134:3300/0 conn(0x7fdc8c15a560 0x7fdc8c071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 >> v1:172.21.15.134:6789/0 conn(0x7fdc8c0b4c10 legacy=0x7fdc8c0cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c0c4e90 con 0x7fdc8c142bc0 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1627016313 0 0) 0x7fdc78001720 con 0x7fdc8c142bc0 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 >> v1:172.21.15.115:6789/0 conn(0x7fdc8c142bc0 legacy=0x7fdc8c159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc74003a60 0x7fdc74003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc74004810 0x7fdc74004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc740051d0 0x7fdc7400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c0c4bb0 con 0x7fdc740051d0 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7400c150 con 0x7fdc74003a60 2024-05-12T10:59:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7400c350 con 0x7fdc74004810 2024-05-12T10:59:19.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc92000640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc740051d0 0x7fdc7400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:19.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc91600640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc74003a60 0x7fdc74003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:19.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc90c00640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc74004810 0x7fdc74004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:19.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc92000640 1 -- 172.21.15.115:0/881074894 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc74004810 msgr2=0x7fdc74004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:19.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc92000640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc74004810 0x7fdc74004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:19.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc92000640 1 -- 172.21.15.115:0/881074894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc74003a60 msgr2=0x7fdc74003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:19.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc92000640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc74003a60 0x7fdc74003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:19.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc92000640 1 -- 172.21.15.115:0/881074894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc74003530 con 0x7fdc740051d0 2024-05-12T10:59:19.786 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.794+0000 7fdc91600640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc74003a60 0x7fdc74003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:59:19.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc92000640 1 -- 172.21.15.115:0/881074894 reap_dead start 2024-05-12T10:59:19.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc92000640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc740051d0 0x7fdc7400b9d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009f90 tx=0x7fdc8401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b656798cf54a193 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:19.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc840b2070 con 0x7fdc740051d0 2024-05-12T10:59:19.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdc840a5c90 con 0x7fdc740051d0 2024-05-12T10:59:19.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc8be00640 1 -- 172.21.15.115:0/881074894 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84009c10 con 0x7fdc740051d0 2024-05-12T10:59:19.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 -- 172.21.15.115:0/881074894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc740051d0 msgr2=0x7fdc7400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:19.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc740051d0 0x7fdc7400b9d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009f90 tx=0x7fdc8401cc80 comp rx=0 tx=0).stop 2024-05-12T10:59:19.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 -- 172.21.15.115:0/881074894 shutdown_connections 2024-05-12T10:59:19.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 --2- 172.21.15.115:0/881074894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc740051d0 0x7fdc7400b9d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:19.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 -- 172.21.15.115:0/881074894 >> 172.21.15.115:0/881074894 conn(0x7fdc8c06c840 msgr2=0x7fdc8c06cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:19.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 -- 172.21.15.115:0/881074894 shutdown_connections 2024-05-12T10:59:19.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 -- 172.21.15.115:0/881074894 wait complete. 2024-05-12T10:59:19.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 Processor -- start 2024-05-12T10:59:19.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 -- start start 2024-05-12T10:59:19.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc740051d0 0x7fdc8c156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:19.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc8c1f2fb0 0x7fdc8c0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:19.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc8c1e2f50 0x7fdc8c0c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:19.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c1598c0 con 0x7fdc8c1e2f50 2024-05-12T10:59:19.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c0b4ff0 con 0x7fdc8c1f2fb0 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.798+0000 7fdc94000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdc8c159e50 con 0x7fdc740051d0 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc92000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc8c1e2f50 0x7fdc8c0c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc92000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc8c1e2f50 0x7fdc8c0c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40670/0 (socket says 172.21.15.115:40670) 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc92000640 1 -- 172.21.15.115:0/3538224348 learned_addr learned my addr 172.21.15.115:0/3538224348 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc91600640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc740051d0 0x7fdc8c156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc90c00640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc8c1f2fb0 0x7fdc8c0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc92000640 1 -- 172.21.15.115:0/3538224348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc740051d0 msgr2=0x7fdc8c156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc92000640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc740051d0 0x7fdc8c156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc92000640 1 -- 172.21.15.115:0/3538224348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc8c1f2fb0 msgr2=0x7fdc8c0c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc92000640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc8c1f2fb0 0x7fdc8c0c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc92000640 1 -- 172.21.15.115:0/3538224348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c0c93f0 con 0x7fdc8c1e2f50 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc91600640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc740051d0 0x7fdc8c156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc90c00640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc8c1f2fb0 0x7fdc8c0c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:59:19.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc92000640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc8c1e2f50 0x7fdc8c0c68d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdc8401cab0 tx=0x7fdc84009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:19.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc89600640 1 -- 172.21.15.115:0/3538224348 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc840bc070 con 0x7fdc8c1e2f50 2024-05-12T10:59:19.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc89600640 1 -- 172.21.15.115:0/3538224348 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdc840b63f0 con 0x7fdc8c1e2f50 2024-05-12T10:59:19.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc94000640 1 -- 172.21.15.115:0/3538224348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8c0c96d0 con 0x7fdc8c1e2f50 2024-05-12T10:59:19.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc89600640 1 -- 172.21.15.115:0/3538224348 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc840b2040 con 0x7fdc8c1e2f50 2024-05-12T10:59:19.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc94000640 1 -- 172.21.15.115:0/3538224348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8c0c80f0 con 0x7fdc8c1e2f50 2024-05-12T10:59:19.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc94000640 1 -- 172.21.15.115:0/3538224348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc8c069730 con 0x7fdc8c1e2f50 2024-05-12T10:59:19.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.802+0000 7fdc89600640 1 -- 172.21.15.115:0/3538224348 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdc840bf070 con 0x7fdc8c1e2f50 2024-05-12T10:59:19.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.806+0000 7fdc89600640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc6c06f400 0x7fdc6c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:19.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.806+0000 7fdc89600640 1 -- 172.21.15.115:0/3538224348 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6993+0+0 (secure 0 0 0) 0x7fdc84129dc0 con 0x7fdc8c1e2f50 2024-05-12T10:59:19.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.806+0000 7fdc91600640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc6c06f400 0x7fdc6c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:19.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.806+0000 7fdc91600640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc6c06f400 0x7fdc6c0718c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdc80007fd0 tx=0x7fdc80009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:19.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.810+0000 7fdc89600640 1 -- 172.21.15.115:0/3538224348 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fdc84016990 con 0x7fdc8c1e2f50 2024-05-12T10:59:19.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:19.970+0000 7fdc94000640 1 -- 172.21.15.115:0/3538224348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdc8c0714a0 con 0x7fdc8c1e2f50 2024-05-12T10:59:20.852 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.862+0000 7fdc89600640 1 -- 172.21.15.115:0/3538224348 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fdc840f60b0 con 0x7fdc8c1e2f50 2024-05-12T10:59:20.852 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2024-05-12T10:59:20.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 -- 172.21.15.115:0/3538224348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc6c06f400 msgr2=0x7fdc6c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:20.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc6c06f400 0x7fdc6c0718c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdc80007fd0 tx=0x7fdc80009040 comp rx=0 tx=0).stop 2024-05-12T10:59:20.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 -- 172.21.15.115:0/3538224348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc8c1e2f50 msgr2=0x7fdc8c0c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:20.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc8c1e2f50 0x7fdc8c0c68d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdc8401cab0 tx=0x7fdc84009750 comp rx=0 tx=0).stop 2024-05-12T10:59:20.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 -- 172.21.15.115:0/3538224348 shutdown_connections 2024-05-12T10:59:20.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fdc6c06f400 0x7fdc6c0718c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:20.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc8c1e2f50 0x7fdc8c0c68d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:20.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc8c1f2fb0 0x7fdc8c0c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:20.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 --2- 172.21.15.115:0/3538224348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc740051d0 0x7fdc8c156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:20.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 -- 172.21.15.115:0/3538224348 >> 172.21.15.115:0/3538224348 conn(0x7fdc8c06c840 msgr2=0x7fdc8c06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:20.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 -- 172.21.15.115:0/3538224348 shutdown_connections 2024-05-12T10:59:20.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:20.866+0000 7fdc94000640 1 -- 172.21.15.115:0/3538224348 wait complete. 2024-05-12T10:59:20.877 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-12T10:59:21.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.026+0000 7f0c48c00640 1 Processor -- start 2024-05-12T10:59:21.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.026+0000 7f0c48c00640 1 -- start start 2024-05-12T10:59:21.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c48c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0c44153a70 0x7f0c440c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:21.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c48c00640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c440c9900 0x7f0c440c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:21.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c48c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c44070d00 con 0x7f0c440ccf10 2024-05-12T10:59:21.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c48c00640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f0c440c8420 con 0x7f0c440c9900 2024-05-12T10:59:21.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c48c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0c44070ab0 con 0x7f0c44153a70 2024-05-12T10:59:21.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c39400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c440c9900 0x7f0c440c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:21.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c39400640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c440c9900 0x7f0c440c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40680/0 (socket says 172.21.15.115:40680) 2024-05-12T10:59:21.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c39400640 1 -- 172.21.15.115:0/768480738 learned_addr learned my addr 172.21.15.115:0/768480738 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:21.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c41e00640 1 --2- 172.21.15.115:0/768480738 >> v2:172.21.15.134:3300/0 conn(0x7f0c44153a70 0x7f0c440c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:21.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c39400640 1 -- 172.21.15.115:0/768480738 >> v2:172.21.15.134:3300/0 conn(0x7f0c44153a70 msgr2=0x7f0c440c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:21.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c39400640 1 --2- 172.21.15.115:0/768480738 >> v2:172.21.15.134:3300/0 conn(0x7f0c44153a70 0x7f0c440c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c39400640 1 -- 172.21.15.115:0/768480738 >> v1:172.21.15.134:6789/0 conn(0x7f0c440ccf10 legacy=0x7f0c4406f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:21.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.030+0000 7f0c39400640 1 -- 172.21.15.115:0/768480738 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c440cb1c0 con 0x7f0c440c9900 2024-05-12T10:59:21.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c39400640 1 --2- 172.21.15.115:0/768480738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c440c9900 0x7f0c440c6f70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009870 tx=0x7f0c2c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9536b1089e68ea8e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:21.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c41400640 1 -- 172.21.15.115:0/768480738 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0b5070 con 0x7f0c440c9900 2024-05-12T10:59:21.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c41400640 1 -- 172.21.15.115:0/768480738 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0c2c0a8a10 con 0x7f0c440c9900 2024-05-12T10:59:21.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c41400640 1 -- 172.21.15.115:0/768480738 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0a8e00 con 0x7f0c440c9900 2024-05-12T10:59:21.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c48c00640 1 -- 172.21.15.115:0/768480738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c440c9900 msgr2=0x7f0c440c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:21.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c48c00640 1 --2- 172.21.15.115:0/768480738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c440c9900 0x7f0c440c6f70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009870 tx=0x7f0c2c01ed10 comp rx=0 tx=0).stop 2024-05-12T10:59:21.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c48c00640 1 -- 172.21.15.115:0/768480738 shutdown_connections 2024-05-12T10:59:21.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c48c00640 1 --2- 172.21.15.115:0/768480738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c440c9900 0x7f0c440c6f70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c48c00640 1 --2- 172.21.15.115:0/768480738 >> v2:172.21.15.134:3300/0 conn(0x7f0c44153a70 0x7f0c440c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c48c00640 1 -- 172.21.15.115:0/768480738 >> 172.21.15.115:0/768480738 conn(0x7f0c440cd320 msgr2=0x7f0c440cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:21.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c48c00640 1 -- 172.21.15.115:0/768480738 shutdown_connections 2024-05-12T10:59:21.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c48c00640 1 -- 172.21.15.115:0/768480738 wait complete. 2024-05-12T10:59:21.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c48c00640 1 Processor -- start 2024-05-12T10:59:21.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.034+0000 7f0c48c00640 1 -- start start 2024-05-12T10:59:21.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c48c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c440c9900 0x7f0c44146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:21.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c48c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c440ccf10 0x7f0c441486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:21.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c48c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c44153a70 0x7f0c44148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:21.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c48c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0c440cde40 con 0x7f0c44153a70 2024-05-12T10:59:21.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c48c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0c440c7f00 con 0x7f0c440ccf10 2024-05-12T10:59:21.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c48c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0c440cdfc0 con 0x7f0c440c9900 2024-05-12T10:59:21.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c42800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c44153a70 0x7f0c44148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:21.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c41e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c440c9900 0x7f0c44146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:21.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c42800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c44153a70 0x7f0c44148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40696/0 (socket says 172.21.15.115:40696) 2024-05-12T10:59:21.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c42800640 1 -- 172.21.15.115:0/4040622753 learned_addr learned my addr 172.21.15.115:0/4040622753 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:21.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c39400640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c440ccf10 0x7f0c441486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:21.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c42800640 1 -- 172.21.15.115:0/4040622753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c440c9900 msgr2=0x7f0c44146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:21.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c42800640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c440c9900 0x7f0c44146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c42800640 1 -- 172.21.15.115:0/4040622753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c440ccf10 msgr2=0x7f0c441486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:21.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c42800640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c440ccf10 0x7f0c441486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c42800640 1 -- 172.21.15.115:0/4040622753 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c44152b70 con 0x7f0c44153a70 2024-05-12T10:59:21.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c42800640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c44153a70 0x7f0c44148c30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c7b0 tx=0x7f0c3c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:21.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c3aa00640 1 -- 172.21.15.115:0/4040622753 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c003b80 con 0x7f0c44153a70 2024-05-12T10:59:21.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c3aa00640 1 -- 172.21.15.115:0/4040622753 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0c3c003d20 con 0x7f0c44153a70 2024-05-12T10:59:21.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c48c00640 1 -- 172.21.15.115:0/4040622753 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c441f06f0 con 0x7f0c44153a70 2024-05-12T10:59:21.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c3aa00640 1 -- 172.21.15.115:0/4040622753 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00aa90 con 0x7f0c44153a70 2024-05-12T10:59:21.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c48c00640 1 -- 172.21.15.115:0/4040622753 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c441f09d0 con 0x7f0c44153a70 2024-05-12T10:59:21.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c48c00640 1 -- 172.21.15.115:0/4040622753 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c44069730 con 0x7f0c44153a70 2024-05-12T10:59:21.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.038+0000 7f0c3aa00640 1 -- 172.21.15.115:0/4040622753 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0c3c00ac30 con 0x7f0c44153a70 2024-05-12T10:59:21.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.042+0000 7f0c3aa00640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0c2006f400 0x7f0c200718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:21.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.042+0000 7f0c3aa00640 1 -- 172.21.15.115:0/4040622753 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6555+0+0 (secure 0 0 0) 0x7f0c3c08f3c0 con 0x7f0c44153a70 2024-05-12T10:59:21.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.042+0000 7f0c41e00640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0c2006f400 0x7f0c200718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:21.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.042+0000 7f0c41e00640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0c2006f400 0x7f0c200718c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0c340079c0 tx=0x7f0c34008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.046+0000 7f0c3aa00640 1 -- 172.21.15.115:0/4040622753 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0c3c05b9a0 con 0x7f0c44153a70 2024-05-12T10:59:21.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.206+0000 7f0c48c00640 1 -- 172.21.15.115:0/4040622753 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0c44157390 con 0x7f0c44153a70 2024-05-12T10:59:21.821 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:59:21.825 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:59:21.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.862+0000 7f0c3aa00640 1 -- 172.21.15.115:0/4040622753 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f0c3c05fca0 con 0x7f0c44153a70 2024-05-12T10:59:21.854 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2024-05-12T10:59:21.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 -- 172.21.15.115:0/4040622753 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0c2006f400 msgr2=0x7f0c200718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:21.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0c2006f400 0x7f0c200718c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0c340079c0 tx=0x7f0c34008040 comp rx=0 tx=0).stop 2024-05-12T10:59:21.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 -- 172.21.15.115:0/4040622753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c44153a70 msgr2=0x7f0c44148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:21.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c44153a70 0x7f0c44148c30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c7b0 tx=0x7f0c3c00cc70 comp rx=0 tx=0).stop 2024-05-12T10:59:21.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 -- 172.21.15.115:0/4040622753 shutdown_connections 2024-05-12T10:59:21.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7f0c2006f400 0x7f0c200718c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c44153a70 0x7f0c44148c30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c440ccf10 0x7f0c441486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 --2- 172.21.15.115:0/4040622753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c440c9900 0x7f0c44146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 -- 172.21.15.115:0/4040622753 >> 172.21.15.115:0/4040622753 conn(0x7f0c440cd320 msgr2=0x7f0c440c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:21.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 -- 172.21.15.115:0/4040622753 shutdown_connections 2024-05-12T10:59:21.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:21.866+0000 7f0c48c00640 1 -- 172.21.15.115:0/4040622753 wait complete. 2024-05-12T10:59:21.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-12T10:59:22.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc216600640 1 Processor -- start 2024-05-12T10:59:22.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc216600640 1 -- start start 2024-05-12T10:59:22.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc216600640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc2100c7470 0x7fc2100c3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:22.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc216600640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2100c3850 con 0x7fc2100cd440 2024-05-12T10:59:22.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc216600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2100cbd20 con 0x7fc2100c7850 2024-05-12T10:59:22.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc216600640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fc21015dc30 con 0x7fc2100c7470 2024-05-12T10:59:22.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc20fe00640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc2100cd440 0x7fc210159ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51784/0 (socket says 172.21.15.115:51784) 2024-05-12T10:59:22.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc20fe00640 1 -- 172.21.15.115:0/1090943831 learned_addr learned my addr 172.21.15.115:0/1090943831 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-12T10:59:22.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc20f400640 1 --2- 172.21.15.115:0/1090943831 >> v2:172.21.15.115:3300/0 conn(0x7fc2100c7470 0x7fc2100c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:22.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc20f400640 1 -- 172.21.15.115:0/1090943831 >> v1:172.21.15.134:6789/0 conn(0x7fc2100c7850 legacy=0x7fc210153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T10:59:22.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc20f400640 1 -- 172.21.15.115:0/1090943831 >> v1:172.21.15.115:6789/0 conn(0x7fc2100cd440 legacy=0x7fc210159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:22.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.090+0000 7fc20f400640 1 -- 172.21.15.115:0/1090943831 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21015d020 con 0x7fc2100c7470 2024-05-12T10:59:22.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.094+0000 7fc20f400640 1 --2- 172.21.15.115:0/1090943831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2100c7470 0x7fc2100c3310 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc2000097c0 tx=0x7fc20001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7c9f23d5783cfd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:22.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.094+0000 7fc20e000640 1 -- 172.21.15.115:0/1090943831 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2000a7070 con 0x7fc2100c7470 2024-05-12T10:59:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.094+0000 7fc20e000640 1 -- 172.21.15.115:0/1090943831 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc2000b0070 con 0x7fc2100c7470 2024-05-12T10:59:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.094+0000 7fc20e000640 1 -- 172.21.15.115:0/1090943831 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2000ab8b0 con 0x7fc2100c7470 2024-05-12T10:59:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.094+0000 7fc216600640 1 -- 172.21.15.115:0/1090943831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2100c7470 msgr2=0x7fc2100c3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.094+0000 7fc216600640 1 --2- 172.21.15.115:0/1090943831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2100c7470 0x7fc2100c3310 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc2000097c0 tx=0x7fc20001c470 comp rx=0 tx=0).stop 2024-05-12T10:59:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.094+0000 7fc216600640 1 -- 172.21.15.115:0/1090943831 shutdown_connections 2024-05-12T10:59:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.094+0000 7fc216600640 1 --2- 172.21.15.115:0/1090943831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2100c7470 0x7fc2100c3310 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.094+0000 7fc216600640 1 -- 172.21.15.115:0/1090943831 >> 172.21.15.115:0/1090943831 conn(0x7fc210070860 msgr2=0x7fc210070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.094+0000 7fc216600640 1 -- 172.21.15.115:0/1090943831 shutdown_connections 2024-05-12T10:59:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.094+0000 7fc216600640 1 -- 172.21.15.115:0/1090943831 wait complete. 2024-05-12T10:59:22.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc216600640 1 Processor -- start 2024-05-12T10:59:22.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc216600640 1 -- start start 2024-05-12T10:59:22.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc216600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2100c7470 0x7fc21014a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:22.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc216600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2100c7850 0x7fc21015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:22.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc216600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2100cd440 0x7fc210158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:22.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc216600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc2100cba80 con 0x7fc2100c7850 2024-05-12T10:59:22.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc216600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc2100cb900 con 0x7fc2100c7470 2024-05-12T10:59:22.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc216600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc210154080 con 0x7fc2100cd440 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc20ea00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2100c7850 0x7fc21015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc20ea00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2100c7850 0x7fc21015c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40712/0 (socket says 172.21.15.115:40712) 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc20ea00640 1 -- 172.21.15.115:0/2975997759 learned_addr learned my addr 172.21.15.115:0/2975997759 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc20fe00640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2100cd440 0x7fc210158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc20f400640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2100c7470 0x7fc21014a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc20ea00640 1 -- 172.21.15.115:0/2975997759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2100cd440 msgr2=0x7fc210158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc20ea00640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2100cd440 0x7fc210158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc20ea00640 1 -- 172.21.15.115:0/2975997759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2100c7470 msgr2=0x7fc21014a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc20ea00640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2100c7470 0x7fc21014a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc20ea00640 1 -- 172.21.15.115:0/2975997759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2101555f0 con 0x7fc2100c7850 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc20ea00640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2100c7850 0x7fc21015c0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00c410 tx=0x7fc1fc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:22.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc207400640 1 -- 172.21.15.115:0/2975997759 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc017070 con 0x7fc2100c7850 2024-05-12T10:59:22.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc207400640 1 -- 172.21.15.115:0/2975997759 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc1fc003600 con 0x7fc2100c7850 2024-05-12T10:59:22.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc207400640 1 -- 172.21.15.115:0/2975997759 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc003a10 con 0x7fc2100c7850 2024-05-12T10:59:22.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc216600640 1 -- 172.21.15.115:0/2975997759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2101558d0 con 0x7fc2100c7850 2024-05-12T10:59:22.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc216600640 1 -- 172.21.15.115:0/2975997759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc210155e90 con 0x7fc2100c7850 2024-05-12T10:59:22.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.098+0000 7fc216600640 1 -- 172.21.15.115:0/2975997759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc210069730 con 0x7fc2100c7850 2024-05-12T10:59:22.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.102+0000 7fc207400640 1 -- 172.21.15.115:0/2975997759 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc1fc003bb0 con 0x7fc2100c7850 2024-05-12T10:59:22.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.102+0000 7fc207400640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1f006f400 0x7fc1f00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:22.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.102+0000 7fc207400640 1 -- 172.21.15.115:0/2975997759 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6025+0+0 (secure 0 0 0) 0x7fc1fc08e840 con 0x7fc2100c7850 2024-05-12T10:59:22.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.102+0000 7fc20f400640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1f006f400 0x7fc1f00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:22.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.102+0000 7fc20f400640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1f006f400 0x7fc1f00718c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc2000af000 tx=0x7fc2000a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:22.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.106+0000 7fc207400640 1 -- 172.21.15.115:0/2975997759 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc1fc05b5e0 con 0x7fc2100c7850 2024-05-12T10:59:22.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.266+0000 7fc216600640 1 -- 172.21.15.115:0/2975997759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc210070ce0 con 0x7fc2100c7850 2024-05-12T10:59:22.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.890+0000 7fc207400640 1 -- 172.21.15.115:0/2975997759 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7fc1fc05aee0 con 0x7fc2100c7850 2024-05-12T10:59:22.880 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data_ec' removed 2024-05-12T10:59:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 -- 172.21.15.115:0/2975997759 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1f006f400 msgr2=0x7fc1f00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1f006f400 0x7fc1f00718c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc2000af000 tx=0x7fc2000a7000 comp rx=0 tx=0).stop 2024-05-12T10:59:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 -- 172.21.15.115:0/2975997759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2100c7850 msgr2=0x7fc21015c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2100c7850 0x7fc21015c0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00c410 tx=0x7fc1fc00c8d0 comp rx=0 tx=0).stop 2024-05-12T10:59:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 -- 172.21.15.115:0/2975997759 shutdown_connections 2024-05-12T10:59:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.115:6832/1265716555,v1:172.21.15.115:6833/1265716555] conn(0x7fc1f006f400 0x7fc1f00718c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2100cd440 0x7fc210158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2100c7850 0x7fc21015c0d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 --2- 172.21.15.115:0/2975997759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2100c7470 0x7fc21014a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 -- 172.21.15.115:0/2975997759 >> 172.21.15.115:0/2975997759 conn(0x7fc210070860 msgr2=0x7fc210152bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 -- 172.21.15.115:0/2975997759 shutdown_connections 2024-05-12T10:59:22.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-12T10:59:22.894+0000 7fc216600640 1 -- 172.21.15.115:0/2975997759 wait complete. 2024-05-12T10:59:22.916 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-12T10:59:22.916 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-12T10:59:22.916 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:22.928 INFO:tasks.ceph.mds.a:Stopped 2024-05-12T10:59:22.928 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-12T10:59:22.928 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:22.982 INFO:tasks.ceph.mds.c:Stopped 2024-05-12T10:59:22.983 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-12T10:59:22.983 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:23.039 INFO:tasks.ceph.mds.e:Stopped 2024-05-12T10:59:23.039 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-12T10:59:23.039 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:23.056 INFO:tasks.ceph.mds.b:Stopped 2024-05-12T10:59:23.056 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-12T10:59:23.056 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:23.111 INFO:tasks.ceph.mds.d:Stopped 2024-05-12T10:59:23.111 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-12T10:59:23.111 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:23.166 INFO:tasks.ceph.mds.f:Stopped 2024-05-12T10:59:23.166 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-12T10:59:23.166 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-12T10:59:23.166 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:23.259 INFO:tasks.ceph.osd.0:Stopped 2024-05-12T10:59:23.260 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-12T10:59:23.260 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:23.358 INFO:tasks.ceph.osd.1:Stopped 2024-05-12T10:59:23.358 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-12T10:59:23.358 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:23.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-05-12T10:59:23.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-05-12T10:59:29.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-12T10:59:29.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-05-12T10:59:29.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-05-12T10:59:29.460 INFO:tasks.ceph.osd.2:Stopped 2024-05-12T10:59:29.460 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-12T10:59:29.460 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:29.560 INFO:tasks.ceph.osd.3:Stopped 2024-05-12T10:59:29.560 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-12T10:59:29.561 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:29.646 INFO:tasks.ceph.osd.4:Stopped 2024-05-12T10:59:29.646 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-12T10:59:29.646 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:29.729 INFO:tasks.ceph.osd.5:Stopped 2024-05-12T10:59:29.730 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-12T10:59:29.730 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:34.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-12T10:59:34.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-12T10:59:35.832 INFO:tasks.ceph.osd.6:Stopped 2024-05-12T10:59:35.832 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-12T10:59:35.832 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:35.916 INFO:tasks.ceph.osd.7:Stopped 2024-05-12T10:59:35.916 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-12T10:59:35.917 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-12T10:59:35.917 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:35.975 INFO:tasks.ceph.mgr.y:Stopped 2024-05-12T10:59:35.976 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-12T10:59:35.976 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:36.005 INFO:tasks.ceph.mgr.x:Stopped 2024-05-12T10:59:36.005 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-12T10:59:36.005 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-12T10:59:36.005 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:36.025 INFO:tasks.ceph.mon.a:Stopped 2024-05-12T10:59:36.026 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-12T10:59:36.026 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:36.066 INFO:tasks.ceph.mon.b:Stopped 2024-05-12T10:59:36.067 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-12T10:59:36.067 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T10:59:36.125 INFO:tasks.ceph.mon.c:Stopped 2024-05-12T10:59:36.125 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-12T10:59:36.126 DEBUG:teuthology.orchestra.run.smithi115:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-05-12T10:59:36.172 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:59:36.173 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-12T10:59:36.576 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:59:36.576 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-12T10:59:36.782 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:59:36.782 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-12T10:59:36.986 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T10:59:36.986 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-12T10:59:37.207 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi134.front.sepia.ceph.com 2024-05-12T10:59:37.207 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-12T10:59:37.627 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi134.front.sepia.ceph.com 2024-05-12T10:59:37.628 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-12T10:59:37.831 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi134.front.sepia.ceph.com 2024-05-12T10:59:37.832 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-12T10:59:38.001 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi134.front.sepia.ceph.com 2024-05-12T10:59:38.001 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-12T10:59:38.149 INFO:tasks.ceph:Archiving mon data... 2024-05-12T10:59:38.150 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/data/mon.a.tgz 2024-05-12T10:59:38.150 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-05-12T10:59:38.159 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.iT8t9OQOcZ 2024-05-12T10:59:38.160 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.iT8t9OQOcZ 2024-05-12T10:59:38.300 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.iT8t9OQOcZ 2024-05-12T10:59:38.375 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.iT8t9OQOcZ is 393KB 2024-05-12T10:59:38.440 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.iT8t9OQOcZ 2024-05-12T10:59:38.450 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/data/mon.b.tgz 2024-05-12T10:59:38.450 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-05-12T10:59:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.kYx2EUkGAY 2024-05-12T10:59:38.456 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kYx2EUkGAY 2024-05-12T10:59:38.588 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.kYx2EUkGAY 2024-05-12T10:59:38.655 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.kYx2EUkGAY is 405KB 2024-05-12T10:59:38.715 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.kYx2EUkGAY 2024-05-12T10:59:38.720 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/data/mon.c.tgz 2024-05-12T10:59:38.721 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-05-12T10:59:38.770 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.E0mcVEyTlN 2024-05-12T10:59:38.771 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.E0mcVEyTlN 2024-05-12T10:59:38.904 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.E0mcVEyTlN 2024-05-12T10:59:38.970 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.E0mcVEyTlN is 405KB 2024-05-12T10:59:39.035 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.E0mcVEyTlN 2024-05-12T10:59:39.040 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-12T10:59:39.041 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-12T10:59:39.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-12T10:59:39.114 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-12T10:59:39.146 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-12T10:59:39.146 INFO:tasks.ceph:Archiving crash dumps... 2024-05-12T10:59:39.149 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/remote/smithi115/crash 2024-05-12T10:59:39.150 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-12T10:59:39.182 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/remote/smithi134/crash 2024-05-12T10:59:39.183 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-12T10:59:39.202 INFO:tasks.ceph:Shutting down logrotate 2024-05-12T10:59:39.202 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:59:39.229 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T10:59:39.284 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-12T10:59:39.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-12T10:59:39.337 INFO:tasks.ceph:Compressing logs... 2024-05-12T10:59:39.338 DEBUG:teuthology.orchestra.run.smithi115:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-12T10:59:39.353 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-12T10:59:39.378 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35681.log 2024-05-12T10:59:39.378 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37740.log 2024-05-12T10:59:39.379 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33460.log 2024-05-12T10:59:39.380 INFO:teuthology.orchestra.run.smithi115.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35681.log.gz 2024-05-12T10:59:39.380 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37740.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-12T10:59:39.380 INFO:teuthology.orchestra.run.smithi115.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37740.log.gz 2024-05-12T10:59:39.381 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33687.log 2024-05-12T10:59:39.382 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34871.log 2024-05-12T10:59:39.382 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33687.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.33460.log.gz 2024-05-12T10:59:39.383 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36051.log 2024-05-12T10:59:39.383 INFO:teuthology.orchestra.run.smithi115.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33687.log.gz 2024-05-12T10:59:39.384 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34150.log 2024-05-12T10:59:39.384 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36051.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.34871.log.gz 2024-05-12T10:59:39.384 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34348.log 2024-05-12T10:59:39.385 INFO:teuthology.orchestra.run.smithi115.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36051.log.gz 2024-05-12T10:59:39.385 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37583.log 2024-05-12T10:59:39.385 INFO:teuthology.orchestra.run.smithi115.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34150.log.gz 2024-05-12T10:59:39.386 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32992.log 2024-05-12T10:59:39.387 INFO:teuthology.orchestra.run.smithi115.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34348.log.gz 2024-05-12T10:59:39.387 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36605.log 2024-05-12T10:59:39.387 INFO:teuthology.orchestra.run.smithi115.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37583.log.gz 2024-05-12T10:59:39.388 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.32992.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-12T10:59:39.388 INFO:teuthology.orchestra.run.smithi115.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32992.log.gz 2024-05-12T10:59:39.389 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34712.log 2024-05-12T10:59:39.389 INFO:teuthology.orchestra.run.smithi115.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36605.log.gz 2024-05-12T10:59:39.390 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33204.log 2024-05-12T10:59:39.391 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36203.log 2024-05-12T10:59:39.391 INFO:teuthology.orchestra.run.smithi115.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34712.log.gz 2024-05-12T10:59:39.391 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34372.log 2024-05-12T10:59:39.392 INFO:teuthology.orchestra.run.smithi115.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33204.log.gz 2024-05-12T10:59:39.393 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34768.log 2024-05-12T10:59:39.393 INFO:teuthology.orchestra.run.smithi115.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36203.log.gz 2024-05-12T10:59:39.394 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34608.log 2024-05-12T10:59:39.394 INFO:teuthology.orchestra.run.smithi115.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34372.log.gz 2024-05-12T10:59:39.394 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37609.log 2024-05-12T10:59:39.395 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34608.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34768.log.gz 2024-05-12T10:59:39.396 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33256.log 2024-05-12T10:59:39.396 INFO:teuthology.orchestra.run.smithi115.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34608.log.gz 2024-05-12T10:59:39.396 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37661.log 2024-05-12T10:59:39.397 INFO:teuthology.orchestra.run.smithi115.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37609.log.gz 2024-05-12T10:59:39.397 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36307.log 2024-05-12T10:59:39.398 INFO:teuthology.orchestra.run.smithi115.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33256.log.gz 2024-05-12T10:59:39.398 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32912.log 2024-05-12T10:59:39.399 INFO:teuthology.orchestra.run.smithi115.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37661.log.gz 2024-05-12T10:59:39.399 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28266.log 2024-05-12T10:59:39.400 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37766.log 2024-05-12T10:59:39.400 INFO:teuthology.orchestra.run.smithi115.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.36307.log.gz 2024-05-12T10:59:39.401 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-12T10:59:39.402 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28266.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-12T10:59:39.402 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28266.log.gz 2024-05-12T10:59:39.402 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28314.log 2024-05-12T10:59:39.402 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28194.log 2024-05-12T10:59:39.402 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28338.log 2024-05-12T10:59:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.32912.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32912.log.gz 2024-05-12T10:59:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33046.log 2024-05-12T10:59:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37818.log 2024-05-12T10:59:39.407 INFO:teuthology.orchestra.run.smithi115.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37766.log.gz 2024-05-12T10:59:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33046.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33046.log.gz 2024-05-12T10:59:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37934.log 2024-05-12T10:59:39.408 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36554.log 2024-05-12T10:59:39.408 INFO:teuthology.orchestra.run.smithi115.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37818.log.gz 2024-05-12T10:59:39.408 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37934.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37934.log.gz 2024-05-12T10:59:39.408 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35337.log 2024-05-12T10:59:39.408 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33653.log 2024-05-12T10:59:39.408 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35337.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36554.log.gz 2024-05-12T10:59:39.408 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33715.log 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35337.log.gz 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33653.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33653.log.gz 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33715.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33715.log.gz 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33545.log 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33949.log 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.33545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34556.log 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33545.log.gz 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34634.log 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33949.log.gz 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34556.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34556.log.gz -5 2024-05-12T10:59:39.413 INFO:teuthology.orchestra.run.smithi115.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37716.log 2024-05-12T10:59:39.414 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28314.log: /var/log/ceph/ceph-client.admin.28194.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28314.log.gz 2024-05-12T10:59:39.414 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28242.log 2024-05-12T10:59:39.414 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28194.log.gz 2024-05-12T10:59:39.414 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28218.log 2024-05-12T10:59:39.414 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28242.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.28338.log.gz 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28242.log.gz 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28218.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28218.log.gz 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mds.f.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28170.log 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph.audit.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 92.8% 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28290.log 2024-05-12T10:59:39.415 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28170.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-12T10:59:39.416 INFO:teuthology.orchestra.run.smithi134.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28170.log.gz 2024-05-12T10:59:39.416 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28290.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-12T10:59:39.416 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-12T10:59:39.416 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28290.log.gz 2024-05-12T10:59:39.416 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-12T10:59:39.416 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mon.b.log: 93.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-12T10:59:39.416 INFO:teuthology.orchestra.run.smithi134.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-12T10:59:39.419 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33627.log 2024-05-12T10:59:39.419 INFO:teuthology.orchestra.run.smithi115.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34634.log.gz 2024-05-12T10:59:39.419 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36722.log 2024-05-12T10:59:39.419 INFO:teuthology.orchestra.run.smithi115.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37716.log.gz 2024-05-12T10:59:39.419 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33627.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-12T10:59:39.419 INFO:teuthology.orchestra.run.smithi115.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33627.log.gz 2024-05-12T10:59:39.419 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37988.log 2024-05-12T10:59:39.419 INFO:teuthology.orchestra.run.smithi115.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36722.log.gz 2024-05-12T10:59:39.419 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33332.log 2024-05-12T10:59:39.419 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36940.log 2024-05-12T10:59:39.420 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37988.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37988.log.gz 2024-05-12T10:59:39.420 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34582.log 2024-05-12T10:59:39.420 INFO:teuthology.orchestra.run.smithi115.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33332.log.gz 2024-05-12T10:59:39.420 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37844.log 2024-05-12T10:59:39.421 INFO:teuthology.orchestra.run.smithi115.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36940.log.gz 2024-05-12T10:59:39.421 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37690.log 2024-05-12T10:59:39.422 INFO:teuthology.orchestra.run.smithi115.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34582.log.gz 2024-05-12T10:59:39.423 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37427.log 2024-05-12T10:59:39.423 INFO:teuthology.orchestra.run.smithi115.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37844.log.gz 2024-05-12T10:59:39.423 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36967.log 2024-05-12T10:59:39.424 INFO:teuthology.orchestra.run.smithi115.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37690.log.gz 2024-05-12T10:59:39.424 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37245.log 2024-05-12T10:59:39.425 INFO:teuthology.orchestra.run.smithi115.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37427.log.gz 2024-05-12T10:59:39.426 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33020.log 2024-05-12T10:59:39.427 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37245.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36967.log.gz 2024-05-12T10:59:39.427 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37401.log 2024-05-12T10:59:39.427 INFO:teuthology.orchestra.run.smithi115.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37245.log.gz 2024-05-12T10:59:39.428 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37167.log 2024-05-12T10:59:39.428 INFO:teuthology.orchestra.run.smithi115.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33020.log.gz 2024-05-12T10:59:39.429 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37479.log 2024-05-12T10:59:39.429 INFO:teuthology.orchestra.run.smithi115.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37401.log.gz 2024-05-12T10:59:39.430 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35251.log 2024-05-12T10:59:39.431 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37167.log: 89.3%/var/log/ceph/ceph-client.admin.37479.log: -- replaced with /var/log/ceph/ceph-client.admin.37167.log.gz 2024-05-12T10:59:39.431 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32721.log 2024-05-12T10:59:39.431 INFO:teuthology.orchestra.run.smithi115.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37479.log.gz 2024-05-12T10:59:39.432 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37048.log 2024-05-12T10:59:39.432 INFO:teuthology.orchestra.run.smithi115.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35251.log.gz 2024-05-12T10:59:39.433 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.32721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34159.log 2024-05-12T10:59:39.433 INFO:teuthology.orchestra.run.smithi115.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32721.log.gz 2024-05-12T10:59:39.434 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32790.log 2024-05-12T10:59:39.435 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34159.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37048.log.gz 2024-05-12T10:59:39.436 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34371.log 2024-05-12T10:59:39.436 INFO:teuthology.orchestra.run.smithi115.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34159.log.gz 2024-05-12T10:59:39.436 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.32790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34361.log 2024-05-12T10:59:39.437 INFO:teuthology.orchestra.run.smithi115.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32790.log.gz 2024-05-12T10:59:39.438 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35116.log 2024-05-12T10:59:39.438 INFO:teuthology.orchestra.run.smithi115.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34371.log.gz 2024-05-12T10:59:39.439 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36280.log 2024-05-12T10:59:39.439 INFO:teuthology.orchestra.run.smithi115.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34361.log.gz 2024-05-12T10:59:39.440 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34364.log 2024-05-12T10:59:39.440 INFO:teuthology.orchestra.run.smithi115.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35116.log.gz 2024-05-12T10:59:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35544.log 2024-05-12T10:59:39.441 INFO:teuthology.orchestra.run.smithi115.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36280.log.gz 2024-05-12T10:59:39.442 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34364.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-12T10:59:39.442 INFO:teuthology.orchestra.run.smithi115.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34364.log.gz 2024-05-12T10:59:39.443 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34140.log 2024-05-12T10:59:39.444 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.3.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35544.log.gz 2024-05-12T10:59:39.445 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36230.log 2024-05-12T10:59:39.446 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34140.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22768.log 2024-05-12T10:59:39.446 INFO:teuthology.orchestra.run.smithi115.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34140.log.gz 2024-05-12T10:59:39.447 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33282.log 2024-05-12T10:59:39.448 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph.tmp-client.admin.22768.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22768.log.gz 2024-05-12T10:59:39.448 INFO:teuthology.orchestra.run.smithi115.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.36230.log.gz 2024-05-12T10:59:39.450 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33282.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33282.log.gz 2024-05-12T10:59:39.450 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34376.log 2024-05-12T10:59:39.451 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36632.log 2024-05-12T10:59:39.453 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36001.log 2024-05-12T10:59:39.453 INFO:teuthology.orchestra.run.smithi115.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34376.log.gz 2024-05-12T10:59:39.454 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36632.log: 90.8%/var/log/ceph/ceph-client.admin.36001.log: -- replaced with /var/log/ceph/ceph-client.admin.36632.log.gz 2024-05-12T10:59:39.456 INFO:teuthology.orchestra.run.smithi115.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.36001.log.gz 2024-05-12T10:59:39.456 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-12T10:59:39.457 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33793.log 2024-05-12T10:59:39.458 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37297.log 2024-05-12T10:59:39.460 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33793.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33793.log.gz 2024-05-12T10:59:39.461 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37297.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37297.log.gz 2024-05-12T10:59:39.461 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32938.log 2024-05-12T10:59:39.463 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34686.log 2024-05-12T10:59:39.465 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.32938.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32938.log.gz 2024-05-12T10:59:39.465 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34686.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34686.log.gz 2024-05-12T10:59:39.466 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34821.log 2024-05-12T10:59:39.467 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33230.log 2024-05-12T10:59:39.470 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34821.log: /var/log/ceph/ceph-client.admin.33230.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.34821.log.gz 2024-05-12T10:59:39.470 INFO:teuthology.orchestra.run.smithi115.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33230.log.gz 2024-05-12T10:59:39.470 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37100.log 2024-05-12T10:59:39.471 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33741.log 2024-05-12T10:59:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37100.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37100.log.gz 2024-05-12T10:59:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33741.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33741.log.gz 2024-05-12T10:59:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36772.log 2024-05-12T10:59:39.475 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33152.log 2024-05-12T10:59:39.477 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36772.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36772.log.gz 2024-05-12T10:59:39.477 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33152.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33152.log.gz 2024-05-12T10:59:39.478 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36801.log 2024-05-12T10:59:39.479 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34154.log 2024-05-12T10:59:39.481 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36801.log: /var/log/ceph/ceph-client.admin.34154.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.36801.log.gz 2024-05-12T10:59:39.481 INFO:teuthology.orchestra.run.smithi115.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34154.log.gz 2024-05-12T10:59:39.482 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35597.log 2024-05-12T10:59:39.483 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37792.log 2024-05-12T10:59:39.485 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35597.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35597.log.gz 2024-05-12T10:59:39.485 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37792.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37792.log.gz 2024-05-12T10:59:39.486 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34370.log 2024-05-12T10:59:39.486 INFO:teuthology.orchestra.run.smithi115.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-12T10:59:39.487 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35467.log 2024-05-12T10:59:39.488 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34370.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-12T10:59:39.489 INFO:teuthology.orchestra.run.smithi115.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34370.log.gz 2024-05-12T10:59:39.489 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37021.log 2024-05-12T10:59:39.490 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35467.log.gz 2024-05-12T10:59:39.492 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37021.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37021.log.gz 2024-05-12T10:59:39.493 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27795.log 2024-05-12T10:59:39.493 INFO:teuthology.orchestra.run.smithi115.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-12T10:59:39.493 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33100.log 2024-05-12T10:59:39.495 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.27795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33072.log 2024-05-12T10:59:39.495 INFO:teuthology.orchestra.run.smithi115.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27795.log.gz 2024-05-12T10:59:39.496 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33100.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33100.log.gz 2024-05-12T10:59:39.497 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33072.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33072.log.gz 2024-05-12T10:59:39.497 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36885.log 2024-05-12T10:59:39.499 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33126.log 2024-05-12T10:59:39.500 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34932.log 2024-05-12T10:59:39.501 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33126.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36885.log.gz 2024-05-12T10:59:39.501 INFO:teuthology.orchestra.run.smithi115.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33126.log.gz 2024-05-12T10:59:39.502 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33767.log 2024-05-12T10:59:39.503 INFO:teuthology.orchestra.run.smithi115.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34932.log.gz 2024-05-12T10:59:39.504 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34158.log 2024-05-12T10:59:39.505 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37505.log 2024-05-12T10:59:39.505 INFO:teuthology.orchestra.run.smithi115.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33767.log.gz 2024-05-12T10:59:39.506 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34158.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34158.log.gz 2024-05-12T10:59:39.507 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37505.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37505.log.gz 2024-05-12T10:59:39.508 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37870.log 2024-05-12T10:59:39.509 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35872.log 2024-05-12T10:59:39.510 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33951.log 2024-05-12T10:59:39.511 INFO:teuthology.orchestra.run.smithi115.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37870.log.gz 2024-05-12T10:59:39.512 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35872.log: /var/log/ceph/ceph-client.admin.33951.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35872.log.gz 2024-05-12T10:59:39.512 INFO:teuthology.orchestra.run.smithi115.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33951.log.gz 2024-05-12T10:59:39.513 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37375.log 2024-05-12T10:59:39.514 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35090.log 2024-05-12T10:59:39.515 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36359.log 2024-05-12T10:59:39.516 INFO:teuthology.orchestra.run.smithi115.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37375.log.gz 2024-05-12T10:59:39.517 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35090.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35090.log.gz 2024-05-12T10:59:39.518 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36359.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36359.log.gz 2024-05-12T10:59:39.518 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35194.log 2024-05-12T10:59:39.519 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36527.log 2024-05-12T10:59:39.521 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37960.log 2024-05-12T10:59:39.521 INFO:teuthology.orchestra.run.smithi115.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35194.log.gz 2024-05-12T10:59:39.522 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36527.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36527.log.gz 2024-05-12T10:59:39.522 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36121.log 2024-05-12T10:59:39.523 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37960.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37960.log.gz 2024-05-12T10:59:39.524 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34147.log 2024-05-12T10:59:39.525 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36121.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36121.log.gz 2024-05-12T10:59:39.525 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36695.log 2024-05-12T10:59:39.526 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37531.log 2024-05-12T10:59:39.527 INFO:teuthology.orchestra.run.smithi115.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34147.log.gz 2024-05-12T10:59:39.527 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36695.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36695.log.gz 2024-05-12T10:59:39.528 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37531.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37531.log.gz 2024-05-12T10:59:39.529 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36386.log 2024-05-12T10:59:39.530 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33575.log 2024-05-12T10:59:39.531 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35708.log 2024-05-12T10:59:39.532 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33575.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.36386.log.gz 2024-05-12T10:59:39.532 INFO:teuthology.orchestra.run.smithi115.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33575.log.gz 2024-05-12T10:59:39.534 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27695.log 2024-05-12T10:59:39.535 INFO:teuthology.orchestra.run.smithi115.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35708.log.gz 2024-05-12T10:59:39.536 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37141.log 2024-05-12T10:59:39.537 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.27695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37219.log 2024-05-12T10:59:39.537 INFO:teuthology.orchestra.run.smithi115.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27695.log.gz 2024-05-12T10:59:39.538 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37141.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37141.log.gz 2024-05-12T10:59:39.538 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33944.log 2024-05-12T10:59:39.541 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37219.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37219.log.gz 2024-05-12T10:59:39.541 INFO:teuthology.orchestra.run.smithi115.stderr:gzip/var/log/ceph/ceph-client.admin.33944.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35925.log 2024-05-12T10:59:39.541 INFO:teuthology.orchestra.run.smithi115.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33944.log.gz 2024-05-12T10:59:39.542 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-12T10:59:39.543 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35925.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35925.log.gz 2024-05-12T10:59:39.545 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph.audit.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-12T10:59:39.546 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-12T10:59:39.547 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37193.log 2024-05-12T10:59:39.548 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32826.log 2024-05-12T10:59:39.549 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37193.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37193.log.gz 2024-05-12T10:59:39.550 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.32826.log: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-12T10:59:39.550 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-12T10:59:39.551 INFO:teuthology.orchestra.run.smithi115.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32826.log.gz 2024-05-12T10:59:39.552 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35066.log 2024-05-12T10:59:39.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.4.log: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-12T10:59:39.553 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37349.log 2024-05-12T10:59:39.554 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.0.35066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35066.log.gz 2024-05-12T10:59:39.554 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35624.log 2024-05-12T10:59:39.557 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37349.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37349.log.gz 2024-05-12T10:59:39.557 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35142.log 2024-05-12T10:59:39.557 INFO:teuthology.orchestra.run.smithi115.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.35624.log.gz 2024-05-12T10:59:39.559 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35142.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35142.log.gz 2024-05-12T10:59:39.560 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34142.log 2024-05-12T10:59:39.561 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34660.log 2024-05-12T10:59:39.562 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34142.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34157.log 2024-05-12T10:59:39.563 INFO:teuthology.orchestra.run.smithi115.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34142.log.gz 2024-05-12T10:59:39.564 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34660.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34660.log.gz 2024-05-12T10:59:39.565 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.34157.log: /var/log/ceph/ceph-client.admin.33178.log 2024-05-12T10:59:39.565 INFO:teuthology.orchestra.run.smithi115.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34157.log.gz 2024-05-12T10:59:39.566 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35220.log 2024-05-12T10:59:39.568 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34742.log 2024-05-12T10:59:39.568 INFO:teuthology.orchestra.run.smithi115.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33178.log.gz 2024-05-12T10:59:39.569 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35220.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35220.log.gz 2024-05-12T10:59:39.570 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.34742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35168.log 2024-05-12T10:59:39.572 INFO:teuthology.orchestra.run.smithi115.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34742.log.gz 2024-05-12T10:59:39.572 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37635.log 2024-05-12T10:59:39.573 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35168.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35168.log.gz 2024-05-12T10:59:39.574 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37635.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37635.log.gz 2024-05-12T10:59:39.575 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33937.log 2024-05-12T10:59:39.576 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33871.log 2024-05-12T10:59:39.578 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33937.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33937.log.gz 2024-05-12T10:59:39.578 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33871.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33871.log.gz 2024-05-12T10:59:39.579 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33819.log 2024-05-12T10:59:39.580 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33518.log 2024-05-12T10:59:39.582 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33819.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33819.log.gz 2024-05-12T10:59:39.582 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33845.log 2024-05-12T10:59:39.583 INFO:teuthology.orchestra.run.smithi115.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33518.log.gz 2024-05-12T10:59:39.584 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33601.log 2024-05-12T10:59:39.585 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33845.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33845.log.gz 2024-05-12T10:59:39.586 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33601.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33601.log.gz 2024-05-12T10:59:39.586 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35440.log 2024-05-12T10:59:39.588 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36858.log 2024-05-12T10:59:39.589 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35440.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35440.log.gz 2024-05-12T10:59:39.590 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36858.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36858.log.gz 2024-05-12T10:59:39.590 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35845.log 2024-05-12T10:59:39.592 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35517.log 2024-05-12T10:59:39.593 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35845.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35845.log.gz 2024-05-12T10:59:39.594 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35517.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35517.log.gz 2024-05-12T10:59:39.594 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37323.log 2024-05-12T10:59:39.596 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37271.log 2024-05-12T10:59:39.597 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37323.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37323.log.gz 2024-05-12T10:59:39.598 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.37271.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37271.log.gz 2024-05-12T10:59:39.599 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35951.log 2024-05-12T10:59:39.600 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35387.log 2024-05-12T10:59:39.602 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35951.log: /var/log/ceph/ceph-client.admin.35387.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35951.log.gz 2024-05-12T10:59:39.602 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-05-12T10:59:39.603 INFO:teuthology.orchestra.run.smithi115.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35387.log.gz 2024-05-12T10:59:39.604 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37453.log 2024-05-12T10:59:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.37453.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37453.log.gz 2024-05-12T10:59:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33897.log 2024-05-12T10:59:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33897.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33897.log.gz 2024-05-12T10:59:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35287.log 2024-05-12T10:59:39.612 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.35287.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35287.log.gz 2024-05-12T10:59:39.613 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33946.log 2024-05-12T10:59:39.616 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36148.log 2024-05-12T10:59:39.617 INFO:teuthology.orchestra.run.smithi115.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33946.log.gz 2024-05-12T10:59:39.618 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33938.log 2024-05-12T10:59:39.619 INFO:teuthology.orchestra.run.smithi134.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-12T10:59:39.621 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.36148.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.36148.log.gz 2024-05-12T10:59:39.622 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34363.log 2024-05-12T10:59:39.623 INFO:teuthology.orchestra.run.smithi115.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-12T10:59:39.625 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33938.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.33938.log.gz -5 2024-05-12T10:59:39.625 INFO:teuthology.orchestra.run.smithi115.stderr: --verbose/var/log/ceph/ceph-client.admin.34363.log: -- /var/log/ceph/ceph-client.admin.27575.log 2024-05-12T10:59:39.625 INFO:teuthology.orchestra.run.smithi115.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34363.log.gz 2024-05-12T10:59:39.626 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33933.log 2024-05-12T10:59:39.628 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.27575.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.27575.log.gz 2024-05-12T10:59:39.629 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33933.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33933.log.gz 2024-05-12T10:59:39.629 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33948.log 2024-05-12T10:59:39.630 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35048.log 2024-05-12T10:59:39.632 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.33948.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33948.log.gz 2024-05-12T10:59:39.632 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.0.35048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35048.log.gz 2024-05-12T10:59:39.633 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32964.log 2024-05-12T10:59:39.634 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37557.log 2024-05-12T10:59:39.636 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.32964.log: 88.1%/var/log/ceph/ceph-client.admin.37557.log: -- replaced with /var/log/ceph/ceph-client.admin.32964.log.gz 2024-05-12T10:59:39.636 INFO:teuthology.orchestra.run.smithi115.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37557.log.gz 2024-05-12T10:59:39.651 INFO:teuthology.orchestra.run.smithi115.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-05-12T10:59:39.846 INFO:teuthology.orchestra.run.smithi115.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-12T10:59:39.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-12T10:59:45.378 INFO:teuthology.orchestra.run.smithi134.stderr: 98.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-12T10:59:45.649 INFO:teuthology.orchestra.run.smithi134.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-12T10:59:46.108 INFO:teuthology.orchestra.run.smithi115.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-12T10:59:47.070 INFO:teuthology.orchestra.run.smithi115.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-12T10:59:47.726 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-12T10:59:48.399 INFO:teuthology.orchestra.run.smithi134.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-12T10:59:48.616 INFO:teuthology.orchestra.run.smithi134.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-12T10:59:48.619 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-05-12T10:59:48.619 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m9.233s 2024-05-12T10:59:48.619 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m37.707s 2024-05-12T10:59:48.619 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m1.445s 2024-05-12T10:59:49.800 INFO:teuthology.orchestra.run.smithi115.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-12T10:59:51.324 INFO:teuthology.orchestra.run.smithi115.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-12T10:59:51.326 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-05-12T10:59:51.326 INFO:teuthology.orchestra.run.smithi115.stderr:real 0m11.970s 2024-05-12T10:59:51.326 INFO:teuthology.orchestra.run.smithi115.stderr:user 0m34.711s 2024-05-12T10:59:51.327 INFO:teuthology.orchestra.run.smithi115.stderr:sys 0m3.041s 2024-05-12T10:59:51.327 INFO:tasks.ceph:Archiving logs... 2024-05-12T10:59:51.328 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/remote/smithi115/log 2024-05-12T10:59:51.329 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-12T10:59:56.530 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/remote/smithi134/log 2024-05-12T10:59:56.531 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-12T11:00:01.085 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-12T11:00:01.095 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-12T11:00:01.095 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-12T11:00:01.098 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-12T11:00:01.176 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-12T11:00:01.199 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-12T11:00:01.199 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T11:00:01.203 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T11:00:01.215 INFO:teuthology.orchestra.run.smithi115.stdout: remote refid st t when poll reach delay offset jitter 2024-05-12T11:00:01.215 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================== 2024-05-12T11:00:01.215 INFO:teuthology.orchestra.run.smithi115.stdout:+hv01.front.sepi 67.205.162.81 3 u 60 64 377 0.057 -1.667 1.540 2024-05-12T11:00:01.215 INFO:teuthology.orchestra.run.smithi115.stdout:+hv02.front.sepi 63.231.80.2 3 u 62 64 377 0.107 -1.777 1.614 2024-05-12T11:00:01.215 INFO:teuthology.orchestra.run.smithi115.stdout:*hv03.front.sepi 74.6.168.72 3 u 59 64 377 0.075 -0.586 1.553 2024-05-12T11:00:01.215 INFO:teuthology.orchestra.run.smithi115.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-05-12T11:00:01.216 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-05-12T11:00:01.216 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-05-12T11:00:01.216 INFO:teuthology.orchestra.run.smithi134.stdout:+hv01.front.sepi 67.205.162.81 3 u 62 64 377 0.120 -6.115 3.377 2024-05-12T11:00:01.216 INFO:teuthology.orchestra.run.smithi134.stdout:+hv02.front.sepi 63.231.80.2 3 u 67 64 377 0.091 +0.325 2.368 2024-05-12T11:00:01.216 INFO:teuthology.orchestra.run.smithi134.stdout:*hv03.front.sepi 74.6.168.72 3 u 64 64 377 0.083 -2.196 1.625 2024-05-12T11:00:01.217 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-05-12T11:00:01.217 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-12T11:00:01.227 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-12T11:00:01.227 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-12T11:00:01.236 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-12T11:00:01.244 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-12T11:00:01.253 INFO:teuthology.task.internal:Duration was 1307.682443 seconds 2024-05-12T11:00:01.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-12T11:00:01.262 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-12T11:00:01.262 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-12T11:00:01.265 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-12T11:00:01.335 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-12T11:00:01.335 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-05-12T11:00:01.336 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-12T11:00:01.356 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-05-12T11:00:01.356 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-12T11:00:01.366 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-12T11:00:01.366 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-12T11:00:01.401 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-12T11:00:01.438 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-12T11:00:01.438 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-12T11:00:01.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-12T11:00:01.561 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-12T11:00:01.572 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-12T11:00:01.572 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-12T11:00:01.592 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-12T11:00:01.604 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-12T11:00:01.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-12T11:00:01.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-12T11:00:01.659 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-05-12T11:00:01.662 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-05-12T11:00:01.680 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-12T11:00:01.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T11:00:01.733 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-12T11:00:01.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T11:00:01.738 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-12T11:00:01.749 INFO:teuthology.task.internal:Transferring archived files... 2024-05-12T11:00:01.750 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/remote/smithi115 2024-05-12T11:00:01.750 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-12T11:00:01.800 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703265/remote/smithi134 2024-05-12T11:00:01.800 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-12T11:00:01.825 INFO:teuthology.task.internal:Removing archive directory... 2024-05-12T11:00:01.825 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-12T11:00:01.840 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-12T11:00:01.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-12T11:00:01.878 INFO:teuthology.task.internal:Not uploading archives. 2024-05-12T11:00:01.879 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-12T11:00:01.930 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-12T11:00:01.930 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-12T11:00:01.934 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-12T11:00:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: 655425 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 12 11:00 /home/ubuntu/cephtest 2024-05-12T11:00:01.940 INFO:teuthology.orchestra.run.smithi134.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 12 11:00 /home/ubuntu/cephtest 2024-05-12T11:00:01.941 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-12T11:00:01.953 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-12T11:00:01.980 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} duration: 1307.6824429035187 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-05-12T11:00:01.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-12T11:00:02.064 INFO:teuthology.run:pass